[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:37:29 dist-test-slave-zj8q krb5kdc[25299](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:37:29 dist-test-slave-zj8q krb5kdc[25299](info): set up 2 sockets
Aug 11 16:37:29 dist-test-slave-zj8q krb5kdc[25299](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260811 16:37:30.648957 25279 mini_kdc.cc:121] Time spent starting KDC: real 1.189s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Aug 11 16:37:30 dist-test-slave-zj8q krb5kdc[25299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466250, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:37:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:37:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab.
Entry for principal kudu/127.24.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab.
I20260811 16:37:30.762225 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:37311
--webserver_interface=127.24.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:42365
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.175.254:37311
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:37:30.848762 25316 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:37:30.848955 25316 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:37:30.848978 25316 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:37:30.850135 25316 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:37:30.850201 25316 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:37:30.850216 25316 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:37:30.850230 25316 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:37:30.850255 25316 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:37:30.852029 25316 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:42365
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.175.254:37311
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:37311
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25316
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:37:30.852247 25316 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:37:30.852448 25316 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:37:30.857383 25327 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:37:30.857424 25316 server_base.cc:1034] running on GCE node
W20260811 16:37:30.857391 25333 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:30.857415 25328 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:37:30.857887 25316 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:37:30.858314 25316 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:37:30.859457 25316 hybrid_clock.cc:648] HybridClock initialized: now 1786466250859406 us; error 67 us; skew 500 ppm
Aug 11 16:37:30 dist-test-slave-zj8q krb5kdc[25299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466250, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:37:30.862298 25316 init.cc:377] Logged in from keytab as kudu/127.24.175.254@KRBTEST.COM (short username kudu)
I20260811 16:37:30.862753 25316 webserver.cc:460] Webserver started at http://127.24.175.254:45557/ using document root <none> and password file <none>
I20260811 16:37:30.862946 25316 fs_manager.cc:359] Metadata directory not provided
I20260811 16:37:30.862989 25316 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:37:30.863108 25316 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:37:30.864300 25316 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/minicluster-data/master-0/data/instance:
uuid: "867769868c0c49ecb4d59a9e46edd7cd"
format_stamp: "Formatted at 2026-08-11 16:37:30 on dist-test-slave-zj8q"
server_key: "e994d9d11510e16a548c7275241ade69"
server_key_iv: "181cfc4152306375be8023718733df37"
server_key_version: "encryptionkey@0"
I20260811 16:37:30.864692 25316 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/minicluster-data/master-0/wal/instance:
uuid: "867769868c0c49ecb4d59a9e46edd7cd"
format_stamp: "Formatted at 2026-08-11 16:37:30 on dist-test-slave-zj8q"
server_key: "e994d9d11510e16a548c7275241ade69"
server_key_iv: "181cfc4152306375be8023718733df37"
server_key_version: "encryptionkey@0"
I20260811 16:37:30.866350 25316 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:37:30.867017 25343 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:30.867216 25316 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:37:30.867304 25316 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/minicluster-data/master-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/minicluster-data/master-0/wal
uuid: "867769868c0c49ecb4d59a9e46edd7cd"
format_stamp: "Formatted at 2026-08-11 16:37:30 on dist-test-slave-zj8q"
server_key: "e994d9d11510e16a548c7275241ade69"
server_key_iv: "181cfc4152306375be8023718733df37"
server_key_version: "encryptionkey@0"
I20260811 16:37:30.867377 25316 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:37:30.892603 25316 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:37:30.895177 25316 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:37:30.895359 25316 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:37:30.908192 25316 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.254:37311
I20260811 16:37:30.908566 25435 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.254:37311 every 8 connection(s)
I20260811 16:37:30.908692 25316 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
I20260811 16:37:30.909878 25436 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:37:30.914132 25436 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 867769868c0c49ecb4d59a9e46edd7cd: Bootstrap starting.
I20260811 16:37:30.915406 25436 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 867769868c0c49ecb4d59a9e46edd7cd: Neither blocks nor log segments found. Creating new log.
I20260811 16:37:30.916491 25436 log.cc:824] T 00000000000000000000000000000000 P 867769868c0c49ecb4d59a9e46edd7cd: Log is configured to *not* fsync() on all Append() calls
I20260811 16:37:30.916795 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 25316
I20260811 16:37:30.916882 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/minicluster-data/master-0/wal/instance
I20260811 16:37:30.917476 25436 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 867769868c0c49ecb4d59a9e46edd7cd: No bootstrap required, opened a new log
I20260811 16:37:30.917729 25279 external_mini_cluster.cc:1428] Setting key c3bef3fb3f3acb407ea6585f0e30f443
I20260811 16:37:30.922135 25436 raft_consensus.cc:348] T 00000000000000000000000000000000 P 867769868c0c49ecb4d59a9e46edd7cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "867769868c0c49ecb4d59a9e46edd7cd" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 37311 } }
I20260811 16:37:30.922338 25436 raft_consensus.cc:374] T 00000000000000000000000000000000 P 867769868c0c49ecb4d59a9e46edd7cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:37:30.922381 25436 raft_consensus.cc:729] T 00000000000000000000000000000000 P 867769868c0c49ecb4d59a9e46edd7cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 867769868c0c49ecb4d59a9e46edd7cd, State: Initialized, Role: FOLLOWER
I20260811 16:37:30.922513 25436 consensus_queue.cc:260] T 00000000000000000000000000000000 P 867769868c0c49ecb4d59a9e46edd7cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "867769868c0c49ecb4d59a9e46edd7cd" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 37311 } }
I20260811 16:37:30.922645 25436 raft_consensus.cc:388] T 00000000000000000000000000000000 P 867769868c0c49ecb4d59a9e46edd7cd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:37:30.922690 25436 raft_consensus.cc:482] T 00000000000000000000000000000000 P 867769868c0c49ecb4d59a9e46edd7cd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:37:30.922742 25436 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 867769868c0c49ecb4d59a9e46edd7cd [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:37:30.924197 25436 raft_consensus.cc:504] T 00000000000000000000000000000000 P 867769868c0c49ecb4d59a9e46edd7cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "867769868c0c49ecb4d59a9e46edd7cd" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 37311 } }
I20260811 16:37:30.924322 25436 leader_election.cc:302] T 00000000000000000000000000000000 P 867769868c0c49ecb4d59a9e46edd7cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 867769868c0c49ecb4d59a9e46edd7cd; no voters:
I20260811 16:37:30.924496 25436 leader_election.cc:288] T 00000000000000000000000000000000 P 867769868c0c49ecb4d59a9e46edd7cd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:37:30.924531 25448 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 867769868c0c49ecb4d59a9e46edd7cd [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:37:30.924677 25448 raft_consensus.cc:686] T 00000000000000000000000000000000 P 867769868c0c49ecb4d59a9e46edd7cd [term 1 LEADER]: Becoming Leader. State: Replica: 867769868c0c49ecb4d59a9e46edd7cd, State: Running, Role: LEADER
I20260811 16:37:30.924758 25436 sys_catalog.cc:564] T 00000000000000000000000000000000 P 867769868c0c49ecb4d59a9e46edd7cd [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:37:30.924788 25448 consensus_queue.cc:237] T 00000000000000000000000000000000 P 867769868c0c49ecb4d59a9e46edd7cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "867769868c0c49ecb4d59a9e46edd7cd" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 37311 } }
I20260811 16:37:30.925117 25448 sys_catalog.cc:455] T 00000000000000000000000000000000 P 867769868c0c49ecb4d59a9e46edd7cd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 867769868c0c49ecb4d59a9e46edd7cd. Latest consensus state: current_term: 1 leader_uuid: "867769868c0c49ecb4d59a9e46edd7cd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "867769868c0c49ecb4d59a9e46edd7cd" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 37311 } } }
I20260811 16:37:30.925190 25448 sys_catalog.cc:458] T 00000000000000000000000000000000 P 867769868c0c49ecb4d59a9e46edd7cd [sys.catalog]: This master's current role is: LEADER
I20260811 16:37:30.925151 25451 sys_catalog.cc:455] T 00000000000000000000000000000000 P 867769868c0c49ecb4d59a9e46edd7cd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "867769868c0c49ecb4d59a9e46edd7cd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "867769868c0c49ecb4d59a9e46edd7cd" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 37311 } } }
I20260811 16:37:30.925374 25451 sys_catalog.cc:458] T 00000000000000000000000000000000 P 867769868c0c49ecb4d59a9e46edd7cd [sys.catalog]: This master's current role is: LEADER
I20260811 16:37:30.926215 25456 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:37:30.927103 25456 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:37:30.930136 25456 catalog_manager.cc:1347] Generated new cluster ID: 72221108c6f0400ea731bffc1d5d9157
I20260811 16:37:30.930220 25456 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 16:37:30 dist-test-slave-zj8q krb5kdc[25299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466250, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:37:30.939041 25445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:30.918583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43572 (local address 127.24.175.254:37311)
0811 16:37:30.919127 (+ 544us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:30.919135 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:30.919184 (+ 49us) server_negotiation.cc:407] Connection header received
0811 16:37:30.922091 (+ 2907us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:30.922097 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:30.922142 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:30.922300 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:30.924210 (+ 1910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:30.926203 (+ 1993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:30.927896 (+ 1693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:30.928401 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:30.928501 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:30.933695 (+ 5194us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:30.933700 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:30.933700 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:37:30.933712 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:30.936320 (+ 2608us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:30.936849 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:30.936852 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:30.936852 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:30.937020 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:30.937355 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:30.937356 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:30.937356 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:30.937751 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:30.938067 (+ 316us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:30.938566 (+ 499us) server_negotiation.cc:299] Negotiation successful
0811 16:37:30.938788 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":480,"thread_start_us":326,"threads_started":1}
I20260811 16:37:30.959888 25456 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:37:30.960728 25456 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:37:30.963827 25456 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 867769868c0c49ecb4d59a9e46edd7cd: Generated new TSK 0
I20260811 16:37:30.964005 25456 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.175.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab.
Entry for principal kudu/127.24.175.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab.
I20260811 16:37:31.004966 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.193:0
--local_ip_for_outbound_sockets=127.24.175.193
--webserver_interface=127.24.175.193
--webserver_port=0
--tserver_master_addrs=127.24.175.254:37311
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab
--principal=kudu/127.24.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:42365
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:37:31.128971 25484 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:37:31.129174 25484 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:37:31.129196 25484 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:37:31.130365 25484 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:37:31.130407 25484 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:37:31.130434 25484 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.193
I20260811 16:37:31.131944 25484 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:42365
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab
--principal=kudu/127.24.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.175.193
--webserver_port=0
--tserver_master_addrs=127.24.175.254:37311
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25484
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.193
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:37:31.132175 25484 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:37:31.132391 25484 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:37:31.138577 25493 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:31.138700 25498 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:31.138597 25494 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:37:31.139991 25484 server_base.cc:1034] running on GCE node
I20260811 16:37:31.140200 25484 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:37:31.140475 25484 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:37:31.141629 25484 hybrid_clock.cc:648] HybridClock initialized: now 1786466251141615 us; error 30 us; skew 500 ppm
Aug 11 16:37:31 dist-test-slave-zj8q krb5kdc[25299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466251, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:37:31.144662 25484 init.cc:377] Logged in from keytab as kudu/127.24.175.193@KRBTEST.COM (short username kudu)
I20260811 16:37:31.145143 25484 webserver.cc:460] Webserver started at http://127.24.175.193:45295/ using document root <none> and password file <none>
I20260811 16:37:31.145351 25484 fs_manager.cc:359] Metadata directory not provided
I20260811 16:37:31.145398 25484 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:37:31.145555 25484 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:37:31.146726 25484 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/minicluster-data/ts-0/data/instance:
uuid: "fd9d24e932114951b23407cada188765"
format_stamp: "Formatted at 2026-08-11 16:37:31 on dist-test-slave-zj8q"
server_key: "ed851cdc05454788618fbb3df0df2b83"
server_key_iv: "a8cd6597a94083474bc098870834bdce"
server_key_version: "encryptionkey@0"
I20260811 16:37:31.147063 25484 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/minicluster-data/ts-0/wal/instance:
uuid: "fd9d24e932114951b23407cada188765"
format_stamp: "Formatted at 2026-08-11 16:37:31 on dist-test-slave-zj8q"
server_key: "ed851cdc05454788618fbb3df0df2b83"
server_key_iv: "a8cd6597a94083474bc098870834bdce"
server_key_version: "encryptionkey@0"
I20260811 16:37:31.148546 25484 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:37:31.149279 25509 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:31.149443 25484 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:37:31.149531 25484 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/minicluster-data/ts-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/minicluster-data/ts-0/wal
uuid: "fd9d24e932114951b23407cada188765"
format_stamp: "Formatted at 2026-08-11 16:37:31 on dist-test-slave-zj8q"
server_key: "ed851cdc05454788618fbb3df0df2b83"
server_key_iv: "a8cd6597a94083474bc098870834bdce"
server_key_version: "encryptionkey@0"
I20260811 16:37:31.149636 25484 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:37:31.173785 25484 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:37:31.176000 25484 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:37:31.176194 25484 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:37:31.176576 25484 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:37:31.176918 25484 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:37:31.176956 25484 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:31.176985 25484 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:37:31.177002 25484 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:31.183619 25484 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.193:38385
I20260811 16:37:31.183660 25695 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.193:38385 every 8 connection(s)
I20260811 16:37:31.183965 25484 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
Aug 11 16:37:31 dist-test-slave-zj8q krb5kdc[25299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466251, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.193@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:37:31.191908 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 25484
I20260811 16:37:31.191992 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/minicluster-data/ts-0/wal/instance
I20260811 16:37:31.192133 25279 external_mini_cluster.cc:1428] Setting key c7af36f62f6f6da24ba59117daf501a9
I20260811 16:37:31.193157 25445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:31.184835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:56719 (local address 127.24.175.254:37311)
0811 16:37:31.184894 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:31.184896 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:31.185163 (+ 267us) server_negotiation.cc:407] Connection header received
0811 16:37:31.185666 (+ 503us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:31.185668 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:31.185681 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:31.185735 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:31.186805 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:31.187316 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:31.188277 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:31.188486 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:31.188543 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:31.190601 (+ 2058us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:31.190603 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:31.190603 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:37:31.190610 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:31.191695 (+ 1085us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:31.192089 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:31.192090 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:31.192090 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:31.192147 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:31.192397 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:31.192398 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:31.192399 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:31.192572 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:31.192639 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:31.192949 (+ 310us) server_negotiation.cc:299] Negotiation successful
0811 16:37:31.193073 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 16:37:31.193172 25698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:31.184797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:37311 (local address 127.24.175.193:56719)
0811 16:37:31.185050 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:31.185085 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:31.185571 (+ 486us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:31.185818 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:31.185822 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:31.186499 (+ 677us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:37:31.186693 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:31.186698 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:31.187399 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:31.187400 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:31.188183 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:31.188185 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:31.188556 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:31.188557 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:31.188677 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:31.189126 (+ 449us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:37:31.189135 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:37:31.190515 (+ 1380us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:37:31.191787 (+ 1272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:31.191794 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:31.191796 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:31.191997 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:31.192200 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:31.192201 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:31.192201 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:31.192320 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:31.192642 (+ 322us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:37:31.192648 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:37:31.192802 (+ 154us) client_negotiation.cc:769] Sending connection context
0811 16:37:31.192901 (+ 99us) client_negotiation.cc:240] Negotiation successful
0811 16:37:31.193020 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":179,"threads_started":1}
I20260811 16:37:31.193662 25696 heartbeater.cc:347] Connected to a master server at 127.24.175.254:37311
I20260811 16:37:31.193760 25696 heartbeater.cc:464] Registering TS with master...
I20260811 16:37:31.193924 25696 heartbeater.cc:511] Master 127.24.175.254:37311 requested a full tablet report, sending...
I20260811 16:37:31.194514 25381 ts_manager.cc:194] Registered new tserver with Master: fd9d24e932114951b23407cada188765 (127.24.175.193:38385)
I20260811 16:37:31.195185 25381 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.175.193@KRBTEST.COM'} at 127.24.175.193:56719
WARNING: no policy specified for kudu/127.24.175.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab.
Entry for principal kudu/127.24.175.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab.
I20260811 16:37:31.215979 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.194:0
--local_ip_for_outbound_sockets=127.24.175.194
--webserver_interface=127.24.175.194
--webserver_port=0
--tserver_master_addrs=127.24.175.254:37311
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab
--principal=kudu/127.24.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:42365
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:37:31.307139 25701 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:37:31.307338 25701 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:37:31.307361 25701 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:37:31.308549 25701 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:37:31.308591 25701 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:37:31.308616 25701 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.194
I20260811 16:37:31.310429 25701 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:42365
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab
--principal=kudu/127.24.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.175.194
--webserver_port=0
--tserver_master_addrs=127.24.175.254:37311
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25701
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.194
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:37:31.310669 25701 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:37:31.310891 25701 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:37:31.315976 25725 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:31.315981 25723 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:31.316098 25721 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:37:31.316257 25701 server_base.cc:1034] running on GCE node
I20260811 16:37:31.316443 25701 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:37:31.316660 25701 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:37:31.317807 25701 hybrid_clock.cc:648] HybridClock initialized: now 1786466251317791 us; error 29 us; skew 500 ppm
Aug 11 16:37:31 dist-test-slave-zj8q krb5kdc[25299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466251, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:37:31.320390 25701 init.cc:377] Logged in from keytab as kudu/127.24.175.194@KRBTEST.COM (short username kudu)
I20260811 16:37:31.320770 25701 webserver.cc:460] Webserver started at http://127.24.175.194:40623/ using document root <none> and password file <none>
I20260811 16:37:31.320951 25701 fs_manager.cc:359] Metadata directory not provided
I20260811 16:37:31.320989 25701 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:37:31.321103 25701 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:37:31.322119 25701 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/minicluster-data/ts-1/data/instance:
uuid: "68e3b0935bc64876acb5b0daaeddd106"
format_stamp: "Formatted at 2026-08-11 16:37:31 on dist-test-slave-zj8q"
server_key: "9b693f7244c4810ecfa4302d77054472"
server_key_iv: "9285aad3c0b858b25a830d4abec7030b"
server_key_version: "encryptionkey@0"
I20260811 16:37:31.322467 25701 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/minicluster-data/ts-1/wal/instance:
uuid: "68e3b0935bc64876acb5b0daaeddd106"
format_stamp: "Formatted at 2026-08-11 16:37:31 on dist-test-slave-zj8q"
server_key: "9b693f7244c4810ecfa4302d77054472"
server_key_iv: "9285aad3c0b858b25a830d4abec7030b"
server_key_version: "encryptionkey@0"
I20260811 16:37:31.323644 25701 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:37:31.324349 25734 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:31.324493 25701 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 16:37:31.324576 25701 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/minicluster-data/ts-1/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/minicluster-data/ts-1/wal
uuid: "68e3b0935bc64876acb5b0daaeddd106"
format_stamp: "Formatted at 2026-08-11 16:37:31 on dist-test-slave-zj8q"
server_key: "9b693f7244c4810ecfa4302d77054472"
server_key_iv: "9285aad3c0b858b25a830d4abec7030b"
server_key_version: "encryptionkey@0"
I20260811 16:37:31.324645 25701 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:37:31.340631 25701 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:37:31.342623 25701 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:37:31.342805 25701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:37:31.343173 25701 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:37:31.343560 25701 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:37:31.343600 25701 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:31.343621 25701 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:37:31.343644 25701 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:31.351788 25701 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.194:37673
I20260811 16:37:31.351850 25951 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.194:37673 every 8 connection(s)
I20260811 16:37:31.352155 25701 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
Aug 11 16:37:31 dist-test-slave-zj8q krb5kdc[25299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466251, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.194@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:37:31.360498 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 25701
I20260811 16:37:31.360589 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/minicluster-data/ts-1/wal/instance
I20260811 16:37:31.360760 25279 external_mini_cluster.cc:1428] Setting key b14315586eeeab24e58e1a075d2f6e58
I20260811 16:37:31.361383 25445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:31.352924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:44001 (local address 127.24.175.254:37311)
0811 16:37:31.352983 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:31.352985 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:31.353223 (+ 238us) server_negotiation.cc:407] Connection header received
0811 16:37:31.353736 (+ 513us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:31.353737 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:31.353749 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:31.353801 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:31.354836 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:31.355358 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:31.356424 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:31.356625 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:31.356683 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:31.358927 (+ 2244us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:31.358928 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:31.358929 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:37:31.358935 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:31.360017 (+ 1082us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:31.360390 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:31.360391 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:31.360391 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:31.360442 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:31.360688 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:31.360689 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:31.360689 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:31.360804 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:31.360866 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:31.361203 (+ 337us) server_negotiation.cc:299] Negotiation successful
0811 16:37:31.361293 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 16:37:31.361510 25954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:31.352885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:37311 (local address 127.24.175.194:44001)
0811 16:37:31.353112 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:31.353147 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:31.353641 (+ 494us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:31.353870 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:31.353875 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:31.354501 (+ 626us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:37:31.354735 (+ 234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:31.354741 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:31.355443 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:31.355444 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:31.356338 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:31.356341 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:31.356694 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:31.356695 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:31.356861 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:31.357328 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:37:31.357336 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:37:31.358853 (+ 1517us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:37:31.360084 (+ 1231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:31.360089 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:31.360091 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:31.360305 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:31.360499 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:31.360500 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:31.360500 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:31.360631 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:31.360894 (+ 263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:37:31.360901 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:37:31.361052 (+ 151us) client_negotiation.cc:769] Sending connection context
0811 16:37:31.361162 (+ 110us) client_negotiation.cc:240] Negotiation successful
0811 16:37:31.361312 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":156,"threads_started":1}
I20260811 16:37:31.361940 25952 heartbeater.cc:347] Connected to a master server at 127.24.175.254:37311
I20260811 16:37:31.362025 25952 heartbeater.cc:464] Registering TS with master...
I20260811 16:37:31.362224 25952 heartbeater.cc:511] Master 127.24.175.254:37311 requested a full tablet report, sending...
I20260811 16:37:31.362601 25381 ts_manager.cc:194] Registered new tserver with Master: 68e3b0935bc64876acb5b0daaeddd106 (127.24.175.194:37673)
I20260811 16:37:31.363046 25381 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.175.194@KRBTEST.COM'} at 127.24.175.194:44001
WARNING: no policy specified for kudu/127.24.175.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab.
Entry for principal kudu/127.24.175.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab.
I20260811 16:37:31.384964 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.195:0
--local_ip_for_outbound_sockets=127.24.175.195
--webserver_interface=127.24.175.195
--webserver_port=0
--tserver_master_addrs=127.24.175.254:37311
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab
--principal=kudu/127.24.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:42365
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:37:31.478279 25957 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:37:31.478477 25957 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:37:31.478508 25957 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:37:31.479714 25957 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:37:31.479758 25957 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:37:31.479792 25957 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.195
I20260811 16:37:31.481233 25957 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:42365
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab
--principal=kudu/127.24.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.175.195
--webserver_port=0
--tserver_master_addrs=127.24.175.254:37311
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25957
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.195
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:37:31.481455 25957 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:37:31.481671 25957 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:37:31.487226 25967 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:31.487200 25970 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:31.487269 25965 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:37:31.487421 25957 server_base.cc:1034] running on GCE node
I20260811 16:37:31.487607 25957 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:37:31.487792 25957 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:37:31.488930 25957 hybrid_clock.cc:648] HybridClock initialized: now 1786466251488915 us; error 31 us; skew 500 ppm
Aug 11 16:37:31 dist-test-slave-zj8q krb5kdc[25299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466251, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:37:31.491947 25957 init.cc:377] Logged in from keytab as kudu/127.24.175.195@KRBTEST.COM (short username kudu)
I20260811 16:37:31.492381 25957 webserver.cc:460] Webserver started at http://127.24.175.195:34939/ using document root <none> and password file <none>
I20260811 16:37:31.492583 25957 fs_manager.cc:359] Metadata directory not provided
I20260811 16:37:31.492632 25957 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:37:31.492754 25957 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:37:31.494010 25957 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/minicluster-data/ts-2/data/instance:
uuid: "46682314095c44c9b3d6df8531a6c8dd"
format_stamp: "Formatted at 2026-08-11 16:37:31 on dist-test-slave-zj8q"
server_key: "716149453750a34a699f82cfdb63a6e5"
server_key_iv: "13a83486a7f567f56e16b543ecee79b3"
server_key_version: "encryptionkey@0"
I20260811 16:37:31.494429 25957 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/minicluster-data/ts-2/wal/instance:
uuid: "46682314095c44c9b3d6df8531a6c8dd"
format_stamp: "Formatted at 2026-08-11 16:37:31 on dist-test-slave-zj8q"
server_key: "716149453750a34a699f82cfdb63a6e5"
server_key_iv: "13a83486a7f567f56e16b543ecee79b3"
server_key_version: "encryptionkey@0"
I20260811 16:37:31.495914 25957 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:37:31.496654 25981 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:31.496802 25957 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:37:31.496891 25957 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/minicluster-data/ts-2/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/minicluster-data/ts-2/wal
uuid: "46682314095c44c9b3d6df8531a6c8dd"
format_stamp: "Formatted at 2026-08-11 16:37:31 on dist-test-slave-zj8q"
server_key: "716149453750a34a699f82cfdb63a6e5"
server_key_iv: "13a83486a7f567f56e16b543ecee79b3"
server_key_version: "encryptionkey@0"
I20260811 16:37:31.496949 25957 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:37:31.523469 25957 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:37:31.525321 25957 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:37:31.525452 25957 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:37:31.525671 25957 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:37:31.526037 25957 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:37:31.526072 25957 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:31.526101 25957 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:37:31.526117 25957 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:31.535050 25957 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.195:45699
I20260811 16:37:31.535207 26186 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.195:45699 every 8 connection(s)
I20260811 16:37:31.535423 25957 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
I20260811 16:37:31.539762 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 25957
I20260811 16:37:31.539834 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466249441839-25279-0/minicluster-data/ts-2/wal/instance
I20260811 16:37:31.540014 25279 external_mini_cluster.cc:1428] Setting key 5b4b636f1d7a896043b5a8e5f1498ccf
Aug 11 16:37:31 dist-test-slave-zj8q krb5kdc[25299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466251, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.195@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:37:31.545061 25445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:31.536151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.195:39209 (local address 127.24.175.254:37311)
0811 16:37:31.536194 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:31.536196 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:31.536383 (+ 187us) server_negotiation.cc:407] Connection header received
0811 16:37:31.536949 (+ 566us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:31.536950 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:31.536964 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:31.537015 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:31.538185 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:31.538713 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:31.539915 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:31.540191 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:31.540279 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:31.542806 (+ 2527us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:31.542807 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:31.542807 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:37:31.542814 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:31.544009 (+ 1195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:31.544372 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:31.544372 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:31.544373 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:31.544419 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:31.544594 (+ 175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:31.544595 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:31.544595 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:31.544687 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:31.544733 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:31.544938 (+ 205us) server_negotiation.cc:299] Negotiation successful
0811 16:37:31.544997 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 16:37:31.545282 26192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:31.536110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:37311 (local address 127.24.175.195:39209)
0811 16:37:31.536274 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:31.536306 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:31.536840 (+ 534us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:31.537098 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:31.537102 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:31.537768 (+ 666us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:37:31.538054 (+ 286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:31.538060 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:31.538802 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:31.538803 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:31.539838 (+ 1035us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:31.539841 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:31.540296 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:31.540297 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:31.540509 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:31.541193 (+ 684us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:37:31.541203 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:37:31.542716 (+ 1513us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:37:31.544096 (+ 1380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:31.544102 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:31.544104 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:31.544314 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:31.544462 (+ 148us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:31.544462 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:31.544463 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:31.544551 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:31.544730 (+ 179us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:37:31.544733 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:37:31.544842 (+ 109us) client_negotiation.cc:769] Sending connection context
0811 16:37:31.544920 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 16:37:31.545036 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":86,"threads_started":1}
I20260811 16:37:31.545677 26189 heartbeater.cc:347] Connected to a master server at 127.24.175.254:37311
I20260811 16:37:31.545768 26189 heartbeater.cc:464] Registering TS with master...
I20260811 16:37:31.545933 26189 heartbeater.cc:511] Master 127.24.175.254:37311 requested a full tablet report, sending...
I20260811 16:37:31.546301 25381 ts_manager.cc:194] Registered new tserver with Master: 46682314095c44c9b3d6df8531a6c8dd (127.24.175.195:45699)
I20260811 16:37:31.546648 25381 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.175.195@KRBTEST.COM'} at 127.24.175.195:39209
I20260811 16:37:31.551908 25279 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 16:37:31 dist-test-slave-zj8q krb5kdc[25299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466251, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 16:37:31 dist-test-slave-zj8q krb5kdc[25299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466251, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.24.175.193@KRBTEST.COM
I20260811 16:37:31.575148 26201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:31.568096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37530 (local address 127.24.175.193:38385)
0811 16:37:31.568280 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:31.568285 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:31.568294 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:37:31.568318 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:31.568320 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:31.568334 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:31.568395 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:31.568902 (+ 507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:31.569616 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:31.570381 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:31.570693 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:31.570749 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:31.572788 (+ 2039us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:31.572796 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:31.572796 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:37:31.572803 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:31.574128 (+ 1325us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:31.574498 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:31.574501 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:31.574502 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:31.574571 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:31.574718 (+ 147us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:31.574719 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:31.574719 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:31.574841 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:31.574965 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:31.574997 (+ 32us) server_negotiation.cc:299] Negotiation successful
0811 16:37:31.575072 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":96,"threads_started":1}
W20260811 16:37:31.575529 25555 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37530
Aug 11 16:37:31 dist-test-slave-zj8q krb5kdc[25299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466251, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 16:37:31 dist-test-slave-zj8q krb5kdc[25299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466251, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.175.193@KRBTEST.COM
I20260811 16:37:31.596755 26201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:31.590376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37544 (local address 127.24.175.193:38385)
0811 16:37:31.590430 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:31.590432 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:31.590496 (+ 64us) server_negotiation.cc:407] Connection header received
0811 16:37:31.590566 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:31.590567 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:31.590580 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:31.590631 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:31.591162 (+ 531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:31.591642 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:31.592387 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:31.592592 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:31.592647 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:31.594704 (+ 2057us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:31.594706 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:31.594706 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:37:31.594714 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:31.595768 (+ 1054us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:31.596062 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:31.596063 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:31.596063 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:31.596131 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:31.596298 (+ 167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:31.596299 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:31.596299 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:31.596393 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:31.596499 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:31.596579 (+ 80us) server_negotiation.cc:299] Negotiation successful
0811 16:37:31.596663 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 16:37:31.597236 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 25484
I20260811 16:37:31.611999 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 25701
I20260811 16:37:31.627751 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 25957
I20260811 16:37:31.635828 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 25316
2026-08-11T16:37:31Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2207 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:37:31 dist-test-slave-zj8q krb5kdc[26214](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:37:31 dist-test-slave-zj8q krb5kdc[26214](info): set up 2 sockets
Aug 11 16:37:31 dist-test-slave-zj8q krb5kdc[26214](info): commencing operation
krb5kdc: starting...
W20260811 16:37:32.799161 25279 mini_kdc.cc:121] Time spent starting KDC: real 1.137s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Aug 11 16:37:32 dist-test-slave-zj8q krb5kdc[26214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466252, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:37:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:37:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab.
Entry for principal kudu/127.24.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab.
I20260811 16:37:32.910001 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:42031
--webserver_interface=127.24.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:37729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.175.254:42031
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:37:32.989089 26237 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:37:32.989295 26237 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:37:32.989323 26237 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:37:32.990468 26237 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:37:32.990506 26237 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:37:32.990525 26237 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:37:32.990540 26237 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:37:32.990556 26237 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:37:32.991979 26237 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:37729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.175.254:42031
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:42031
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26237
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:37:32.992208 26237 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:37:32.992401 26237 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:37:32.997159 26245 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:37:32.997200 26237 server_base.cc:1034] running on GCE node
W20260811 16:37:32.997162 26248 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:32.997218 26246 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:37:32.997596 26237 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:37:32.997864 26237 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:37:32.998999 26237 hybrid_clock.cc:648] HybridClock initialized: now 1786466252998981 us; error 33 us; skew 500 ppm
Aug 11 16:37:32 dist-test-slave-zj8q krb5kdc[26214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466252, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:37:33.001305 26237 init.cc:377] Logged in from keytab as kudu/127.24.175.254@KRBTEST.COM (short username kudu)
I20260811 16:37:33.001672 26237 webserver.cc:460] Webserver started at http://127.24.175.254:45699/ using document root <none> and password file <none>
I20260811 16:37:33.001838 26237 fs_manager.cc:359] Metadata directory not provided
I20260811 16:37:33.001875 26237 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:37:33.001960 26237 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:37:33.002959 26237 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/minicluster-data/master-0/data/instance:
uuid: "5c1b4bba97fb4f2f8bf5324f3bd0a573"
format_stamp: "Formatted at 2026-08-11 16:37:32 on dist-test-slave-zj8q"
server_key: "1b9465308e20e7797100c7b3958f9404"
server_key_iv: "4d939b7ad2bc1b0b88a1624f46e0ef4b"
server_key_version: "encryptionkey@0"
I20260811 16:37:33.003258 26237 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/minicluster-data/master-0/wal/instance:
uuid: "5c1b4bba97fb4f2f8bf5324f3bd0a573"
format_stamp: "Formatted at 2026-08-11 16:37:32 on dist-test-slave-zj8q"
server_key: "1b9465308e20e7797100c7b3958f9404"
server_key_iv: "4d939b7ad2bc1b0b88a1624f46e0ef4b"
server_key_version: "encryptionkey@0"
I20260811 16:37:33.004581 26237 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 16:37:33.005224 26265 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:33.005362 26237 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 16:37:33.005448 26237 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/minicluster-data/master-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/minicluster-data/master-0/wal
uuid: "5c1b4bba97fb4f2f8bf5324f3bd0a573"
format_stamp: "Formatted at 2026-08-11 16:37:32 on dist-test-slave-zj8q"
server_key: "1b9465308e20e7797100c7b3958f9404"
server_key_iv: "4d939b7ad2bc1b0b88a1624f46e0ef4b"
server_key_version: "encryptionkey@0"
I20260811 16:37:33.005508 26237 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:37:33.031075 26237 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:37:33.032884 26237 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:37:33.033015 26237 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:37:33.036950 26237 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.254:42031
I20260811 16:37:33.037012 26354 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.254:42031 every 8 connection(s)
I20260811 16:37:33.037333 26237 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
I20260811 16:37:33.038197 26357 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:37:33.040429 26357 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c1b4bba97fb4f2f8bf5324f3bd0a573: Bootstrap starting.
I20260811 16:37:33.040962 26357 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5c1b4bba97fb4f2f8bf5324f3bd0a573: Neither blocks nor log segments found. Creating new log.
I20260811 16:37:33.041208 26357 log.cc:824] T 00000000000000000000000000000000 P 5c1b4bba97fb4f2f8bf5324f3bd0a573: Log is configured to *not* fsync() on all Append() calls
I20260811 16:37:33.041852 26357 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c1b4bba97fb4f2f8bf5324f3bd0a573: No bootstrap required, opened a new log
I20260811 16:37:33.043494 26357 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5c1b4bba97fb4f2f8bf5324f3bd0a573 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c1b4bba97fb4f2f8bf5324f3bd0a573" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 42031 } }
I20260811 16:37:33.043632 26357 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5c1b4bba97fb4f2f8bf5324f3bd0a573 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:37:33.043653 26357 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5c1b4bba97fb4f2f8bf5324f3bd0a573 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c1b4bba97fb4f2f8bf5324f3bd0a573, State: Initialized, Role: FOLLOWER
I20260811 16:37:33.043769 26357 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5c1b4bba97fb4f2f8bf5324f3bd0a573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c1b4bba97fb4f2f8bf5324f3bd0a573" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 42031 } }
I20260811 16:37:33.043846 26357 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5c1b4bba97fb4f2f8bf5324f3bd0a573 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:37:33.043874 26357 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5c1b4bba97fb4f2f8bf5324f3bd0a573 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:37:33.043905 26357 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5c1b4bba97fb4f2f8bf5324f3bd0a573 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:37:33.044270 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 26237
I20260811 16:37:33.044344 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/minicluster-data/master-0/wal/instance
I20260811 16:37:33.044385 26357 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5c1b4bba97fb4f2f8bf5324f3bd0a573 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c1b4bba97fb4f2f8bf5324f3bd0a573" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 42031 } }
I20260811 16:37:33.044482 25279 external_mini_cluster.cc:1428] Setting key 31be4f1aa40acd535b2aed99bfa5be2e
I20260811 16:37:33.044482 26357 leader_election.cc:302] T 00000000000000000000000000000000 P 5c1b4bba97fb4f2f8bf5324f3bd0a573 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5c1b4bba97fb4f2f8bf5324f3bd0a573; no voters:
I20260811 16:37:33.044623 26357 leader_election.cc:288] T 00000000000000000000000000000000 P 5c1b4bba97fb4f2f8bf5324f3bd0a573 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:37:33.044658 26361 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5c1b4bba97fb4f2f8bf5324f3bd0a573 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:37:33.044806 26361 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5c1b4bba97fb4f2f8bf5324f3bd0a573 [term 1 LEADER]: Becoming Leader. State: Replica: 5c1b4bba97fb4f2f8bf5324f3bd0a573, State: Running, Role: LEADER
I20260811 16:37:33.044893 26357 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5c1b4bba97fb4f2f8bf5324f3bd0a573 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:37:33.044945 26361 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5c1b4bba97fb4f2f8bf5324f3bd0a573 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c1b4bba97fb4f2f8bf5324f3bd0a573" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 42031 } }
I20260811 16:37:33.045392 26361 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c1b4bba97fb4f2f8bf5324f3bd0a573 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5c1b4bba97fb4f2f8bf5324f3bd0a573. Latest consensus state: current_term: 1 leader_uuid: "5c1b4bba97fb4f2f8bf5324f3bd0a573" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c1b4bba97fb4f2f8bf5324f3bd0a573" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 42031 } } }
I20260811 16:37:33.045555 26361 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c1b4bba97fb4f2f8bf5324f3bd0a573 [sys.catalog]: This master's current role is: LEADER
I20260811 16:37:33.045567 26364 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c1b4bba97fb4f2f8bf5324f3bd0a573 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5c1b4bba97fb4f2f8bf5324f3bd0a573" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c1b4bba97fb4f2f8bf5324f3bd0a573" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 42031 } } }
I20260811 16:37:33.045694 26364 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c1b4bba97fb4f2f8bf5324f3bd0a573 [sys.catalog]: This master's current role is: LEADER
I20260811 16:37:33.046198 26390 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:37:33.046787 26390 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:37:33.048261 26390 catalog_manager.cc:1347] Generated new cluster ID: d3c1c6597e57456488b22c1fbdf86700
I20260811 16:37:33.048309 26390 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 16:37:33 dist-test-slave-zj8q krb5kdc[26214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466252, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:37:33.053699 26390 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:37:33.054426 26390 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:37:33.055860 26368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:33.045118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57128 (local address 127.24.175.254:42031)
0811 16:37:33.045275 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:33.045284 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:33.045314 (+ 30us) server_negotiation.cc:407] Connection header received
0811 16:37:33.045878 (+ 564us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:33.045885 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:33.045928 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:33.046871 (+ 943us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:33.046967 (+ 96us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:33.048229 (+ 1262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:33.049291 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:33.049891 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:33.049988 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:33.052705 (+ 2717us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:33.052709 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:33.052709 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:37:33.052721 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:33.054473 (+ 1752us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:33.054810 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:33.054813 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:33.054813 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:33.054914 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:33.055088 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:33.055089 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:33.055089 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:33.055299 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:33.055455 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:33.055551 (+ 96us) server_negotiation.cc:299] Negotiation successful
0811 16:37:33.055701 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":80,"threads_started":1}
I20260811 16:37:33.062415 26390 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5c1b4bba97fb4f2f8bf5324f3bd0a573: Generated new TSK 0
I20260811 16:37:33.062579 26390 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.175.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab.
Entry for principal kudu/127.24.175.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab.
I20260811 16:37:33.094444 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.193:0
--local_ip_for_outbound_sockets=127.24.175.193
--webserver_interface=127.24.175.193
--webserver_port=0
--tserver_master_addrs=127.24.175.254:42031
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab
--principal=kudu/127.24.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:37729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:37:33.215298 26412 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:37:33.215561 26412 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:37:33.215593 26412 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:37:33.217239 26412 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:37:33.217298 26412 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:37:33.217343 26412 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.193
I20260811 16:37:33.219542 26412 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:37729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab
--principal=kudu/127.24.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.175.193
--webserver_port=0
--tserver_master_addrs=127.24.175.254:42031
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26412
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.193
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:37:33.219785 26412 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:37:33.220068 26412 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:37:33.225419 26431 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:33.225452 26434 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:33.225452 26427 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:37:33.225630 26412 server_base.cc:1034] running on GCE node
I20260811 16:37:33.225783 26412 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:37:33.225989 26412 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:37:33.227141 26412 hybrid_clock.cc:648] HybridClock initialized: now 1786466253227112 us; error 42 us; skew 500 ppm
Aug 11 16:37:33 dist-test-slave-zj8q krb5kdc[26214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466253, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:37:33.229715 26412 init.cc:377] Logged in from keytab as kudu/127.24.175.193@KRBTEST.COM (short username kudu)
I20260811 16:37:33.230134 26412 webserver.cc:460] Webserver started at http://127.24.175.193:44413/ using document root <none> and password file <none>
I20260811 16:37:33.230386 26412 fs_manager.cc:359] Metadata directory not provided
I20260811 16:37:33.230435 26412 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:37:33.230584 26412 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:37:33.231564 26412 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/minicluster-data/ts-0/data/instance:
uuid: "5ca1cc414e2c4ccab3342e69765aacb7"
format_stamp: "Formatted at 2026-08-11 16:37:33 on dist-test-slave-zj8q"
server_key: "4bd55f09251b8c9c6e7d161ad82dc0b0"
server_key_iv: "d9064eb5662c48cc13a4024763bcb009"
server_key_version: "encryptionkey@0"
I20260811 16:37:33.231914 26412 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/minicluster-data/ts-0/wal/instance:
uuid: "5ca1cc414e2c4ccab3342e69765aacb7"
format_stamp: "Formatted at 2026-08-11 16:37:33 on dist-test-slave-zj8q"
server_key: "4bd55f09251b8c9c6e7d161ad82dc0b0"
server_key_iv: "d9064eb5662c48cc13a4024763bcb009"
server_key_version: "encryptionkey@0"
I20260811 16:37:33.233135 26412 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 16:37:33.233776 26447 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:33.233927 26412 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 16:37:33.234014 26412 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/minicluster-data/ts-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/minicluster-data/ts-0/wal
uuid: "5ca1cc414e2c4ccab3342e69765aacb7"
format_stamp: "Formatted at 2026-08-11 16:37:33 on dist-test-slave-zj8q"
server_key: "4bd55f09251b8c9c6e7d161ad82dc0b0"
server_key_iv: "d9064eb5662c48cc13a4024763bcb009"
server_key_version: "encryptionkey@0"
I20260811 16:37:33.234082 26412 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:37:33.262612 26412 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:37:33.264348 26412 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:37:33.264497 26412 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:37:33.264740 26412 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:37:33.265045 26412 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:37:33.265080 26412 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:33.265111 26412 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:37:33.265128 26412 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:33.273743 26412 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.193:34767
I20260811 16:37:33.273789 26659 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.193:34767 every 8 connection(s)
I20260811 16:37:33.274101 26412 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
I20260811 16:37:33.280045 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 26412
I20260811 16:37:33.280135 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/minicluster-data/ts-0/wal/instance
I20260811 16:37:33.280287 25279 external_mini_cluster.cc:1428] Setting key 61ff75230f31a6b644573c30f207ea9a
Aug 11 16:37:33 dist-test-slave-zj8q krb5kdc[26214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466253, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.193@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:37:33.283931 26368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:33.274943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:33629 (local address 127.24.175.254:42031)
0811 16:37:33.274990 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:33.274992 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:33.275182 (+ 190us) server_negotiation.cc:407] Connection header received
0811 16:37:33.276188 (+ 1006us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:33.276190 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:33.276202 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:33.276265 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:33.276895 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:33.277411 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:33.278567 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:33.278778 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:33.278838 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:33.281148 (+ 2310us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:33.281149 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:33.281150 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:37:33.281159 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:33.282535 (+ 1376us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:33.282905 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:33.282906 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:33.282906 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:33.282982 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:33.283274 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:33.283275 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:33.283275 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:33.283387 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:33.283440 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:33.283778 (+ 338us) server_negotiation.cc:299] Negotiation successful
0811 16:37:33.283865 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 16:37:33.284122 26663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:33.274896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:42031 (local address 127.24.175.193:33629)
0811 16:37:33.275073 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:33.275108 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:33.276085 (+ 977us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:33.276349 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:33.276353 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:33.276607 (+ 254us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:37:33.276806 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:33.276811 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:33.277493 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:33.277494 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:33.278475 (+ 981us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:33.278478 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:33.278854 (+ 376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:33.278856 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:33.278972 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:33.279442 (+ 470us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:37:33.279450 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:37:33.281055 (+ 1605us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:37:33.282607 (+ 1552us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:33.282614 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:33.282615 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:33.282832 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:33.283060 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:33.283062 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:33.283062 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:33.283210 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:33.283442 (+ 232us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:37:33.283447 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:37:33.283634 (+ 187us) client_negotiation.cc:769] Sending connection context
0811 16:37:33.283743 (+ 109us) client_negotiation.cc:240] Negotiation successful
0811 16:37:33.283904 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":90,"threads_started":1}
I20260811 16:37:33.284646 26661 heartbeater.cc:347] Connected to a master server at 127.24.175.254:42031
I20260811 16:37:33.284736 26661 heartbeater.cc:464] Registering TS with master...
I20260811 16:37:33.284911 26661 heartbeater.cc:511] Master 127.24.175.254:42031 requested a full tablet report, sending...
I20260811 16:37:33.285394 26297 ts_manager.cc:194] Registered new tserver with Master: 5ca1cc414e2c4ccab3342e69765aacb7 (127.24.175.193:34767)
I20260811 16:37:33.286048 26297 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.175.193@KRBTEST.COM'} at 127.24.175.193:33629
WARNING: no policy specified for kudu/127.24.175.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab.
Entry for principal kudu/127.24.175.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab.
I20260811 16:37:33.304661 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.194:0
--local_ip_for_outbound_sockets=127.24.175.194
--webserver_interface=127.24.175.194
--webserver_port=0
--tserver_master_addrs=127.24.175.254:42031
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab
--principal=kudu/127.24.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:37729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:37:33.396983 26670 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:37:33.397171 26670 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:37:33.397200 26670 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:37:33.398507 26670 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:37:33.398562 26670 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:37:33.398610 26670 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.194
I20260811 16:37:33.400442 26670 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:37729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab
--principal=kudu/127.24.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.175.194
--webserver_port=0
--tserver_master_addrs=127.24.175.254:42031
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26670
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.194
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:37:33.400633 26670 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:37:33.400805 26670 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 16:37:33.405682 26670 server_base.cc:1034] running on GCE node
W20260811 16:37:33.405695 26684 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:33.405795 26686 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:33.405695 26682 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:37:33.406067 26670 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:37:33.406332 26670 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:37:33.407481 26670 hybrid_clock.cc:648] HybridClock initialized: now 1786466253407467 us; error 31 us; skew 500 ppm
Aug 11 16:37:33 dist-test-slave-zj8q krb5kdc[26214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466253, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:37:33.410310 26670 init.cc:377] Logged in from keytab as kudu/127.24.175.194@KRBTEST.COM (short username kudu)
I20260811 16:37:33.410903 26670 webserver.cc:460] Webserver started at http://127.24.175.194:38573/ using document root <none> and password file <none>
I20260811 16:37:33.411181 26670 fs_manager.cc:359] Metadata directory not provided
I20260811 16:37:33.411250 26670 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:37:33.411386 26670 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:37:33.412403 26670 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/minicluster-data/ts-1/data/instance:
uuid: "52a320e1595e4823b09accea7ba2017d"
format_stamp: "Formatted at 2026-08-11 16:37:33 on dist-test-slave-zj8q"
server_key: "6628bd43aca38b7cfb25b9107bef3710"
server_key_iv: "6f1eb2bfb99aa2d48a0d8ed159b774ae"
server_key_version: "encryptionkey@0"
I20260811 16:37:33.412705 26670 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/minicluster-data/ts-1/wal/instance:
uuid: "52a320e1595e4823b09accea7ba2017d"
format_stamp: "Formatted at 2026-08-11 16:37:33 on dist-test-slave-zj8q"
server_key: "6628bd43aca38b7cfb25b9107bef3710"
server_key_iv: "6f1eb2bfb99aa2d48a0d8ed159b774ae"
server_key_version: "encryptionkey@0"
I20260811 16:37:33.413849 26670 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 16:37:33.414515 26697 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:33.414685 26670 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:33.414768 26670 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/minicluster-data/ts-1/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/minicluster-data/ts-1/wal
uuid: "52a320e1595e4823b09accea7ba2017d"
format_stamp: "Formatted at 2026-08-11 16:37:33 on dist-test-slave-zj8q"
server_key: "6628bd43aca38b7cfb25b9107bef3710"
server_key_iv: "6f1eb2bfb99aa2d48a0d8ed159b774ae"
server_key_version: "encryptionkey@0"
I20260811 16:37:33.414841 26670 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:37:33.436774 26670 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:37:33.438799 26670 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:37:33.438932 26670 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:37:33.439122 26670 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:37:33.439399 26670 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:37:33.439431 26670 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:33.439458 26670 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:37:33.439481 26670 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:33.447710 26670 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.194:34089
I20260811 16:37:33.447880 26889 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.194:34089 every 8 connection(s)
I20260811 16:37:33.448074 26670 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
I20260811 16:37:33.449537 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 26670
I20260811 16:37:33.449615 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/minicluster-data/ts-1/wal/instance
I20260811 16:37:33.449772 25279 external_mini_cluster.cc:1428] Setting key 4c0297698689a156d10f933a51c51d3a
Aug 11 16:37:33 dist-test-slave-zj8q krb5kdc[26214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466253, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.194@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:37:33.457775 26368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:33.448833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:57115 (local address 127.24.175.254:42031)
0811 16:37:33.448891 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:33.448893 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:33.449075 (+ 182us) server_negotiation.cc:407] Connection header received
0811 16:37:33.450235 (+ 1160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:33.450237 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:33.450249 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:33.450308 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:33.451172 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:33.451844 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:33.453047 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:33.453261 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:33.453318 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:33.455343 (+ 2025us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:33.455344 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:33.455345 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:37:33.455353 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:33.456557 (+ 1204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:33.456910 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:33.456911 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:33.456912 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:33.456971 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:33.457184 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:33.457185 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:33.457185 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:33.457298 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:33.457354 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:33.457598 (+ 244us) server_negotiation.cc:299] Negotiation successful
0811 16:37:33.457678 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 16:37:33.457921 26893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:33.448809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:42031 (local address 127.24.175.194:57115)
0811 16:37:33.448952 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:33.448988 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:33.450113 (+ 1125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:33.450382 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:33.450386 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:33.450728 (+ 342us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:37:33.451037 (+ 309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:33.451044 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:33.451955 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:33.451956 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:33.452961 (+ 1005us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:33.452964 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:33.453334 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:33.453334 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:33.453463 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:33.453898 (+ 435us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:37:33.453906 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:37:33.455262 (+ 1356us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:37:33.456629 (+ 1367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:33.456636 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:33.456638 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:33.456846 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:33.457020 (+ 174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:33.457021 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:33.457021 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:33.457130 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:33.457350 (+ 220us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:37:33.457356 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:37:33.457487 (+ 131us) client_negotiation.cc:769] Sending connection context
0811 16:37:33.457571 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 16:37:33.457717 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":70,"threads_started":1}
I20260811 16:37:33.458411 26891 heartbeater.cc:347] Connected to a master server at 127.24.175.254:42031
I20260811 16:37:33.458523 26891 heartbeater.cc:464] Registering TS with master...
I20260811 16:37:33.458714 26891 heartbeater.cc:511] Master 127.24.175.254:42031 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.24.175.195@KRBTEST.COM; defaulting to no policy
I20260811 16:37:33.459116 26297 ts_manager.cc:194] Registered new tserver with Master: 52a320e1595e4823b09accea7ba2017d (127.24.175.194:34089)
I20260811 16:37:33.459481 26297 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.175.194@KRBTEST.COM'} at 127.24.175.194:57115
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab.
Entry for principal kudu/127.24.175.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab.
I20260811 16:37:33.474941 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.195:0
--local_ip_for_outbound_sockets=127.24.175.195
--webserver_interface=127.24.175.195
--webserver_port=0
--tserver_master_addrs=127.24.175.254:42031
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab
--principal=kudu/127.24.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:37729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:37:33.570564 26902 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:37:33.570777 26902 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:37:33.570809 26902 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:37:33.571991 26902 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:37:33.572033 26902 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:37:33.572075 26902 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.195
I20260811 16:37:33.573742 26902 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:37729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab
--principal=kudu/127.24.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.175.195
--webserver_port=0
--tserver_master_addrs=127.24.175.254:42031
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26902
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.195
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:37:33.573987 26902 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:37:33.574227 26902 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:37:33.579610 26921 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:33.579592 26914 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:33.579677 26913 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:37:33.579838 26902 server_base.cc:1034] running on GCE node
I20260811 16:37:33.580050 26902 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:37:33.580248 26902 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:37:33.581389 26902 hybrid_clock.cc:648] HybridClock initialized: now 1786466253581379 us; error 29 us; skew 500 ppm
Aug 11 16:37:33 dist-test-slave-zj8q krb5kdc[26214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466253, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:37:33.584398 26902 init.cc:377] Logged in from keytab as kudu/127.24.175.195@KRBTEST.COM (short username kudu)
I20260811 16:37:33.584769 26902 webserver.cc:460] Webserver started at http://127.24.175.195:38637/ using document root <none> and password file <none>
I20260811 16:37:33.584945 26902 fs_manager.cc:359] Metadata directory not provided
I20260811 16:37:33.584982 26902 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:37:33.585067 26902 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:37:33.586048 26902 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/minicluster-data/ts-2/data/instance:
uuid: "05e67aa991604a58a5c6be43ecc10d1a"
format_stamp: "Formatted at 2026-08-11 16:37:33 on dist-test-slave-zj8q"
server_key: "350002c9a01e6caf9be0be3161c14fe0"
server_key_iv: "cc4c3b814f4e7384974a3d2adebad153"
server_key_version: "encryptionkey@0"
I20260811 16:37:33.586381 26902 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/minicluster-data/ts-2/wal/instance:
uuid: "05e67aa991604a58a5c6be43ecc10d1a"
format_stamp: "Formatted at 2026-08-11 16:37:33 on dist-test-slave-zj8q"
server_key: "350002c9a01e6caf9be0be3161c14fe0"
server_key_iv: "cc4c3b814f4e7384974a3d2adebad153"
server_key_version: "encryptionkey@0"
I20260811 16:37:33.587631 26902 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:37:33.588382 26929 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:33.588578 26902 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 16:37:33.588676 26902 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/minicluster-data/ts-2/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/minicluster-data/ts-2/wal
uuid: "05e67aa991604a58a5c6be43ecc10d1a"
format_stamp: "Formatted at 2026-08-11 16:37:33 on dist-test-slave-zj8q"
server_key: "350002c9a01e6caf9be0be3161c14fe0"
server_key_iv: "cc4c3b814f4e7384974a3d2adebad153"
server_key_version: "encryptionkey@0"
I20260811 16:37:33.588740 26902 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:37:33.609390 26902 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:37:33.611330 26902 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:37:33.611490 26902 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:37:33.611802 26902 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:37:33.612140 26902 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:37:33.612188 26902 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:33.612210 26902 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:37:33.612226 26902 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:33.621608 26902 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.195:43421
I20260811 16:37:33.621670 27123 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.195:43421 every 8 connection(s)
I20260811 16:37:33.621951 26902 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
Aug 11 16:37:33 dist-test-slave-zj8q krb5kdc[26214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466253, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.195@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:37:33.629673 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 26902
I20260811 16:37:33.629765 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466249441839-25279-0/minicluster-data/ts-2/wal/instance
I20260811 16:37:33.629906 25279 external_mini_cluster.cc:1428] Setting key 1f2a28e38a344685b1ca941b4beb65ca
I20260811 16:37:33.630832 26368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:33.622659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.195:42639 (local address 127.24.175.254:42031)
0811 16:37:33.622704 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:33.622706 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:33.622885 (+ 179us) server_negotiation.cc:407] Connection header received
0811 16:37:33.623770 (+ 885us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:33.623771 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:33.623780 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:33.623833 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:33.624409 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:33.624912 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:33.625856 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:33.626043 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:33.626097 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:33.628404 (+ 2307us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:33.628406 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:33.628407 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:37:33.628413 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:33.629454 (+ 1041us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:33.629859 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:33.629861 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:33.629862 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:33.629921 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:33.630147 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:33.630166 (+ 19us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:33.630167 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:33.630279 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:33.630345 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:33.630657 (+ 312us) server_negotiation.cc:299] Negotiation successful
0811 16:37:33.630751 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 16:37:33.630923 27127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:33.622625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:42031 (local address 127.24.175.195:42639)
0811 16:37:33.622776 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:33.622818 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:33.623687 (+ 869us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:33.623891 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:33.623894 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:33.624134 (+ 240us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:37:33.624331 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:33.624336 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:33.624975 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:33.624976 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:33.625783 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:33.625785 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:33.626099 (+ 314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:33.626100 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:33.626285 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:33.626809 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:37:33.626818 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:37:33.628307 (+ 1489us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:37:33.629531 (+ 1224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:33.629537 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:33.629539 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:33.629764 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:33.629977 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:33.629978 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:33.629978 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:33.630086 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:33.630340 (+ 254us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:37:33.630347 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:37:33.630494 (+ 147us) client_negotiation.cc:769] Sending connection context
0811 16:37:33.630615 (+ 121us) client_negotiation.cc:240] Negotiation successful
0811 16:37:33.630757 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":73,"threads_started":1}
I20260811 16:37:33.631312 27124 heartbeater.cc:347] Connected to a master server at 127.24.175.254:42031
I20260811 16:37:33.631398 27124 heartbeater.cc:464] Registering TS with master...
I20260811 16:37:33.631534 27124 heartbeater.cc:511] Master 127.24.175.254:42031 requested a full tablet report, sending...
I20260811 16:37:33.631878 26297 ts_manager.cc:194] Registered new tserver with Master: 05e67aa991604a58a5c6be43ecc10d1a (127.24.175.195:43421)
I20260811 16:37:33.632212 26297 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.175.195@KRBTEST.COM'} at 127.24.175.195:42639
I20260811 16:37:33.641414 25279 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 16:37:33.648895 26368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:33.643170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57138 (local address 127.24.175.254:42031)
0811 16:37:33.643229 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:33.643231 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:33.643331 (+ 100us) server_negotiation.cc:407] Connection header received
0811 16:37:33.643387 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:33.643388 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:33.643398 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:33.643443 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:33.644011 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:33.644533 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:33.645257 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:33.645499 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:33.645558 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:33.646710 (+ 1152us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:33.646711 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:33.646711 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:37:33.646718 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:33.647911 (+ 1193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:33.648194 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:33.648195 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:33.648195 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:33.648248 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:33.648406 (+ 158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:33.648407 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:33.648408 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:33.648545 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:33.648628 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:33.648742 (+ 114us) server_negotiation.cc:299] Negotiation successful
0811 16:37:33.648811 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 16:37:33.651386 26297 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57138:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:37:33.653223 26297 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:37:33.660531 27146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:33.656375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.194:34089 (local address 127.0.0.1:60510)
0811 16:37:33.656641 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:33.656651 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:33.656699 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:33.656860 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:33.656860 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:33.656861 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:37:33.656901 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:33.656902 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:33.658063 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:33.658064 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:33.659478 (+ 1414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:33.659481 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:33.660246 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:33.660247 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:33.660330 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:33.660344 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 16:37:33.660407 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 16:37:33.660460 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":247,"mutex_wait_us":63,"thread_start_us":79,"threads_started":1}
I20260811 16:37:33.660545 27149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:33.656501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60510 (local address 127.24.175.194:34089)
0811 16:37:33.656695 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:33.656700 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:33.656709 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:37:33.656771 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:33.656773 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:33.656789 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:33.656867 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:37:33.656941 (+ 74us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:33.657969 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:33.659579 (+ 1610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:33.660178 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:33.660248 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:33.660306 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:33.660429 (+ 123us) server_negotiation.cc:299] Negotiation successful
0811 16:37:33.660471 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":81,"threads_started":1}
I20260811 16:37:33.660713 27144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:33.656072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36156 (local address 127.24.175.193:34767)
0811 16:37:33.656377 (+ 305us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:33.656382 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:33.656392 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:37:33.656432 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:33.656434 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:33.656449 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:33.656534 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:37:33.656728 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:33.657940 (+ 1212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:33.659560 (+ 1620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:33.660287 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:33.660361 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:33.660409 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:33.660600 (+ 191us) server_negotiation.cc:299] Negotiation successful
0811 16:37:33.660638 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":272,"thread_start_us":121,"threads_started":1}
I20260811 16:37:33.661000 27140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:33.655878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.193:34767 (local address 127.0.0.1:36156)
0811 16:37:33.656019 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:33.656098 (+ 79us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:33.656193 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:33.656544 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:33.656547 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:33.656550 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:37:33.656622 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:33.656625 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:33.658116 (+ 1491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:33.658116 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:33.659477 (+ 1361us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:33.659481 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:33.660443 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:33.660444 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:33.660501 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:33.660505 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:37:33.660887 (+ 382us) client_negotiation.cc:240] Negotiation successful
0811 16:37:33.660931 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":90,"mutex_wait_us":49,"thread_start_us":55,"threads_started":1}
I20260811 16:37:33.661478 27143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:33.656064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.195:43421 (local address 127.0.0.1:34550)
0811 16:37:33.656655 (+ 591us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:33.656665 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:33.656702 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:33.658510 (+ 1808us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:33.658511 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:33.658514 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:37:33.658554 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:33.658556 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:33.659327 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:33.659328 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:33.660423 (+ 1095us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:33.660426 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:33.661256 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:33.661257 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:33.661319 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:33.661323 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:37:33.661375 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 16:37:33.661411 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":556,"spinlock_wait_cycles":768,"thread_start_us":78,"threads_started":1}
I20260811 16:37:33.661500 27148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:33.656416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34550 (local address 127.24.175.195:43421)
0811 16:37:33.658370 (+ 1954us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:33.658374 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:33.658382 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:37:33.658409 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:33.658411 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:33.658422 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:33.658491 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:37:33.658611 (+ 120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:33.659238 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:33.660504 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:33.661179 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:33.661255 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:33.661306 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:33.661393 (+ 87us) server_negotiation.cc:299] Negotiation successful
0811 16:37:33.661431 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1923,"thread_start_us":89,"threads_started":1}
I20260811 16:37:33.661643 26782 tablet_service.cc:1467] Processing CreateTablet for tablet eff9ea1a381c47eeb052f167a76aac88 (DEFAULT_TABLE table=test-table [id=e268993441ca42d79dff715caad856f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:37:33.661727 26552 tablet_service.cc:1467] Processing CreateTablet for tablet eff9ea1a381c47eeb052f167a76aac88 (DEFAULT_TABLE table=test-table [id=e268993441ca42d79dff715caad856f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:37:33.662014 26782 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eff9ea1a381c47eeb052f167a76aac88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:37:33.662065 26552 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eff9ea1a381c47eeb052f167a76aac88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:37:33.662344 27014 tablet_service.cc:1467] Processing CreateTablet for tablet eff9ea1a381c47eeb052f167a76aac88 (DEFAULT_TABLE table=test-table [id=e268993441ca42d79dff715caad856f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:37:33.663184 27014 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eff9ea1a381c47eeb052f167a76aac88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:37:33.665967 27150 tablet_bootstrap.cc:492] T eff9ea1a381c47eeb052f167a76aac88 P 52a320e1595e4823b09accea7ba2017d: Bootstrap starting.
I20260811 16:37:33.666673 27152 tablet_bootstrap.cc:492] T eff9ea1a381c47eeb052f167a76aac88 P 05e67aa991604a58a5c6be43ecc10d1a: Bootstrap starting.
I20260811 16:37:33.666875 27150 tablet_bootstrap.cc:654] T eff9ea1a381c47eeb052f167a76aac88 P 52a320e1595e4823b09accea7ba2017d: Neither blocks nor log segments found. Creating new log.
I20260811 16:37:33.666853 27151 tablet_bootstrap.cc:492] T eff9ea1a381c47eeb052f167a76aac88 P 5ca1cc414e2c4ccab3342e69765aacb7: Bootstrap starting.
I20260811 16:37:33.667371 27152 tablet_bootstrap.cc:654] T eff9ea1a381c47eeb052f167a76aac88 P 05e67aa991604a58a5c6be43ecc10d1a: Neither blocks nor log segments found. Creating new log.
I20260811 16:37:33.667624 27150 log.cc:824] T eff9ea1a381c47eeb052f167a76aac88 P 52a320e1595e4823b09accea7ba2017d: Log is configured to *not* fsync() on all Append() calls
I20260811 16:37:33.667860 27151 tablet_bootstrap.cc:654] T eff9ea1a381c47eeb052f167a76aac88 P 5ca1cc414e2c4ccab3342e69765aacb7: Neither blocks nor log segments found. Creating new log.
I20260811 16:37:33.668145 27152 log.cc:824] T eff9ea1a381c47eeb052f167a76aac88 P 05e67aa991604a58a5c6be43ecc10d1a: Log is configured to *not* fsync() on all Append() calls
I20260811 16:37:33.668424 27151 log.cc:824] T eff9ea1a381c47eeb052f167a76aac88 P 5ca1cc414e2c4ccab3342e69765aacb7: Log is configured to *not* fsync() on all Append() calls
I20260811 16:37:33.668470 27150 tablet_bootstrap.cc:492] T eff9ea1a381c47eeb052f167a76aac88 P 52a320e1595e4823b09accea7ba2017d: No bootstrap required, opened a new log
I20260811 16:37:33.668529 27150 ts_tablet_manager.cc:1397] T eff9ea1a381c47eeb052f167a76aac88 P 52a320e1595e4823b09accea7ba2017d: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 16:37:33.669160 27151 tablet_bootstrap.cc:492] T eff9ea1a381c47eeb052f167a76aac88 P 5ca1cc414e2c4ccab3342e69765aacb7: No bootstrap required, opened a new log
I20260811 16:37:33.669215 27151 ts_tablet_manager.cc:1397] T eff9ea1a381c47eeb052f167a76aac88 P 5ca1cc414e2c4ccab3342e69765aacb7: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:37:33.669283 27152 tablet_bootstrap.cc:492] T eff9ea1a381c47eeb052f167a76aac88 P 05e67aa991604a58a5c6be43ecc10d1a: No bootstrap required, opened a new log
I20260811 16:37:33.669394 27152 ts_tablet_manager.cc:1397] T eff9ea1a381c47eeb052f167a76aac88 P 05e67aa991604a58a5c6be43ecc10d1a: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 16:37:33.671264 27150 raft_consensus.cc:348] T eff9ea1a381c47eeb052f167a76aac88 P 52a320e1595e4823b09accea7ba2017d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca1cc414e2c4ccab3342e69765aacb7" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 34767 } } peers { permanent_uuid: "52a320e1595e4823b09accea7ba2017d" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 34089 } } peers { permanent_uuid: "05e67aa991604a58a5c6be43ecc10d1a" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 43421 } }
I20260811 16:37:33.671351 27151 raft_consensus.cc:348] T eff9ea1a381c47eeb052f167a76aac88 P 5ca1cc414e2c4ccab3342e69765aacb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca1cc414e2c4ccab3342e69765aacb7" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 34767 } } peers { permanent_uuid: "52a320e1595e4823b09accea7ba2017d" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 34089 } } peers { permanent_uuid: "05e67aa991604a58a5c6be43ecc10d1a" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 43421 } }
I20260811 16:37:33.671450 27150 raft_consensus.cc:374] T eff9ea1a381c47eeb052f167a76aac88 P 52a320e1595e4823b09accea7ba2017d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:37:33.671483 27151 raft_consensus.cc:374] T eff9ea1a381c47eeb052f167a76aac88 P 5ca1cc414e2c4ccab3342e69765aacb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:37:33.671489 27150 raft_consensus.cc:729] T eff9ea1a381c47eeb052f167a76aac88 P 52a320e1595e4823b09accea7ba2017d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52a320e1595e4823b09accea7ba2017d, State: Initialized, Role: FOLLOWER
I20260811 16:37:33.671504 27151 raft_consensus.cc:729] T eff9ea1a381c47eeb052f167a76aac88 P 5ca1cc414e2c4ccab3342e69765aacb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca1cc414e2c4ccab3342e69765aacb7, State: Initialized, Role: FOLLOWER
I20260811 16:37:33.671595 27150 consensus_queue.cc:260] T eff9ea1a381c47eeb052f167a76aac88 P 52a320e1595e4823b09accea7ba2017d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca1cc414e2c4ccab3342e69765aacb7" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 34767 } } peers { permanent_uuid: "52a320e1595e4823b09accea7ba2017d" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 34089 } } peers { permanent_uuid: "05e67aa991604a58a5c6be43ecc10d1a" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 43421 } }
I20260811 16:37:33.671591 27151 consensus_queue.cc:260] T eff9ea1a381c47eeb052f167a76aac88 P 5ca1cc414e2c4ccab3342e69765aacb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca1cc414e2c4ccab3342e69765aacb7" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 34767 } } peers { permanent_uuid: "52a320e1595e4823b09accea7ba2017d" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 34089 } } peers { permanent_uuid: "05e67aa991604a58a5c6be43ecc10d1a" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 43421 } }
I20260811 16:37:33.671865 27150 ts_tablet_manager.cc:1428] T eff9ea1a381c47eeb052f167a76aac88 P 52a320e1595e4823b09accea7ba2017d: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260811 16:37:33.671877 27151 ts_tablet_manager.cc:1428] T eff9ea1a381c47eeb052f167a76aac88 P 5ca1cc414e2c4ccab3342e69765aacb7: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 16:37:33.671911 26661 heartbeater.cc:503] Master 127.24.175.254:42031 was elected leader, sending a full tablet report...
I20260811 16:37:33.671990 26891 heartbeater.cc:503] Master 127.24.175.254:42031 was elected leader, sending a full tablet report...
I20260811 16:37:33.672282 27152 raft_consensus.cc:348] T eff9ea1a381c47eeb052f167a76aac88 P 05e67aa991604a58a5c6be43ecc10d1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca1cc414e2c4ccab3342e69765aacb7" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 34767 } } peers { permanent_uuid: "52a320e1595e4823b09accea7ba2017d" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 34089 } } peers { permanent_uuid: "05e67aa991604a58a5c6be43ecc10d1a" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 43421 } }
I20260811 16:37:33.672518 27152 raft_consensus.cc:374] T eff9ea1a381c47eeb052f167a76aac88 P 05e67aa991604a58a5c6be43ecc10d1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:37:33.672566 27152 raft_consensus.cc:729] T eff9ea1a381c47eeb052f167a76aac88 P 05e67aa991604a58a5c6be43ecc10d1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05e67aa991604a58a5c6be43ecc10d1a, State: Initialized, Role: FOLLOWER
I20260811 16:37:33.672674 27152 consensus_queue.cc:260] T eff9ea1a381c47eeb052f167a76aac88 P 05e67aa991604a58a5c6be43ecc10d1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca1cc414e2c4ccab3342e69765aacb7" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 34767 } } peers { permanent_uuid: "52a320e1595e4823b09accea7ba2017d" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 34089 } } peers { permanent_uuid: "05e67aa991604a58a5c6be43ecc10d1a" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 43421 } }
I20260811 16:37:33.673017 27124 heartbeater.cc:503] Master 127.24.175.254:42031 was elected leader, sending a full tablet report...
I20260811 16:37:33.673090 27152 ts_tablet_manager.cc:1428] T eff9ea1a381c47eeb052f167a76aac88 P 05e67aa991604a58a5c6be43ecc10d1a: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
W20260811 16:37:33.698807 26892 tablet.cc:2369] T eff9ea1a381c47eeb052f167a76aac88 P 52a320e1595e4823b09accea7ba2017d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:37:33.722321 27159 raft_consensus.cc:482] T eff9ea1a381c47eeb052f167a76aac88 P 52a320e1595e4823b09accea7ba2017d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:37:33.722450 27159 raft_consensus.cc:504] T eff9ea1a381c47eeb052f167a76aac88 P 52a320e1595e4823b09accea7ba2017d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca1cc414e2c4ccab3342e69765aacb7" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 34767 } } peers { permanent_uuid: "52a320e1595e4823b09accea7ba2017d" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 34089 } } peers { permanent_uuid: "05e67aa991604a58a5c6be43ecc10d1a" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 43421 } }
I20260811 16:37:33.722922 27159 leader_election.cc:288] T eff9ea1a381c47eeb052f167a76aac88 P 52a320e1595e4823b09accea7ba2017d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca1cc414e2c4ccab3342e69765aacb7 (127.24.175.193:34767), 05e67aa991604a58a5c6be43ecc10d1a (127.24.175.195:43421)
I20260811 16:37:33.726236 26893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:33.723076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.193:34767 (local address 127.24.175.194:48309)
0811 16:37:33.723131 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:33.723147 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:33.723196 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:33.723346 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:33.723347 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:33.723350 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:37:33.723443 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:33.723445 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:33.724262 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:33.724262 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:33.725419 (+ 1157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:33.725422 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:33.725950 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:33.725951 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:33.726067 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:33.726070 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:37:33.726118 (+ 48us) client_negotiation.cc:240] Negotiation successful
0811 16:37:33.726178 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260811 16:37:33.726264 27144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:33.723176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:48309 (local address 127.24.175.193:34767)
0811 16:37:33.723222 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:33.723224 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:33.723237 (+ 13us) server_negotiation.cc:407] Connection header received
0811 16:37:33.723262 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:33.723263 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:33.723271 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:33.723316 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:37:33.723520 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:33.724180 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:33.725505 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:33.725875 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:33.725940 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:33.725950 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:33.726140 (+ 190us) server_negotiation.cc:299] Negotiation successful
0811 16:37:33.726198 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 16:37:33.726679 26583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eff9ea1a381c47eeb052f167a76aac88" candidate_uuid: "52a320e1595e4823b09accea7ba2017d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca1cc414e2c4ccab3342e69765aacb7" is_pre_election: true
I20260811 16:37:33.726779 27148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:33.723281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:55521 (local address 127.24.175.195:43421)
0811 16:37:33.723347 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:33.723349 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:33.723514 (+ 165us) server_negotiation.cc:407] Connection header received
0811 16:37:33.723562 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:33.723564 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:33.723572 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:33.723622 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:37:33.723876 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:33.724461 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:33.725936 (+ 1475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:33.726467 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:33.726538 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:33.726546 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:33.726704 (+ 158us) server_negotiation.cc:299] Negotiation successful
0811 16:37:33.726734 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 16:37:33.726845 27167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:33.723183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.195:43421 (local address 127.24.175.194:55521)
0811 16:37:33.723449 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:33.723459 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:33.723511 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:33.723629 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:33.723629 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:33.723631 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:37:33.723808 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:33.723810 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:33.724531 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:33.724532 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:33.725857 (+ 1325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:33.725860 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:33.726564 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:33.726566 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:33.726634 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:33.726639 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 16:37:33.726702 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 16:37:33.726742 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":120,"threads_started":1}
I20260811 16:37:33.726856 26583 raft_consensus.cc:2454] T eff9ea1a381c47eeb052f167a76aac88 P 5ca1cc414e2c4ccab3342e69765aacb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 52a320e1595e4823b09accea7ba2017d in term 0.
I20260811 16:37:33.727080 26702 leader_election.cc:302] T eff9ea1a381c47eeb052f167a76aac88 P 52a320e1595e4823b09accea7ba2017d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52a320e1595e4823b09accea7ba2017d, 5ca1cc414e2c4ccab3342e69765aacb7; no voters:
I20260811 16:37:33.727200 27159 raft_consensus.cc:2781] T eff9ea1a381c47eeb052f167a76aac88 P 52a320e1595e4823b09accea7ba2017d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:37:33.727257 27159 raft_consensus.cc:482] T eff9ea1a381c47eeb052f167a76aac88 P 52a320e1595e4823b09accea7ba2017d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:37:33.727275 27159 raft_consensus.cc:3037] T eff9ea1a381c47eeb052f167a76aac88 P 52a320e1595e4823b09accea7ba2017d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:37:33.727327 27050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eff9ea1a381c47eeb052f167a76aac88" candidate_uuid: "52a320e1595e4823b09accea7ba2017d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05e67aa991604a58a5c6be43ecc10d1a" is_pre_election: true
I20260811 16:37:33.727479 27050 raft_consensus.cc:2454] T eff9ea1a381c47eeb052f167a76aac88 P 05e67aa991604a58a5c6be43ecc10d1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 52a320e1595e4823b09accea7ba2017d in term 0.
I20260811 16:37:33.728506 27159 raft_consensus.cc:504] T eff9ea1a381c47eeb052f167a76aac88 P 52a320e1595e4823b09accea7ba2017d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca1cc414e2c4ccab3342e69765aacb7" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 34767 } } peers { permanent_uuid: "52a320e1595e4823b09accea7ba2017d" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 34089 } } peers { permanent_uuid: "05e67aa991604a58a5c6be43ecc10d1a" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 43421 } }
I20260811 16:37:33.728615 27159 leader_election.cc:288] T eff9ea1a381c47eeb052f167a76aac88 P 52a320e1595e4823b09accea7ba2017d [CANDIDATE]: Term 1 election: Requested vote from peers 5ca1cc414e2c4ccab3342e69765aacb7 (127.24.175.193:34767), 05e67aa991604a58a5c6be43ecc10d1a (127.24.175.195:43421)
I20260811 16:37:33.728760 26583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eff9ea1a381c47eeb052f167a76aac88" candidate_uuid: "52a320e1595e4823b09accea7ba2017d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca1cc414e2c4ccab3342e69765aacb7"
I20260811 16:37:33.728792 27050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eff9ea1a381c47eeb052f167a76aac88" candidate_uuid: "52a320e1595e4823b09accea7ba2017d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05e67aa991604a58a5c6be43ecc10d1a"
I20260811 16:37:33.728852 27050 raft_consensus.cc:3037] T eff9ea1a381c47eeb052f167a76aac88 P 05e67aa991604a58a5c6be43ecc10d1a [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:37:33.728849 26583 raft_consensus.cc:3037] T eff9ea1a381c47eeb052f167a76aac88 P 5ca1cc414e2c4ccab3342e69765aacb7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:37:33.730304 26583 raft_consensus.cc:2454] T eff9ea1a381c47eeb052f167a76aac88 P 5ca1cc414e2c4ccab3342e69765aacb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52a320e1595e4823b09accea7ba2017d in term 1.
I20260811 16:37:33.730304 27050 raft_consensus.cc:2454] T eff9ea1a381c47eeb052f167a76aac88 P 05e67aa991604a58a5c6be43ecc10d1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52a320e1595e4823b09accea7ba2017d in term 1.
I20260811 16:37:33.730458 26702 leader_election.cc:302] T eff9ea1a381c47eeb052f167a76aac88 P 52a320e1595e4823b09accea7ba2017d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52a320e1595e4823b09accea7ba2017d, 5ca1cc414e2c4ccab3342e69765aacb7; no voters:
I20260811 16:37:33.730537 27159 raft_consensus.cc:2781] T eff9ea1a381c47eeb052f167a76aac88 P 52a320e1595e4823b09accea7ba2017d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:37:33.730695 27159 raft_consensus.cc:686] T eff9ea1a381c47eeb052f167a76aac88 P 52a320e1595e4823b09accea7ba2017d [term 1 LEADER]: Becoming Leader. State: Replica: 52a320e1595e4823b09accea7ba2017d, State: Running, Role: LEADER
I20260811 16:37:33.730785 27159 consensus_queue.cc:237] T eff9ea1a381c47eeb052f167a76aac88 P 52a320e1595e4823b09accea7ba2017d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca1cc414e2c4ccab3342e69765aacb7" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 34767 } } peers { permanent_uuid: "52a320e1595e4823b09accea7ba2017d" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 34089 } } peers { permanent_uuid: "05e67aa991604a58a5c6be43ecc10d1a" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 43421 } }
I20260811 16:37:33.731617 26296 catalog_manager.cc:5495] T eff9ea1a381c47eeb052f167a76aac88 P 52a320e1595e4823b09accea7ba2017d reported cstate change: term changed from 0 to 1, leader changed from <none> to 52a320e1595e4823b09accea7ba2017d (127.24.175.194). New cstate: current_term: 1 leader_uuid: "52a320e1595e4823b09accea7ba2017d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca1cc414e2c4ccab3342e69765aacb7" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 34767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "52a320e1595e4823b09accea7ba2017d" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 34089 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05e67aa991604a58a5c6be43ecc10d1a" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 43421 } health_report { overall_health: UNKNOWN } } }
Aug 11 16:37:33 dist-test-slave-zj8q krb5kdc[26214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466252, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.175.193@KRBTEST.COM
I20260811 16:37:33.758176 27144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:33.751527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36172 (local address 127.24.175.193:34767)
0811 16:37:33.751590 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:33.751591 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:33.751748 (+ 157us) server_negotiation.cc:407] Connection header received
0811 16:37:33.751772 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:33.751773 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:33.751781 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:33.751825 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:33.752383 (+ 558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:33.752830 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:33.753456 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:33.753626 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:33.753664 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:33.755813 (+ 2149us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:33.755821 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:33.755821 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:37:33.755828 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:33.757322 (+ 1494us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:33.757610 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:33.757612 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:33.757613 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:33.757660 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:33.757793 (+ 133us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:33.757793 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:33.757793 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:33.757908 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:33.758009 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:33.758038 (+ 29us) server_negotiation.cc:299] Negotiation successful
0811 16:37:33.758096 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
Aug 11 16:37:33 dist-test-slave-zj8q krb5kdc[26214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466253, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
W20260811 16:37:33.774886 26662 tablet.cc:2369] T eff9ea1a381c47eeb052f167a76aac88 P 5ca1cc414e2c4ccab3342e69765aacb7: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 11 16:37:33 dist-test-slave-zj8q krb5kdc[26214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466253, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.24.175.193@KRBTEST.COM
I20260811 16:37:33.780227 27144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:33.774253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36176 (local address 127.24.175.193:34767)
0811 16:37:33.774316 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:33.774318 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:33.774375 (+ 57us) server_negotiation.cc:407] Connection header received
0811 16:37:33.774422 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:33.774423 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:33.774431 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:33.774475 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:33.774960 (+ 485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:33.775445 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:33.776182 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:33.776367 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:33.776414 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:33.778358 (+ 1944us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:33.778359 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:33.778360 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:37:33.778366 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:33.779425 (+ 1059us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:33.779691 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:33.779692 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:33.779692 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:33.779738 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:33.779856 (+ 118us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:33.779857 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:33.779857 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:33.779934 (+ 77us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:33.779995 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:33.780095 (+ 100us) server_negotiation.cc:299] Negotiation successful
0811 16:37:33.780151 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
Aug 11 16:37:33 dist-test-slave-zj8q krb5kdc[26214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466253, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 16:37:33 dist-test-slave-zj8q krb5kdc[26214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466253, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.175.193@KRBTEST.COM
I20260811 16:37:33.801092 27144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:33.795098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36190 (local address 127.24.175.193:34767)
0811 16:37:33.795154 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:33.795156 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:33.795196 (+ 40us) server_negotiation.cc:407] Connection header received
0811 16:37:33.795258 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:33.795259 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:33.795267 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:33.795302 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:33.795786 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:33.796221 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:33.796881 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:33.797048 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:33.797089 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:33.799127 (+ 2038us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:33.799129 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:33.799129 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:37:33.799135 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:33.800282 (+ 1147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:33.800579 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:33.800580 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:33.800580 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:33.800623 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:33.800761 (+ 138us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:33.800762 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:33.800762 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:33.800840 (+ 78us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:33.800908 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:33.800978 (+ 70us) server_negotiation.cc:299] Negotiation successful
0811 16:37:33.801030 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
W20260811 16:37:33.801797 26515 tablet_service.cc:2908] Rejecting scan request for tablet eff9ea1a381c47eeb052f167a76aac88: Uninitialized: clean time has not yet been initialized
I20260811 16:37:33.802856 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 26412
I20260811 16:37:33.813546 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 26670
I20260811 16:37:33.821130 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 26902
I20260811 16:37:33.830405 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 26237
2026-08-11T16:37:33Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2195 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:37:33 dist-test-slave-zj8q krb5kdc[27194](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:37:33 dist-test-slave-zj8q krb5kdc[27194](info): set up 2 sockets
Aug 11 16:37:33 dist-test-slave-zj8q krb5kdc[27194](info): commencing operation
krb5kdc: starting...
W20260811 16:37:35.112558 25279 mini_kdc.cc:121] Time spent starting KDC: real 1.255s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Aug 11 16:37:35 dist-test-slave-zj8q krb5kdc[27194](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466255, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:37:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:37:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab.
Entry for principal kudu/127.24.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab.
I20260811 16:37:35.290218 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:43961
--webserver_interface=127.24.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:45325
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.175.254:43961
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:37:35.475569 27213 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:37:35.476050 27213 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:37:35.476111 27213 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:37:35.479000 27213 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:37:35.479089 27213 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 16:37:35.479151 27213 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:37:35.479197 27213 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:37:35.479252 27213 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:37:35.479303 27213 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:37:35.482633 27213 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:45325
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.175.254:43961
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:43961
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27213
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:37:35.483052 27213 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:37:35.483410 27213 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:37:35.492570 27227 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:35.492640 27230 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:35.492589 27226 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:37:35.493295 27213 server_base.cc:1034] running on GCE node
I20260811 16:37:35.493593 27213 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:37:35.494084 27213 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:37:35.495359 27213 hybrid_clock.cc:648] HybridClock initialized: now 1786466255495334 us; error 66 us; skew 500 ppm
Aug 11 16:37:35 dist-test-slave-zj8q krb5kdc[27194](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466255, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:37:35.503489 27213 init.cc:377] Logged in from keytab as kudu/127.24.175.254@KRBTEST.COM (short username kudu)
I20260811 16:37:35.504205 27213 webserver.cc:460] Webserver started at http://127.24.175.254:35449/ using document root <none> and password file <none>
I20260811 16:37:35.504645 27213 fs_manager.cc:359] Metadata directory not provided
I20260811 16:37:35.504746 27213 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:37:35.505103 27213 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:37:35.507607 27213 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/master-0/data/instance:
uuid: "09ee313a70b4468aac60cbec7bd2489e"
format_stamp: "Formatted at 2026-08-11 16:37:35 on dist-test-slave-zj8q"
server_key: "28f15c1c506d7fabe1c8c0274ecad541"
server_key_iv: "9bba0bc1e2b89aade7a93683a64fd19c"
server_key_version: "encryptionkey@0"
I20260811 16:37:35.508193 27213 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/master-0/wal/instance:
uuid: "09ee313a70b4468aac60cbec7bd2489e"
format_stamp: "Formatted at 2026-08-11 16:37:35 on dist-test-slave-zj8q"
server_key: "28f15c1c506d7fabe1c8c0274ecad541"
server_key_iv: "9bba0bc1e2b89aade7a93683a64fd19c"
server_key_version: "encryptionkey@0"
I20260811 16:37:35.511216 27213 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.003s
I20260811 16:37:35.512639 27245 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:35.512948 27213 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:37:35.513134 27213 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/master-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/master-0/wal
uuid: "09ee313a70b4468aac60cbec7bd2489e"
format_stamp: "Formatted at 2026-08-11 16:37:35 on dist-test-slave-zj8q"
server_key: "28f15c1c506d7fabe1c8c0274ecad541"
server_key_iv: "9bba0bc1e2b89aade7a93683a64fd19c"
server_key_version: "encryptionkey@0"
I20260811 16:37:35.513283 27213 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:37:35.530006 27213 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:37:35.533164 27213 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:37:35.533492 27213 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:37:35.546582 27213 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.254:43961
I20260811 16:37:35.546679 27347 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.254:43961 every 8 connection(s)
I20260811 16:37:35.547658 27213 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
I20260811 16:37:35.549208 27348 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:37:35.549716 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 27213
I20260811 16:37:35.549929 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/master-0/wal/instance
I20260811 16:37:35.550314 25279 external_mini_cluster.cc:1428] Setting key 02db76367a475581cbe2ea0d64e0ff6b
I20260811 16:37:35.554916 27348 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09ee313a70b4468aac60cbec7bd2489e: Bootstrap starting.
I20260811 16:37:35.556176 27348 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 09ee313a70b4468aac60cbec7bd2489e: Neither blocks nor log segments found. Creating new log.
I20260811 16:37:35.556913 27348 log.cc:824] T 00000000000000000000000000000000 P 09ee313a70b4468aac60cbec7bd2489e: Log is configured to *not* fsync() on all Append() calls
I20260811 16:37:35.561691 27348 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09ee313a70b4468aac60cbec7bd2489e: No bootstrap required, opened a new log
Aug 11 16:37:35 dist-test-slave-zj8q krb5kdc[27194](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466255, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:37:35.567625 27348 raft_consensus.cc:348] T 00000000000000000000000000000000 P 09ee313a70b4468aac60cbec7bd2489e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09ee313a70b4468aac60cbec7bd2489e" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 43961 } }
I20260811 16:37:35.568080 27348 raft_consensus.cc:374] T 00000000000000000000000000000000 P 09ee313a70b4468aac60cbec7bd2489e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:37:35.568173 27348 raft_consensus.cc:729] T 00000000000000000000000000000000 P 09ee313a70b4468aac60cbec7bd2489e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09ee313a70b4468aac60cbec7bd2489e, State: Initialized, Role: FOLLOWER
I20260811 16:37:35.568630 27348 consensus_queue.cc:260] T 00000000000000000000000000000000 P 09ee313a70b4468aac60cbec7bd2489e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09ee313a70b4468aac60cbec7bd2489e" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 43961 } }
I20260811 16:37:35.568871 27348 raft_consensus.cc:388] T 00000000000000000000000000000000 P 09ee313a70b4468aac60cbec7bd2489e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:37:35.569036 27348 raft_consensus.cc:482] T 00000000000000000000000000000000 P 09ee313a70b4468aac60cbec7bd2489e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:37:35.569164 27348 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 09ee313a70b4468aac60cbec7bd2489e [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:37:35.570854 27348 raft_consensus.cc:504] T 00000000000000000000000000000000 P 09ee313a70b4468aac60cbec7bd2489e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09ee313a70b4468aac60cbec7bd2489e" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 43961 } }
I20260811 16:37:35.571089 27348 leader_election.cc:302] T 00000000000000000000000000000000 P 09ee313a70b4468aac60cbec7bd2489e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 09ee313a70b4468aac60cbec7bd2489e; no voters:
I20260811 16:37:35.571437 27348 leader_election.cc:288] T 00000000000000000000000000000000 P 09ee313a70b4468aac60cbec7bd2489e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:37:35.571552 27357 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 09ee313a70b4468aac60cbec7bd2489e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:37:35.571805 27357 raft_consensus.cc:686] T 00000000000000000000000000000000 P 09ee313a70b4468aac60cbec7bd2489e [term 1 LEADER]: Becoming Leader. State: Replica: 09ee313a70b4468aac60cbec7bd2489e, State: Running, Role: LEADER
I20260811 16:37:35.572006 27348 sys_catalog.cc:564] T 00000000000000000000000000000000 P 09ee313a70b4468aac60cbec7bd2489e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:37:35.572047 27357 consensus_queue.cc:237] T 00000000000000000000000000000000 P 09ee313a70b4468aac60cbec7bd2489e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09ee313a70b4468aac60cbec7bd2489e" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 43961 } }
I20260811 16:37:35.572696 27357 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09ee313a70b4468aac60cbec7bd2489e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 09ee313a70b4468aac60cbec7bd2489e. Latest consensus state: current_term: 1 leader_uuid: "09ee313a70b4468aac60cbec7bd2489e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09ee313a70b4468aac60cbec7bd2489e" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 43961 } } }
I20260811 16:37:35.572916 27357 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09ee313a70b4468aac60cbec7bd2489e [sys.catalog]: This master's current role is: LEADER
I20260811 16:37:35.572711 27363 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09ee313a70b4468aac60cbec7bd2489e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "09ee313a70b4468aac60cbec7bd2489e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09ee313a70b4468aac60cbec7bd2489e" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 43961 } } }
I20260811 16:37:35.573030 27363 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09ee313a70b4468aac60cbec7bd2489e [sys.catalog]: This master's current role is: LEADER
W20260811 16:37:35.576342 27384 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 09ee313a70b4468aac60cbec7bd2489e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260811 16:37:35.576460 27352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:35.551496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55542 (local address 127.24.175.254:43961)
0811 16:37:35.551908 (+ 412us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:35.551946 (+ 38us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:35.552012 (+ 66us) server_negotiation.cc:407] Connection header received
0811 16:37:35.553279 (+ 1267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:35.553289 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:35.553453 (+ 164us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:35.553905 (+ 452us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:35.555626 (+ 1721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:35.558675 (+ 3049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:35.560361 (+ 1686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:35.561580 (+ 1219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:35.561841 (+ 261us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:35.568500 (+ 6659us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:35.568508 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:35.568509 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:37:35.568572 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:35.572677 (+ 4105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:35.573500 (+ 823us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:35.573506 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:35.573506 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:35.573780 (+ 274us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:35.574139 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:35.574148 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:35.574185 (+ 37us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:35.574936 (+ 751us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:35.575281 (+ 345us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:35.575629 (+ 348us) server_negotiation.cc:299] Negotiation successful
0811 16:37:35.575958 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":314,"thread_start_us":197,"threads_started":1}
W20260811 16:37:35.576464 27384 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 16:37:35.578375 27386 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:37:35.578922 27386 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:37:35.581808 27386 catalog_manager.cc:1347] Generated new cluster ID: 1a58c95945cb4a89bdca6887b22c52eb
I20260811 16:37:35.581877 27386 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:37:35.609041 27386 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:37:35.609999 27386 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:37:35.617611 27386 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 09ee313a70b4468aac60cbec7bd2489e: Generated new TSK 0
I20260811 16:37:35.617787 27386 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.175.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab.
Entry for principal kudu/127.24.175.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab.
I20260811 16:37:35.651387 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.193:0
--local_ip_for_outbound_sockets=127.24.175.193
--webserver_interface=127.24.175.193
--webserver_port=0
--tserver_master_addrs=127.24.175.254:43961
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab
--principal=kudu/127.24.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:45325
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:37:35.733312 27397 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:37:35.733498 27397 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:37:35.733520 27397 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:37:35.734663 27397 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:37:35.734701 27397 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:37:35.734722 27397 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 16:37:35.734752 27397 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.193
I20260811 16:37:35.736152 27397 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:45325
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab
--principal=kudu/127.24.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.175.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.24.175.254:43961
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27397
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.193
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:37:35.736364 27397 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:37:35.736568 27397 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:37:35.741292 27404 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:35.741348 27405 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:35.741300 27408 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:37:35.741434 27397 server_base.cc:1034] running on GCE node
I20260811 16:37:35.741706 27397 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:37:35.741915 27397 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:37:35.743046 27397 hybrid_clock.cc:648] HybridClock initialized: now 1786466255743026 us; error 36 us; skew 500 ppm
Aug 11 16:37:35 dist-test-slave-zj8q krb5kdc[27194](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466255, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:37:35.745344 27397 init.cc:377] Logged in from keytab as kudu/127.24.175.193@KRBTEST.COM (short username kudu)
I20260811 16:37:35.745746 27397 webserver.cc:460] Webserver started at http://127.24.175.193:45027/ using document root <none> and password file <none>
I20260811 16:37:35.745939 27397 fs_manager.cc:359] Metadata directory not provided
I20260811 16:37:35.745985 27397 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:37:35.746109 27397 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:37:35.747108 27397 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/ts-0/data/instance:
uuid: "bc93071d362845daab3d1592f5fb591e"
format_stamp: "Formatted at 2026-08-11 16:37:35 on dist-test-slave-zj8q"
server_key: "b4556309016331d9b8252ccdf601bdd8"
server_key_iv: "a3bd363e88e8fc5d726ed6d273491f74"
server_key_version: "encryptionkey@0"
I20260811 16:37:35.747439 27397 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/ts-0/wal/instance:
uuid: "bc93071d362845daab3d1592f5fb591e"
format_stamp: "Formatted at 2026-08-11 16:37:35 on dist-test-slave-zj8q"
server_key: "b4556309016331d9b8252ccdf601bdd8"
server_key_iv: "a3bd363e88e8fc5d726ed6d273491f74"
server_key_version: "encryptionkey@0"
I20260811 16:37:35.748634 27397 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:37:35.749274 27422 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:35.749455 27397 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:37:35.749541 27397 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/ts-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/ts-0/wal
uuid: "bc93071d362845daab3d1592f5fb591e"
format_stamp: "Formatted at 2026-08-11 16:37:35 on dist-test-slave-zj8q"
server_key: "b4556309016331d9b8252ccdf601bdd8"
server_key_iv: "a3bd363e88e8fc5d726ed6d273491f74"
server_key_version: "encryptionkey@0"
I20260811 16:37:35.749632 27397 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:37:35.766705 27397 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:37:35.768831 27397 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:37:35.768965 27397 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:37:35.769456 27397 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:37:35.769492 27397 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:35.769520 27397 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:37:35.769538 27397 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:35.776078 27397 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.193:40883
I20260811 16:37:35.776135 27615 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.193:40883 every 8 connection(s)
Aug 11 16:37:35 dist-test-slave-zj8q krb5kdc[27194](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466255, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.193@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:37:35.776467 27397 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
I20260811 16:37:35.779121 27352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:35.769997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:43471 (local address 127.24.175.254:43961)
0811 16:37:35.770063 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:35.770065 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:35.770291 (+ 226us) server_negotiation.cc:407] Connection header received
0811 16:37:35.770754 (+ 463us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:35.770755 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:35.770770 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:35.770846 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:35.771602 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:35.772365 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:35.773890 (+ 1525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:35.774273 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:35.774352 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:35.776784 (+ 2432us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:35.776785 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:35.776786 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:37:35.776794 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:35.778051 (+ 1257us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:35.778428 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:35.778429 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:35.778429 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:35.778479 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:35.778657 (+ 178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:35.778657 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:35.778657 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:35.778754 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:35.778799 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:35.778984 (+ 185us) server_negotiation.cc:299] Negotiation successful
0811 16:37:35.779051 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 16:37:35.779279 27441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:35.769930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:43961 (local address 127.24.175.193:43471)
0811 16:37:35.770185 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:35.770220 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:35.770660 (+ 440us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:35.770904 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:35.770908 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:35.771227 (+ 319us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:37:35.771516 (+ 289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:35.771523 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:35.772481 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:35.772482 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:35.773803 (+ 1321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:35.773806 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:35.774363 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:35.774365 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:35.774485 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:35.774964 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:37:35.774973 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:37:35.776674 (+ 1701us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:37:35.778120 (+ 1446us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:35.778125 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:35.778127 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:35.778373 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:35.778526 (+ 153us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:35.778526 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:35.778527 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:35.778612 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:35.778796 (+ 184us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:37:35.778799 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:37:35.778902 (+ 103us) client_negotiation.cc:769] Sending connection context
0811 16:37:35.778974 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 16:37:35.779083 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":88,"threads_started":1}
I20260811 16:37:35.779763 27616 heartbeater.cc:347] Connected to a master server at 127.24.175.254:43961
I20260811 16:37:35.779851 27616 heartbeater.cc:464] Registering TS with master...
I20260811 16:37:35.780040 27616 heartbeater.cc:511] Master 127.24.175.254:43961 requested a full tablet report, sending...
I20260811 16:37:35.780530 27279 ts_manager.cc:194] Registered new tserver with Master: bc93071d362845daab3d1592f5fb591e (127.24.175.193:40883)
I20260811 16:37:35.781221 27279 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.175.193@KRBTEST.COM'} at 127.24.175.193:43471
I20260811 16:37:35.785228 27352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:35.780831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:40123 (local address 127.24.175.254:43961)
0811 16:37:35.780867 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:35.780869 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:35.780969 (+ 100us) server_negotiation.cc:407] Connection header received
0811 16:37:35.781025 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:35.781026 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:35.781035 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:35.781078 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:35.781445 (+ 367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:35.781931 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:35.782539 (+ 608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:35.782718 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:35.782769 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:35.783419 (+ 650us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:35.783420 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:35.783420 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:37:35.783426 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:35.784407 (+ 981us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:35.784731 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:35.784732 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:35.784732 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:35.784773 (+ 41us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:35.784895 (+ 122us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:35.784896 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:35.784896 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:35.784974 (+ 78us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:35.785014 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:35.785123 (+ 109us) server_negotiation.cc:299] Negotiation successful
0811 16:37:35.785175 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260811 16:37:35.785236 27622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:35.780782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:43961 (local address 127.24.175.193:40123)
0811 16:37:35.780906 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:35.780915 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:35.780971 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:35.781081 (+ 110us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:35.781081 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:35.781239 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:37:35.781293 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:35.781294 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:35.781993 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:35.781994 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:35.782484 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:35.782485 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:35.782769 (+ 284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:35.782770 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:35.782818 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:35.783095 (+ 277us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:37:35.783098 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:37:35.783357 (+ 259us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:37:35.784475 (+ 1118us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:35.784476 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:35.784477 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:35.784673 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:35.784816 (+ 143us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:35.784816 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:35.784816 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:35.784863 (+ 47us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:35.785012 (+ 149us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:37:35.785013 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:37:35.785055 (+ 42us) client_negotiation.cc:769] Sending connection context
0811 16:37:35.785098 (+ 43us) client_negotiation.cc:240] Negotiation successful
0811 16:37:35.785166 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":67,"threads_started":1}
I20260811 16:37:35.786624 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 27397
I20260811 16:37:35.786725 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/ts-0/wal/instance
I20260811 16:37:35.786891 25279 external_mini_cluster.cc:1428] Setting key 9e7f49232b491bf3920f06e7dc2b97f2
WARNING: no policy specified for kudu/127.24.175.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab.
Entry for principal kudu/127.24.175.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab.
I20260811 16:37:35.809422 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.194:0
--local_ip_for_outbound_sockets=127.24.175.194
--webserver_interface=127.24.175.194
--webserver_port=0
--tserver_master_addrs=127.24.175.254:43961
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab
--principal=kudu/127.24.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:45325
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:37:35.890380 27629 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:37:35.890566 27629 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:37:35.890588 27629 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:37:35.891671 27629 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:37:35.891707 27629 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:37:35.891732 27629 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 16:37:35.891754 27629 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.194
I20260811 16:37:35.893107 27629 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:45325
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab
--principal=kudu/127.24.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.175.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.24.175.254:43961
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27629
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.194
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:37:35.893289 27629 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:37:35.893488 27629 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:37:35.898170 27641 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:37:35.898203 27629 server_base.cc:1034] running on GCE node
W20260811 16:37:35.898185 27639 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:35.898203 27643 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:37:35.898550 27629 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:37:35.898788 27629 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:37:35.899935 27629 hybrid_clock.cc:648] HybridClock initialized: now 1786466255899925 us; error 26 us; skew 500 ppm
Aug 11 16:37:35 dist-test-slave-zj8q krb5kdc[27194](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466255, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:37:35.902352 27629 init.cc:377] Logged in from keytab as kudu/127.24.175.194@KRBTEST.COM (short username kudu)
I20260811 16:37:35.902750 27629 webserver.cc:460] Webserver started at http://127.24.175.194:45111/ using document root <none> and password file <none>
I20260811 16:37:35.902940 27629 fs_manager.cc:359] Metadata directory not provided
I20260811 16:37:35.902988 27629 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:37:35.903112 27629 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:37:35.904073 27629 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/ts-1/data/instance:
uuid: "3e78b35a6f034657b418d0f93f0762fa"
format_stamp: "Formatted at 2026-08-11 16:37:35 on dist-test-slave-zj8q"
server_key: "4315ab2c220be2fa801a3919b475ecda"
server_key_iv: "6b78f9d3c1abf9bf0c3ee207772df6a4"
server_key_version: "encryptionkey@0"
I20260811 16:37:35.904399 27629 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/ts-1/wal/instance:
uuid: "3e78b35a6f034657b418d0f93f0762fa"
format_stamp: "Formatted at 2026-08-11 16:37:35 on dist-test-slave-zj8q"
server_key: "4315ab2c220be2fa801a3919b475ecda"
server_key_iv: "6b78f9d3c1abf9bf0c3ee207772df6a4"
server_key_version: "encryptionkey@0"
I20260811 16:37:35.905637 27629 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:37:35.906312 27654 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:35.906459 27629 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:37:35.906544 27629 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/ts-1/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/ts-1/wal
uuid: "3e78b35a6f034657b418d0f93f0762fa"
format_stamp: "Formatted at 2026-08-11 16:37:35 on dist-test-slave-zj8q"
server_key: "4315ab2c220be2fa801a3919b475ecda"
server_key_iv: "6b78f9d3c1abf9bf0c3ee207772df6a4"
server_key_version: "encryptionkey@0"
I20260811 16:37:35.906612 27629 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:37:35.924847 27629 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:37:35.926494 27629 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:37:35.926622 27629 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:37:35.927095 27629 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:37:35.927134 27629 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:35.927160 27629 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:37:35.927176 27629 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 16:37:35 dist-test-slave-zj8q krb5kdc[27194](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466255, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.194@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:37:35.933935 27629 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.194:46513
I20260811 16:37:35.934003 27853 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.194:46513 every 8 connection(s)
I20260811 16:37:35.934348 27629 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
I20260811 16:37:35.936412 27352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:35.927491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:50331 (local address 127.24.175.254:43961)
0811 16:37:35.927559 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:35.927561 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:35.927742 (+ 181us) server_negotiation.cc:407] Connection header received
0811 16:37:35.928344 (+ 602us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:35.928345 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:35.928359 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:35.928418 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:35.929241 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:35.929994 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:35.931480 (+ 1486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:35.931755 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:35.931813 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:35.934098 (+ 2285us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:35.934100 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:35.934101 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:37:35.934109 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:35.935411 (+ 1302us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:35.935756 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:35.935756 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:35.935757 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:35.935801 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:35.935961 (+ 160us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:35.935962 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:35.935962 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:35.936054 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:35.936098 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:35.936295 (+ 197us) server_negotiation.cc:299] Negotiation successful
0811 16:37:35.936350 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 16:37:35.936586 27666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:35.927450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:43961 (local address 127.24.175.194:50331)
0811 16:37:35.927606 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:35.927652 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:35.928246 (+ 594us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:35.928496 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:35.928501 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:35.928846 (+ 345us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:37:35.929139 (+ 293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:35.929146 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:35.930090 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:35.930091 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:35.931390 (+ 1299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:35.931394 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:35.931836 (+ 442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:35.931838 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:35.931991 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:35.932494 (+ 503us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:37:35.932503 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:37:35.934009 (+ 1506us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:37:35.935476 (+ 1467us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:35.935480 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:35.935481 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:35.935695 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:35.935841 (+ 146us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:35.935841 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:35.935842 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:35.935924 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:35.936099 (+ 175us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:37:35.936101 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:37:35.936206 (+ 105us) client_negotiation.cc:769] Sending connection context
0811 16:37:35.936283 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 16:37:35.936393 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":66,"threads_started":1}
I20260811 16:37:35.937026 27854 heartbeater.cc:347] Connected to a master server at 127.24.175.254:43961
I20260811 16:37:35.937105 27854 heartbeater.cc:464] Registering TS with master...
I20260811 16:37:35.937311 27854 heartbeater.cc:511] Master 127.24.175.254:43961 requested a full tablet report, sending...
I20260811 16:37:35.937731 27278 ts_manager.cc:194] Registered new tserver with Master: 3e78b35a6f034657b418d0f93f0762fa (127.24.175.194:46513)
I20260811 16:37:35.938254 27278 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.175.194@KRBTEST.COM'} at 127.24.175.194:50331
I20260811 16:37:35.942945 27352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:35.938045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:42697 (local address 127.24.175.254:43961)
0811 16:37:35.938083 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:35.938084 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:35.938206 (+ 122us) server_negotiation.cc:407] Connection header received
0811 16:37:35.938264 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:35.938264 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:35.938274 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:35.938320 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:35.938802 (+ 482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:35.939272 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:35.939949 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:35.940155 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:35.940207 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:35.940943 (+ 736us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:35.940945 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:35.940945 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:37:35.940952 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:35.941879 (+ 927us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:35.942217 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:35.942218 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:35.942219 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:35.942275 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:35.942432 (+ 157us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:35.942433 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:35.942433 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:35.942587 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:35.942649 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:35.942791 (+ 142us) server_negotiation.cc:299] Negotiation successful
0811 16:37:35.942857 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 16:37:35.942960 27867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:35.937983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:43961 (local address 127.24.175.194:42697)
0811 16:37:35.938138 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:35.938146 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:35.938219 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:35.938422 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:35.938423 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:35.938659 (+ 236us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:37:35.938725 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:35.938727 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:35.939359 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:35.939360 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:35.939877 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:35.939879 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:35.940215 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:35.940216 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:35.940291 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:35.940613 (+ 322us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:37:35.940618 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:37:35.940865 (+ 247us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:37:35.941951 (+ 1086us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:35.941952 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:35.941952 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:35.942119 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:35.942327 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:35.942327 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:35.942328 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:35.942383 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:35.942654 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:37:35.942654 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:37:35.942702 (+ 48us) client_negotiation.cc:769] Sending connection context
0811 16:37:35.942761 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 16:37:35.942858 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":79,"threads_started":1}
I20260811 16:37:35.943997 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 27629
I20260811 16:37:35.944087 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/ts-1/wal/instance
I20260811 16:37:35.944288 25279 external_mini_cluster.cc:1428] Setting key 693f81060821c8d0aa3013339e5fc6f0
WARNING: no policy specified for kudu/127.24.175.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab.
Entry for principal kudu/127.24.175.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab.
I20260811 16:37:35.966404 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.195:0
--local_ip_for_outbound_sockets=127.24.175.195
--webserver_interface=127.24.175.195
--webserver_port=0
--tserver_master_addrs=127.24.175.254:43961
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab
--principal=kudu/127.24.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:45325
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:37:36.048761 27873 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:37:36.048954 27873 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:37:36.048975 27873 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:37:36.050138 27873 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:37:36.050196 27873 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:37:36.050216 27873 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 16:37:36.050246 27873 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.195
I20260811 16:37:36.051736 27873 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:45325
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab
--principal=kudu/127.24.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.175.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.24.175.254:43961
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27873
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.195
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:37:36.051945 27873 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:37:36.052157 27873 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:37:36.056963 27883 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:36.056979 27879 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:36.057031 27881 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:37:36.057065 27873 server_base.cc:1034] running on GCE node
I20260811 16:37:36.057358 27873 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:37:36.057554 27873 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:37:36.058724 27873 hybrid_clock.cc:648] HybridClock initialized: now 1786466256058712 us; error 33 us; skew 500 ppm
Aug 11 16:37:36 dist-test-slave-zj8q krb5kdc[27194](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466256, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:37:36.061116 27873 init.cc:377] Logged in from keytab as kudu/127.24.175.195@KRBTEST.COM (short username kudu)
I20260811 16:37:36.061518 27873 webserver.cc:460] Webserver started at http://127.24.175.195:40939/ using document root <none> and password file <none>
I20260811 16:37:36.061707 27873 fs_manager.cc:359] Metadata directory not provided
I20260811 16:37:36.061755 27873 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:37:36.061877 27873 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:37:36.062909 27873 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/ts-2/data/instance:
uuid: "23d6ab10333843b9b28ebeca435a509c"
format_stamp: "Formatted at 2026-08-11 16:37:36 on dist-test-slave-zj8q"
server_key: "d281e943d6f07a9f706d78ce38f60b42"
server_key_iv: "413a6a8fe3dbd98ccaefea538e3b074d"
server_key_version: "encryptionkey@0"
I20260811 16:37:36.063236 27873 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/ts-2/wal/instance:
uuid: "23d6ab10333843b9b28ebeca435a509c"
format_stamp: "Formatted at 2026-08-11 16:37:36 on dist-test-slave-zj8q"
server_key: "d281e943d6f07a9f706d78ce38f60b42"
server_key_iv: "413a6a8fe3dbd98ccaefea538e3b074d"
server_key_version: "encryptionkey@0"
I20260811 16:37:36.064421 27873 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:37:36.065037 27897 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:36.065162 27873 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:37:36.065253 27873 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/ts-2/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/ts-2/wal
uuid: "23d6ab10333843b9b28ebeca435a509c"
format_stamp: "Formatted at 2026-08-11 16:37:36 on dist-test-slave-zj8q"
server_key: "d281e943d6f07a9f706d78ce38f60b42"
server_key_iv: "413a6a8fe3dbd98ccaefea538e3b074d"
server_key_version: "encryptionkey@0"
I20260811 16:37:36.065310 27873 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:37:36.077832 27873 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:37:36.079491 27873 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:37:36.079620 27873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:37:36.080138 27873 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:37:36.080188 27873 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:36.080224 27873 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:37:36.080248 27873 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:36.086115 27873 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.195:42601
I20260811 16:37:36.086257 28102 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.195:42601 every 8 connection(s)
I20260811 16:37:36.086477 27873 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
Aug 11 16:37:36 dist-test-slave-zj8q krb5kdc[27194](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466256, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.195@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:37:36.089156 27352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:36.080497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.195:54095 (local address 127.24.175.254:43961)
0811 16:37:36.080544 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:36.080546 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:36.080770 (+ 224us) server_negotiation.cc:407] Connection header received
0811 16:37:36.081298 (+ 528us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:36.081299 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:36.081313 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:36.081364 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:36.082122 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.082892 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.084294 (+ 1402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.084584 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.084667 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:36.087104 (+ 2437us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:36.087105 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:36.087105 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:37:36.087112 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:36.088158 (+ 1046us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:36.088488 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:36.088488 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:36.088489 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:36.088531 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:36.088706 (+ 175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:36.088706 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:36.088706 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:36.088805 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:36.088849 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:36.089032 (+ 183us) server_negotiation.cc:299] Negotiation successful
0811 16:37:36.089095 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260811 16:37:36.089301 27910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:36.080509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:43961 (local address 127.24.175.195:54095)
0811 16:37:36.080662 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:36.080696 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:36.081202 (+ 506us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:36.081433 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:36.081437 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:36.081750 (+ 313us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:37:36.082013 (+ 263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:36.082020 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.082969 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.082970 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:36.084191 (+ 1221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:36.084194 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.084680 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.084681 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:36.084786 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:36.085274 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:37:36.085283 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:37:36.087014 (+ 1731us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:37:36.088221 (+ 1207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:36.088227 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:36.088228 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:36.088432 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:36.088580 (+ 148us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:36.088581 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:36.088581 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:36.088666 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:36.088846 (+ 180us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:37:36.088849 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:37:36.088948 (+ 99us) client_negotiation.cc:769] Sending connection context
0811 16:37:36.089017 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 16:37:36.089131 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":80,"threads_started":1}
I20260811 16:37:36.089754 28103 heartbeater.cc:347] Connected to a master server at 127.24.175.254:43961
I20260811 16:37:36.089838 28103 heartbeater.cc:464] Registering TS with master...
I20260811 16:37:36.090021 28103 heartbeater.cc:511] Master 127.24.175.254:43961 requested a full tablet report, sending...
I20260811 16:37:36.090379 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 27873
I20260811 16:37:36.090469 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/ts-2/wal/instance
I20260811 16:37:36.090512 27279 ts_manager.cc:194] Registered new tserver with Master: 23d6ab10333843b9b28ebeca435a509c (127.24.175.195:42601)
I20260811 16:37:36.090631 25279 external_mini_cluster.cc:1428] Setting key f8abc369fcda50b55a4752e412dc2168
I20260811 16:37:36.090934 27279 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.175.195@KRBTEST.COM'} at 127.24.175.195:54095
I20260811 16:37:36.091665 25279 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 16:37:36.096642 27352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:36.090940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.195:39157 (local address 127.24.175.254:43961)
0811 16:37:36.090978 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:36.090980 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:36.091104 (+ 124us) server_negotiation.cc:407] Connection header received
0811 16:37:36.091176 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:36.091177 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:36.091187 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:36.091247 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:36.092007 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.092617 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.093247 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.093494 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.093557 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:36.094478 (+ 921us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:36.094479 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:36.094480 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:37:36.094485 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:36.095663 (+ 1178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:36.096005 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:36.096006 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:36.096006 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:36.096051 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:36.096232 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:36.096232 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:36.096232 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:36.096315 (+ 83us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:36.096366 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:36.096524 (+ 158us) server_negotiation.cc:299] Negotiation successful
0811 16:37:36.096584 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 16:37:36.096686 28118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:36.090891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:43961 (local address 127.24.175.195:39157)
0811 16:37:36.091042 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:36.091052 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:36.091126 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:36.091713 (+ 587us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:36.091714 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:36.091887 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:37:36.091941 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:36.091943 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.092698 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.092699 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:36.093172 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:36.093174 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.093565 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.093567 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:36.093671 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:36.094008 (+ 337us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:37:36.094013 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:37:36.094406 (+ 393us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:37:36.095740 (+ 1334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:36.095741 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:36.095741 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:36.095935 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:36.096102 (+ 167us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:36.096103 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:36.096103 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:36.096176 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:36.096368 (+ 192us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:37:36.096369 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:37:36.096426 (+ 57us) client_negotiation.cc:769] Sending connection context
0811 16:37:36.096492 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 16:37:36.096588 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":63,"threads_started":1}
Aug 11 16:37:36 dist-test-slave-zj8q krb5kdc[27194](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466256, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 16:37:36 dist-test-slave-zj8q krb5kdc[27194](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466256, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:37:36.114360 27352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:36.108429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55550 (local address 127.24.175.254:43961)
0811 16:37:36.108477 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:36.108480 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:36.108487 (+ 7us) server_negotiation.cc:407] Connection header received
0811 16:37:36.108506 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:36.108507 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:36.108516 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:36.108559 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:36.109105 (+ 546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.109569 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.110302 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.110481 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.110536 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:36.112503 (+ 1967us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:36.112505 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:36.112505 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:37:36.112511 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:36.113507 (+ 996us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:36.113784 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:36.113784 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:36.113784 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:36.113825 (+ 41us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:36.113944 (+ 119us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:36.113945 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:36.113945 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:36.114028 (+ 83us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:36.114094 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:36.114243 (+ 149us) server_negotiation.cc:299] Negotiation successful
0811 16:37:36.114301 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 16:37:36.115722 27279 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55550:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:37:36.117244 27279 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:37:36.123536 28138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:36.119615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.195:42601 (local address 127.0.0.1:49176)
0811 16:37:36.119824 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:36.119833 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:36.119879 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:36.120111 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:36.120114 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:36.120116 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:37:36.120193 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:36.120195 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.121097 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.121098 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:36.122353 (+ 1255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:36.122356 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.123242 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.123244 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:36.123333 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:36.123348 (+ 15us) client_negotiation.cc:769] Sending connection context
0811 16:37:36.123412 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 16:37:36.123464 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":46,"threads_started":1}
I20260811 16:37:36.123855 28141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:36.119878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44640 (local address 127.24.175.193:40883)
0811 16:37:36.120043 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:36.120047 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:36.120055 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:37:36.120089 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:36.120090 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:36.120105 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:36.120359 (+ 254us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:37:36.120420 (+ 61us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.121529 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.122801 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.123502 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.123574 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:36.123623 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:36.123746 (+ 123us) server_negotiation.cc:299] Negotiation successful
0811 16:37:36.123782 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":87,"threads_started":1}
I20260811 16:37:36.123935 28139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:36.119713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49176 (local address 127.24.175.195:42601)
0811 16:37:36.119878 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:36.119882 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:36.119893 (+ 11us) server_negotiation.cc:407] Connection header received
0811 16:37:36.119935 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:36.119937 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:36.119953 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:36.120031 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:37:36.120276 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.121002 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.122424 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.123160 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.123234 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:36.123287 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:36.123809 (+ 522us) server_negotiation.cc:299] Negotiation successful
0811 16:37:36.123852 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":71,"threads_started":1}
I20260811 16:37:36.124012 28136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:36.119541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39454 (local address 127.24.175.194:46513)
0811 16:37:36.120001 (+ 460us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:36.120006 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:36.120015 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:37:36.120056 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:36.120058 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:36.120073 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:36.120360 (+ 287us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:37:36.120453 (+ 93us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.121564 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.122779 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.123337 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.123416 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:36.123470 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:36.123876 (+ 406us) server_negotiation.cc:299] Negotiation successful
0811 16:37:36.123920 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":420,"thread_start_us":75,"threads_started":1}
I20260811 16:37:36.123675 28134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:36.119433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.194:46513 (local address 127.0.0.1:39454)
0811 16:37:36.119528 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:36.119566 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:36.119622 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:36.120220 (+ 598us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:36.120220 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:36.120222 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:37:36.120285 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:36.120287 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.121641 (+ 1354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.121642 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:36.122706 (+ 1064us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:36.122709 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.123423 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.123424 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:36.123502 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:36.123507 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 16:37:36.123563 (+ 56us) client_negotiation.cc:240] Negotiation successful
0811 16:37:36.123602 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":71,"mutex_wait_us":14,"thread_start_us":40,"threads_started":1}
I20260811 16:37:36.123814 28137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:36.119746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.193:40883 (local address 127.0.0.1:44640)
0811 16:37:36.119831 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:36.119838 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:36.119879 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:36.120199 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:36.120200 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:36.120202 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:37:36.120285 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:36.120289 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.121639 (+ 1350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.121640 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:36.122712 (+ 1072us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:36.122715 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.123583 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.123584 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:36.123661 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:36.123665 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:37:36.123719 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 16:37:36.123755 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":76,"mutex_wait_us":35,"thread_start_us":36,"threads_started":1}
I20260811 16:37:36.124749 27976 tablet_service.cc:1467] Processing CreateTablet for tablet 52609754993e418db929196b223a86b1 (DEFAULT_TABLE table=test-table [id=2eed76d6e32e49d98562432925b33e28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:37:36.124771 27732 tablet_service.cc:1467] Processing CreateTablet for tablet 52609754993e418db929196b223a86b1 (DEFAULT_TABLE table=test-table [id=2eed76d6e32e49d98562432925b33e28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:37:36.125075 27976 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52609754993e418db929196b223a86b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:37:36.125080 27732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52609754993e418db929196b223a86b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:37:36.126595 27499 tablet_service.cc:1467] Processing CreateTablet for tablet 52609754993e418db929196b223a86b1 (DEFAULT_TABLE table=test-table [id=2eed76d6e32e49d98562432925b33e28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:37:36.126919 27499 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52609754993e418db929196b223a86b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:37:36.127876 28143 tablet_bootstrap.cc:492] T 52609754993e418db929196b223a86b1 P 3e78b35a6f034657b418d0f93f0762fa: Bootstrap starting.
I20260811 16:37:36.128193 28144 tablet_bootstrap.cc:492] T 52609754993e418db929196b223a86b1 P 23d6ab10333843b9b28ebeca435a509c: Bootstrap starting.
I20260811 16:37:36.128624 28143 tablet_bootstrap.cc:654] T 52609754993e418db929196b223a86b1 P 3e78b35a6f034657b418d0f93f0762fa: Neither blocks nor log segments found. Creating new log.
I20260811 16:37:36.128968 28143 log.cc:824] T 52609754993e418db929196b223a86b1 P 3e78b35a6f034657b418d0f93f0762fa: Log is configured to *not* fsync() on all Append() calls
I20260811 16:37:36.129128 28144 tablet_bootstrap.cc:654] T 52609754993e418db929196b223a86b1 P 23d6ab10333843b9b28ebeca435a509c: Neither blocks nor log segments found. Creating new log.
I20260811 16:37:36.129453 28144 log.cc:824] T 52609754993e418db929196b223a86b1 P 23d6ab10333843b9b28ebeca435a509c: Log is configured to *not* fsync() on all Append() calls
I20260811 16:37:36.129781 28143 tablet_bootstrap.cc:492] T 52609754993e418db929196b223a86b1 P 3e78b35a6f034657b418d0f93f0762fa: No bootstrap required, opened a new log
I20260811 16:37:36.129850 28143 ts_tablet_manager.cc:1397] T 52609754993e418db929196b223a86b1 P 3e78b35a6f034657b418d0f93f0762fa: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:37:36.130273 28152 tablet_bootstrap.cc:492] T 52609754993e418db929196b223a86b1 P bc93071d362845daab3d1592f5fb591e: Bootstrap starting.
I20260811 16:37:36.130484 28144 tablet_bootstrap.cc:492] T 52609754993e418db929196b223a86b1 P 23d6ab10333843b9b28ebeca435a509c: No bootstrap required, opened a new log
I20260811 16:37:36.130559 28144 ts_tablet_manager.cc:1397] T 52609754993e418db929196b223a86b1 P 23d6ab10333843b9b28ebeca435a509c: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:37:36.130916 28152 tablet_bootstrap.cc:654] T 52609754993e418db929196b223a86b1 P bc93071d362845daab3d1592f5fb591e: Neither blocks nor log segments found. Creating new log.
I20260811 16:37:36.131244 28152 log.cc:824] T 52609754993e418db929196b223a86b1 P bc93071d362845daab3d1592f5fb591e: Log is configured to *not* fsync() on all Append() calls
I20260811 16:37:36.131875 28143 raft_consensus.cc:348] T 52609754993e418db929196b223a86b1 P 3e78b35a6f034657b418d0f93f0762fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e78b35a6f034657b418d0f93f0762fa" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 46513 } } peers { permanent_uuid: "23d6ab10333843b9b28ebeca435a509c" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42601 } } peers { permanent_uuid: "bc93071d362845daab3d1592f5fb591e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40883 } }
I20260811 16:37:36.132009 28143 raft_consensus.cc:374] T 52609754993e418db929196b223a86b1 P 3e78b35a6f034657b418d0f93f0762fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:37:36.132018 28152 tablet_bootstrap.cc:492] T 52609754993e418db929196b223a86b1 P bc93071d362845daab3d1592f5fb591e: No bootstrap required, opened a new log
I20260811 16:37:36.132042 28143 raft_consensus.cc:729] T 52609754993e418db929196b223a86b1 P 3e78b35a6f034657b418d0f93f0762fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e78b35a6f034657b418d0f93f0762fa, State: Initialized, Role: FOLLOWER
I20260811 16:37:36.132072 28152 ts_tablet_manager.cc:1397] T 52609754993e418db929196b223a86b1 P bc93071d362845daab3d1592f5fb591e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 16:37:36.132160 28143 consensus_queue.cc:260] T 52609754993e418db929196b223a86b1 P 3e78b35a6f034657b418d0f93f0762fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e78b35a6f034657b418d0f93f0762fa" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 46513 } } peers { permanent_uuid: "23d6ab10333843b9b28ebeca435a509c" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42601 } } peers { permanent_uuid: "bc93071d362845daab3d1592f5fb591e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40883 } }
I20260811 16:37:36.132414 28143 ts_tablet_manager.cc:1428] T 52609754993e418db929196b223a86b1 P 3e78b35a6f034657b418d0f93f0762fa: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260811 16:37:36.132455 27854 heartbeater.cc:503] Master 127.24.175.254:43961 was elected leader, sending a full tablet report...
I20260811 16:37:36.132437 28144 raft_consensus.cc:348] T 52609754993e418db929196b223a86b1 P 23d6ab10333843b9b28ebeca435a509c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e78b35a6f034657b418d0f93f0762fa" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 46513 } } peers { permanent_uuid: "23d6ab10333843b9b28ebeca435a509c" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42601 } } peers { permanent_uuid: "bc93071d362845daab3d1592f5fb591e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40883 } }
I20260811 16:37:36.132594 28144 raft_consensus.cc:374] T 52609754993e418db929196b223a86b1 P 23d6ab10333843b9b28ebeca435a509c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:37:36.132634 28144 raft_consensus.cc:729] T 52609754993e418db929196b223a86b1 P 23d6ab10333843b9b28ebeca435a509c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23d6ab10333843b9b28ebeca435a509c, State: Initialized, Role: FOLLOWER
I20260811 16:37:36.132750 28144 consensus_queue.cc:260] T 52609754993e418db929196b223a86b1 P 23d6ab10333843b9b28ebeca435a509c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e78b35a6f034657b418d0f93f0762fa" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 46513 } } peers { permanent_uuid: "23d6ab10333843b9b28ebeca435a509c" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42601 } } peers { permanent_uuid: "bc93071d362845daab3d1592f5fb591e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40883 } }
I20260811 16:37:36.133345 28144 ts_tablet_manager.cc:1428] T 52609754993e418db929196b223a86b1 P 23d6ab10333843b9b28ebeca435a509c: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 16:37:36.133463 28103 heartbeater.cc:503] Master 127.24.175.254:43961 was elected leader, sending a full tablet report...
I20260811 16:37:36.134613 28152 raft_consensus.cc:348] T 52609754993e418db929196b223a86b1 P bc93071d362845daab3d1592f5fb591e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e78b35a6f034657b418d0f93f0762fa" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 46513 } } peers { permanent_uuid: "23d6ab10333843b9b28ebeca435a509c" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42601 } } peers { permanent_uuid: "bc93071d362845daab3d1592f5fb591e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40883 } }
I20260811 16:37:36.134734 28152 raft_consensus.cc:374] T 52609754993e418db929196b223a86b1 P bc93071d362845daab3d1592f5fb591e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:37:36.134756 28152 raft_consensus.cc:729] T 52609754993e418db929196b223a86b1 P bc93071d362845daab3d1592f5fb591e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc93071d362845daab3d1592f5fb591e, State: Initialized, Role: FOLLOWER
I20260811 16:37:36.134843 28152 consensus_queue.cc:260] T 52609754993e418db929196b223a86b1 P bc93071d362845daab3d1592f5fb591e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e78b35a6f034657b418d0f93f0762fa" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 46513 } } peers { permanent_uuid: "23d6ab10333843b9b28ebeca435a509c" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42601 } } peers { permanent_uuid: "bc93071d362845daab3d1592f5fb591e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40883 } }
I20260811 16:37:36.135066 28152 ts_tablet_manager.cc:1428] T 52609754993e418db929196b223a86b1 P bc93071d362845daab3d1592f5fb591e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 16:37:36.135169 27616 heartbeater.cc:503] Master 127.24.175.254:43961 was elected leader, sending a full tablet report...
I20260811 16:37:36.149039 28159 raft_consensus.cc:482] T 52609754993e418db929196b223a86b1 P 23d6ab10333843b9b28ebeca435a509c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:37:36.149144 28159 raft_consensus.cc:504] T 52609754993e418db929196b223a86b1 P 23d6ab10333843b9b28ebeca435a509c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e78b35a6f034657b418d0f93f0762fa" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 46513 } } peers { permanent_uuid: "23d6ab10333843b9b28ebeca435a509c" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42601 } } peers { permanent_uuid: "bc93071d362845daab3d1592f5fb591e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40883 } }
I20260811 16:37:36.149482 28159 leader_election.cc:288] T 52609754993e418db929196b223a86b1 P 23d6ab10333843b9b28ebeca435a509c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e78b35a6f034657b418d0f93f0762fa (127.24.175.194:46513), bc93071d362845daab3d1592f5fb591e (127.24.175.193:40883)
I20260811 16:37:36.152503 27910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:36.149628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.194:46513 (local address 127.24.175.195:50115)
0811 16:37:36.149688 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:36.149702 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:36.149750 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:36.149920 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:36.149922 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:36.149923 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:37:36.149995 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:36.149997 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.150841 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.150842 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:36.151629 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:36.151631 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.152315 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.152316 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:36.152380 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:36.152384 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:37:36.152425 (+ 41us) client_negotiation.cc:240] Negotiation successful
0811 16:37:36.152452 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34,"mutex_wait_us":6}
I20260811 16:37:36.152549 28136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:36.149765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.195:50115 (local address 127.24.175.194:46513)
0811 16:37:36.149805 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:36.149807 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:36.149814 (+ 7us) server_negotiation.cc:407] Connection header received
0811 16:37:36.149838 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:36.149839 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:36.149848 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:36.149905 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:37:36.150075 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.150762 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.151706 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.152256 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.152320 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:36.152328 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:36.152442 (+ 114us) server_negotiation.cc:299] Negotiation successful
0811 16:37:36.152480 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 16:37:36.152851 27765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52609754993e418db929196b223a86b1" candidate_uuid: "23d6ab10333843b9b28ebeca435a509c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e78b35a6f034657b418d0f93f0762fa" is_pre_election: true
I20260811 16:37:36.152946 28141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:36.149810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.195:59609 (local address 127.24.175.193:40883)
0811 16:37:36.149851 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:36.149852 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:36.149907 (+ 55us) server_negotiation.cc:407] Connection header received
0811 16:37:36.149962 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:36.149963 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:36.149973 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:36.150026 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:37:36.150377 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.150975 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.152025 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.152555 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.152598 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:36.152607 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:36.152850 (+ 243us) server_negotiation.cc:299] Negotiation successful
0811 16:37:36.152889 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 16:37:36.152956 28161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:36.149716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.193:40883 (local address 127.24.175.195:59609)
0811 16:37:36.149853 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:36.149861 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:36.149906 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:36.150040 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:36.150041 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:36.150043 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:37:36.150306 (+ 263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:36.150309 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.151043 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.151044 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:36.151932 (+ 888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:36.151935 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.152683 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.152684 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:36.152767 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:36.152771 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:37:36.152841 (+ 70us) client_negotiation.cc:240] Negotiation successful
0811 16:37:36.152878 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":90,"threads_started":1}
I20260811 16:37:36.152980 27765 raft_consensus.cc:2454] T 52609754993e418db929196b223a86b1 P 3e78b35a6f034657b418d0f93f0762fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23d6ab10333843b9b28ebeca435a509c in term 0.
I20260811 16:37:36.153226 27901 leader_election.cc:302] T 52609754993e418db929196b223a86b1 P 23d6ab10333843b9b28ebeca435a509c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23d6ab10333843b9b28ebeca435a509c, 3e78b35a6f034657b418d0f93f0762fa; no voters:
I20260811 16:37:36.153283 27530 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52609754993e418db929196b223a86b1" candidate_uuid: "23d6ab10333843b9b28ebeca435a509c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc93071d362845daab3d1592f5fb591e" is_pre_election: true
I20260811 16:37:36.153352 28159 raft_consensus.cc:2781] T 52609754993e418db929196b223a86b1 P 23d6ab10333843b9b28ebeca435a509c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:37:36.153409 28159 raft_consensus.cc:482] T 52609754993e418db929196b223a86b1 P 23d6ab10333843b9b28ebeca435a509c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:37:36.153437 28159 raft_consensus.cc:3037] T 52609754993e418db929196b223a86b1 P 23d6ab10333843b9b28ebeca435a509c [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:37:36.153419 27530 raft_consensus.cc:2454] T 52609754993e418db929196b223a86b1 P bc93071d362845daab3d1592f5fb591e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23d6ab10333843b9b28ebeca435a509c in term 0.
I20260811 16:37:36.154183 28159 raft_consensus.cc:504] T 52609754993e418db929196b223a86b1 P 23d6ab10333843b9b28ebeca435a509c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e78b35a6f034657b418d0f93f0762fa" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 46513 } } peers { permanent_uuid: "23d6ab10333843b9b28ebeca435a509c" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42601 } } peers { permanent_uuid: "bc93071d362845daab3d1592f5fb591e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40883 } }
I20260811 16:37:36.154314 28159 leader_election.cc:288] T 52609754993e418db929196b223a86b1 P 23d6ab10333843b9b28ebeca435a509c [CANDIDATE]: Term 1 election: Requested vote from peers 3e78b35a6f034657b418d0f93f0762fa (127.24.175.194:46513), bc93071d362845daab3d1592f5fb591e (127.24.175.193:40883)
I20260811 16:37:36.154496 27765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52609754993e418db929196b223a86b1" candidate_uuid: "23d6ab10333843b9b28ebeca435a509c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e78b35a6f034657b418d0f93f0762fa"
I20260811 16:37:36.154577 27765 raft_consensus.cc:3037] T 52609754993e418db929196b223a86b1 P 3e78b35a6f034657b418d0f93f0762fa [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:37:36.154536 27530 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52609754993e418db929196b223a86b1" candidate_uuid: "23d6ab10333843b9b28ebeca435a509c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc93071d362845daab3d1592f5fb591e"
I20260811 16:37:36.154641 27530 raft_consensus.cc:3037] T 52609754993e418db929196b223a86b1 P bc93071d362845daab3d1592f5fb591e [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:37:36.155323 27530 raft_consensus.cc:2454] T 52609754993e418db929196b223a86b1 P bc93071d362845daab3d1592f5fb591e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23d6ab10333843b9b28ebeca435a509c in term 1.
I20260811 16:37:36.155334 27765 raft_consensus.cc:2454] T 52609754993e418db929196b223a86b1 P 3e78b35a6f034657b418d0f93f0762fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23d6ab10333843b9b28ebeca435a509c in term 1.
I20260811 16:37:36.155469 27901 leader_election.cc:302] T 52609754993e418db929196b223a86b1 P 23d6ab10333843b9b28ebeca435a509c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23d6ab10333843b9b28ebeca435a509c, 3e78b35a6f034657b418d0f93f0762fa; no voters:
I20260811 16:37:36.155566 28159 raft_consensus.cc:2781] T 52609754993e418db929196b223a86b1 P 23d6ab10333843b9b28ebeca435a509c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:37:36.155776 28159 raft_consensus.cc:686] T 52609754993e418db929196b223a86b1 P 23d6ab10333843b9b28ebeca435a509c [term 1 LEADER]: Becoming Leader. State: Replica: 23d6ab10333843b9b28ebeca435a509c, State: Running, Role: LEADER
I20260811 16:37:36.155857 28159 consensus_queue.cc:237] T 52609754993e418db929196b223a86b1 P 23d6ab10333843b9b28ebeca435a509c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e78b35a6f034657b418d0f93f0762fa" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 46513 } } peers { permanent_uuid: "23d6ab10333843b9b28ebeca435a509c" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42601 } } peers { permanent_uuid: "bc93071d362845daab3d1592f5fb591e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40883 } }
I20260811 16:37:36.156659 27279 catalog_manager.cc:5495] T 52609754993e418db929196b223a86b1 P 23d6ab10333843b9b28ebeca435a509c reported cstate change: term changed from 0 to 1, leader changed from <none> to 23d6ab10333843b9b28ebeca435a509c (127.24.175.195). New cstate: current_term: 1 leader_uuid: "23d6ab10333843b9b28ebeca435a509c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e78b35a6f034657b418d0f93f0762fa" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 46513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23d6ab10333843b9b28ebeca435a509c" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42601 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc93071d362845daab3d1592f5fb591e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40883 } health_report { overall_health: UNKNOWN } } }
I20260811 16:37:36.165164 28139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:36.163097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49182 (local address 127.24.175.195:42601)
0811 16:37:36.163145 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:36.163147 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:36.163183 (+ 36us) server_negotiation.cc:407] Connection header received
0811 16:37:36.163250 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:36.163251 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:36.163264 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:36.163318 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:37:36.163425 (+ 107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.163863 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.164567 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.164743 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.164780 (+ 37us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:36.164930 (+ 150us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:37:36.165010 (+ 80us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:37:36.165058 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:36.165104 (+ 46us) server_negotiation.cc:299] Negotiation successful
0811 16:37:36.165120 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 16:37:36.167111 27530 raft_consensus.cc:1261] T 52609754993e418db929196b223a86b1 P bc93071d362845daab3d1592f5fb591e [term 1 FOLLOWER]: Refusing update from remote peer 23d6ab10333843b9b28ebeca435a509c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:37:36.167121 27765 raft_consensus.cc:1261] T 52609754993e418db929196b223a86b1 P 3e78b35a6f034657b418d0f93f0762fa [term 1 FOLLOWER]: Refusing update from remote peer 23d6ab10333843b9b28ebeca435a509c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:37:36.167380 28159 consensus_queue.cc:1035] T 52609754993e418db929196b223a86b1 P 23d6ab10333843b9b28ebeca435a509c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc93071d362845daab3d1592f5fb591e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:37:36.167517 28163 consensus_queue.cc:1035] T 52609754993e418db929196b223a86b1 P 23d6ab10333843b9b28ebeca435a509c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e78b35a6f034657b418d0f93f0762fa" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 46513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:37:36.170009 28168 mvcc.cc:205] Tried to move back new op lower bound from 7317365785258422272 to 7317365785215078400. Current Snapshot: MvccSnapshot[applied={T|T < 7317365785258422272}]
I20260811 16:37:36.170507 28174 mvcc.cc:205] Tried to move back new op lower bound from 7317365785258422272 to 7317365785215078400. Current Snapshot: MvccSnapshot[applied={T|T < 7317365785258422272 or (T in {7317365785258422272})}]
I20260811 16:37:36.171008 28171 mvcc.cc:205] Tried to move back new op lower bound from 7317365785258422272 to 7317365785215078400. Current Snapshot: MvccSnapshot[applied={T|T < 7317365785258422272}]
I20260811 16:37:36.173892 27279 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55550:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:37:36.174006 27279 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55550:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:37:36.174826 27279 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 09ee313a70b4468aac60cbec7bd2489e: Sending DeleteTablet for 3 replicas of tablet 52609754993e418db929196b223a86b1
I20260811 16:37:36.175232 27732 tablet_service.cc:1514] Processing DeleteTablet for tablet 52609754993e418db929196b223a86b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:37:36 UTC) from {username='kudu', principal='kudu/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:39454
I20260811 16:37:36.175246 27499 tablet_service.cc:1514] Processing DeleteTablet for tablet 52609754993e418db929196b223a86b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:37:36 UTC) from {username='kudu', principal='kudu/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:44640
I20260811 16:37:36.175302 27976 tablet_service.cc:1514] Processing DeleteTablet for tablet 52609754993e418db929196b223a86b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:37:36 UTC) from {username='kudu', principal='kudu/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:49176
I20260811 16:37:36.175493 28191 tablet_replica.cc:330] T 52609754993e418db929196b223a86b1 P 3e78b35a6f034657b418d0f93f0762fa: stopping tablet replica
I20260811 16:37:36.175591 28191 raft_consensus.cc:2229] T 52609754993e418db929196b223a86b1 P 3e78b35a6f034657b418d0f93f0762fa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:37:36.175585 28193 tablet_replica.cc:330] T 52609754993e418db929196b223a86b1 P 23d6ab10333843b9b28ebeca435a509c: stopping tablet replica
I20260811 16:37:36.175679 28193 raft_consensus.cc:2229] T 52609754993e418db929196b223a86b1 P 23d6ab10333843b9b28ebeca435a509c [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:37:36.175801 28193 raft_consensus.cc:2258] T 52609754993e418db929196b223a86b1 P 23d6ab10333843b9b28ebeca435a509c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:37:36.175921 27279 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55550:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 16:37:36.176002 28191 raft_consensus.cc:2258] T 52609754993e418db929196b223a86b1 P 3e78b35a6f034657b418d0f93f0762fa [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 16:37:36.176072 27279 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:37:36.176188 28192 tablet_replica.cc:330] T 52609754993e418db929196b223a86b1 P bc93071d362845daab3d1592f5fb591e: stopping tablet replica
I20260811 16:37:36.176272 28192 raft_consensus.cc:2229] T 52609754993e418db929196b223a86b1 P bc93071d362845daab3d1592f5fb591e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:37:36.176683 28192 raft_consensus.cc:2258] T 52609754993e418db929196b223a86b1 P bc93071d362845daab3d1592f5fb591e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:37:36.177196 28192 ts_tablet_manager.cc:1905] T 52609754993e418db929196b223a86b1 P bc93071d362845daab3d1592f5fb591e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:37:36.177452 27499 tablet_service.cc:1467] Processing CreateTablet for tablet 13355f4ecfa74ebcb945b98b54adc400 (DEFAULT_TABLE table=test-table [id=cbe66d7a40bc4f79b498c754c34cec66]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:37:36.177577 27499 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13355f4ecfa74ebcb945b98b54adc400. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:37:36.177713 28191 ts_tablet_manager.cc:1905] T 52609754993e418db929196b223a86b1 P 3e78b35a6f034657b418d0f93f0762fa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:37:36.178267 27732 tablet_service.cc:1467] Processing CreateTablet for tablet 13355f4ecfa74ebcb945b98b54adc400 (DEFAULT_TABLE table=test-table [id=cbe66d7a40bc4f79b498c754c34cec66]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:37:36.178376 27732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13355f4ecfa74ebcb945b98b54adc400. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:37:36.178892 28193 ts_tablet_manager.cc:1905] T 52609754993e418db929196b223a86b1 P 23d6ab10333843b9b28ebeca435a509c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:37:36.179365 28192 ts_tablet_manager.cc:1918] T 52609754993e418db929196b223a86b1 P bc93071d362845daab3d1592f5fb591e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:37:36.179427 28192 log.cc:1196] T 52609754993e418db929196b223a86b1 P bc93071d362845daab3d1592f5fb591e: Deleting WAL directory at /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/ts-0/wal/wals/52609754993e418db929196b223a86b1
I20260811 16:37:36.179636 28143 tablet_bootstrap.cc:492] T 13355f4ecfa74ebcb945b98b54adc400 P 3e78b35a6f034657b418d0f93f0762fa: Bootstrap starting.
I20260811 16:37:36.179672 28192 ts_tablet_manager.cc:1939] T 52609754993e418db929196b223a86b1 P bc93071d362845daab3d1592f5fb591e: Deleting consensus metadata
I20260811 16:37:36.180035 28143 tablet_bootstrap.cc:654] T 13355f4ecfa74ebcb945b98b54adc400 P 3e78b35a6f034657b418d0f93f0762fa: Neither blocks nor log segments found. Creating new log.
I20260811 16:37:36.180090 27976 tablet_service.cc:1467] Processing CreateTablet for tablet 13355f4ecfa74ebcb945b98b54adc400 (DEFAULT_TABLE table=test-table [id=cbe66d7a40bc4f79b498c754c34cec66]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:37:36.180063 27252 catalog_manager.cc:4841] TS bc93071d362845daab3d1592f5fb591e (127.24.175.193:40883): tablet 52609754993e418db929196b223a86b1 (table test-table [id=2eed76d6e32e49d98562432925b33e28]) successfully deleted
I20260811 16:37:36.180207 27976 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13355f4ecfa74ebcb945b98b54adc400. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:37:36.180651 28143 tablet_bootstrap.cc:492] T 13355f4ecfa74ebcb945b98b54adc400 P 3e78b35a6f034657b418d0f93f0762fa: No bootstrap required, opened a new log
I20260811 16:37:36.180701 28143 ts_tablet_manager.cc:1397] T 13355f4ecfa74ebcb945b98b54adc400 P 3e78b35a6f034657b418d0f93f0762fa: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 16:37:36.180853 28143 raft_consensus.cc:348] T 13355f4ecfa74ebcb945b98b54adc400 P 3e78b35a6f034657b418d0f93f0762fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc93071d362845daab3d1592f5fb591e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40883 } } peers { permanent_uuid: "3e78b35a6f034657b418d0f93f0762fa" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 46513 } } peers { permanent_uuid: "23d6ab10333843b9b28ebeca435a509c" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42601 } }
I20260811 16:37:36.180915 28143 raft_consensus.cc:374] T 13355f4ecfa74ebcb945b98b54adc400 P 3e78b35a6f034657b418d0f93f0762fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:37:36.180934 28143 raft_consensus.cc:729] T 13355f4ecfa74ebcb945b98b54adc400 P 3e78b35a6f034657b418d0f93f0762fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e78b35a6f034657b418d0f93f0762fa, State: Initialized, Role: FOLLOWER
I20260811 16:37:36.180981 28143 consensus_queue.cc:260] T 13355f4ecfa74ebcb945b98b54adc400 P 3e78b35a6f034657b418d0f93f0762fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc93071d362845daab3d1592f5fb591e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40883 } } peers { permanent_uuid: "3e78b35a6f034657b418d0f93f0762fa" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 46513 } } peers { permanent_uuid: "23d6ab10333843b9b28ebeca435a509c" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42601 } }
I20260811 16:37:36.181051 28152 tablet_bootstrap.cc:492] T 13355f4ecfa74ebcb945b98b54adc400 P bc93071d362845daab3d1592f5fb591e: Bootstrap starting.
I20260811 16:37:36.181082 28143 ts_tablet_manager.cc:1428] T 13355f4ecfa74ebcb945b98b54adc400 P 3e78b35a6f034657b418d0f93f0762fa: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:36.181461 28152 tablet_bootstrap.cc:654] T 13355f4ecfa74ebcb945b98b54adc400 P bc93071d362845daab3d1592f5fb591e: Neither blocks nor log segments found. Creating new log.
I20260811 16:37:36.181507 28193 ts_tablet_manager.cc:1918] T 52609754993e418db929196b223a86b1 P 23d6ab10333843b9b28ebeca435a509c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:37:36.181582 28193 log.cc:1196] T 52609754993e418db929196b223a86b1 P 23d6ab10333843b9b28ebeca435a509c: Deleting WAL directory at /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/ts-2/wal/wals/52609754993e418db929196b223a86b1
I20260811 16:37:36.181838 28193 ts_tablet_manager.cc:1939] T 52609754993e418db929196b223a86b1 P 23d6ab10333843b9b28ebeca435a509c: Deleting consensus metadata
I20260811 16:37:36.182194 28152 tablet_bootstrap.cc:492] T 13355f4ecfa74ebcb945b98b54adc400 P bc93071d362845daab3d1592f5fb591e: No bootstrap required, opened a new log
I20260811 16:37:36.182245 28152 ts_tablet_manager.cc:1397] T 13355f4ecfa74ebcb945b98b54adc400 P bc93071d362845daab3d1592f5fb591e: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 16:37:36.182343 28144 tablet_bootstrap.cc:492] T 13355f4ecfa74ebcb945b98b54adc400 P 23d6ab10333843b9b28ebeca435a509c: Bootstrap starting.
I20260811 16:37:36.182374 27252 catalog_manager.cc:4841] TS 23d6ab10333843b9b28ebeca435a509c (127.24.175.195:42601): tablet 52609754993e418db929196b223a86b1 (table test-table [id=2eed76d6e32e49d98562432925b33e28]) successfully deleted
I20260811 16:37:36.182382 28152 raft_consensus.cc:348] T 13355f4ecfa74ebcb945b98b54adc400 P bc93071d362845daab3d1592f5fb591e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc93071d362845daab3d1592f5fb591e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40883 } } peers { permanent_uuid: "3e78b35a6f034657b418d0f93f0762fa" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 46513 } } peers { permanent_uuid: "23d6ab10333843b9b28ebeca435a509c" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42601 } }
I20260811 16:37:36.182446 28152 raft_consensus.cc:374] T 13355f4ecfa74ebcb945b98b54adc400 P bc93071d362845daab3d1592f5fb591e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:37:36.182466 28152 raft_consensus.cc:729] T 13355f4ecfa74ebcb945b98b54adc400 P bc93071d362845daab3d1592f5fb591e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc93071d362845daab3d1592f5fb591e, State: Initialized, Role: FOLLOWER
I20260811 16:37:36.182508 28152 consensus_queue.cc:260] T 13355f4ecfa74ebcb945b98b54adc400 P bc93071d362845daab3d1592f5fb591e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc93071d362845daab3d1592f5fb591e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40883 } } peers { permanent_uuid: "3e78b35a6f034657b418d0f93f0762fa" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 46513 } } peers { permanent_uuid: "23d6ab10333843b9b28ebeca435a509c" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42601 } }
I20260811 16:37:36.182586 28152 ts_tablet_manager.cc:1428] T 13355f4ecfa74ebcb945b98b54adc400 P bc93071d362845daab3d1592f5fb591e: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:36.182708 28144 tablet_bootstrap.cc:654] T 13355f4ecfa74ebcb945b98b54adc400 P 23d6ab10333843b9b28ebeca435a509c: Neither blocks nor log segments found. Creating new log.
I20260811 16:37:36.182971 28191 ts_tablet_manager.cc:1918] T 52609754993e418db929196b223a86b1 P 3e78b35a6f034657b418d0f93f0762fa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:37:36.183032 28191 log.cc:1196] T 52609754993e418db929196b223a86b1 P 3e78b35a6f034657b418d0f93f0762fa: Deleting WAL directory at /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/ts-1/wal/wals/52609754993e418db929196b223a86b1
I20260811 16:37:36.183264 28191 ts_tablet_manager.cc:1939] T 52609754993e418db929196b223a86b1 P 3e78b35a6f034657b418d0f93f0762fa: Deleting consensus metadata
I20260811 16:37:36.183681 27252 catalog_manager.cc:4841] TS 3e78b35a6f034657b418d0f93f0762fa (127.24.175.194:46513): tablet 52609754993e418db929196b223a86b1 (table test-table [id=2eed76d6e32e49d98562432925b33e28]) successfully deleted
W20260811 16:37:36.184836 27857 tablet.cc:2369] T 13355f4ecfa74ebcb945b98b54adc400 P 3e78b35a6f034657b418d0f93f0762fa: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:37:36.186494 28144 tablet_bootstrap.cc:492] T 13355f4ecfa74ebcb945b98b54adc400 P 23d6ab10333843b9b28ebeca435a509c: No bootstrap required, opened a new log
I20260811 16:37:36.186537 28144 ts_tablet_manager.cc:1397] T 13355f4ecfa74ebcb945b98b54adc400 P 23d6ab10333843b9b28ebeca435a509c: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260811 16:37:36.186722 28144 raft_consensus.cc:348] T 13355f4ecfa74ebcb945b98b54adc400 P 23d6ab10333843b9b28ebeca435a509c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc93071d362845daab3d1592f5fb591e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40883 } } peers { permanent_uuid: "3e78b35a6f034657b418d0f93f0762fa" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 46513 } } peers { permanent_uuid: "23d6ab10333843b9b28ebeca435a509c" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42601 } }
I20260811 16:37:36.186777 28144 raft_consensus.cc:374] T 13355f4ecfa74ebcb945b98b54adc400 P 23d6ab10333843b9b28ebeca435a509c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:37:36.186795 28144 raft_consensus.cc:729] T 13355f4ecfa74ebcb945b98b54adc400 P 23d6ab10333843b9b28ebeca435a509c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23d6ab10333843b9b28ebeca435a509c, State: Initialized, Role: FOLLOWER
I20260811 16:37:36.186833 28144 consensus_queue.cc:260] T 13355f4ecfa74ebcb945b98b54adc400 P 23d6ab10333843b9b28ebeca435a509c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc93071d362845daab3d1592f5fb591e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40883 } } peers { permanent_uuid: "3e78b35a6f034657b418d0f93f0762fa" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 46513 } } peers { permanent_uuid: "23d6ab10333843b9b28ebeca435a509c" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42601 } }
I20260811 16:37:36.186916 28144 ts_tablet_manager.cc:1428] T 13355f4ecfa74ebcb945b98b54adc400 P 23d6ab10333843b9b28ebeca435a509c: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
W20260811 16:37:36.277123 27617 tablet.cc:2369] T 13355f4ecfa74ebcb945b98b54adc400 P bc93071d362845daab3d1592f5fb591e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 16:37:36.337064 28105 tablet.cc:2369] T 13355f4ecfa74ebcb945b98b54adc400 P 23d6ab10333843b9b28ebeca435a509c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:37:36.387241 28160 raft_consensus.cc:482] T 13355f4ecfa74ebcb945b98b54adc400 P bc93071d362845daab3d1592f5fb591e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:37:36.387347 28160 raft_consensus.cc:504] T 13355f4ecfa74ebcb945b98b54adc400 P bc93071d362845daab3d1592f5fb591e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc93071d362845daab3d1592f5fb591e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40883 } } peers { permanent_uuid: "3e78b35a6f034657b418d0f93f0762fa" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 46513 } } peers { permanent_uuid: "23d6ab10333843b9b28ebeca435a509c" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42601 } }
I20260811 16:37:36.387681 28160 leader_election.cc:288] T 13355f4ecfa74ebcb945b98b54adc400 P bc93071d362845daab3d1592f5fb591e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e78b35a6f034657b418d0f93f0762fa (127.24.175.194:46513), 23d6ab10333843b9b28ebeca435a509c (127.24.175.195:42601)
I20260811 16:37:36.391585 28139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:36.388082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:35339 (local address 127.24.175.195:42601)
0811 16:37:36.388138 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:36.388140 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:36.388153 (+ 13us) server_negotiation.cc:407] Connection header received
0811 16:37:36.388240 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:36.388241 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:36.388252 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:36.388298 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:37:36.388410 (+ 112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.389156 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.390684 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.391244 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.391307 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:36.391317 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:36.391478 (+ 161us) server_negotiation.cc:299] Negotiation successful
0811 16:37:36.391512 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 16:37:36.391585 28136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:36.387920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:40485 (local address 127.24.175.194:46513)
0811 16:37:36.387976 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:36.387978 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:36.388038 (+ 60us) server_negotiation.cc:407] Connection header received
0811 16:37:36.388186 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:36.388187 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:36.388198 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:36.388256 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:37:36.388410 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.389158 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.390684 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.391231 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.391307 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:36.391317 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:36.391479 (+ 162us) server_negotiation.cc:299] Negotiation successful
0811 16:37:36.391512 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 16:37:36.391611 28198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:36.387842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.194:46513 (local address 127.24.175.193:40485)
0811 16:37:36.387955 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:36.387969 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:36.388071 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:36.388266 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:36.388267 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:36.388268 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:37:36.388350 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:36.388351 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.389229 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.389230 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:36.390606 (+ 1376us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:36.390609 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.391317 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.391317 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:36.391398 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:36.391405 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 16:37:36.391457 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 16:37:36.391501 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":92,"mutex_wait_us":33,"thread_start_us":63,"threads_started":1}
I20260811 16:37:36.391625 28200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:36.388009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.195:42601 (local address 127.24.175.193:35339)
0811 16:37:36.388101 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:36.388111 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:36.388164 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:36.388304 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:36.388304 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:36.388305 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:37:36.388348 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:36.388351 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.389228 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.389230 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:36.390618 (+ 1388us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:36.390619 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.391316 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.391317 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:36.391398 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:36.391406 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 16:37:36.391457 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 16:37:36.391501 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":80,"mutex_wait_us":75,"thread_start_us":35,"threads_started":1}
I20260811 16:37:36.391897 28032 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13355f4ecfa74ebcb945b98b54adc400" candidate_uuid: "bc93071d362845daab3d1592f5fb591e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23d6ab10333843b9b28ebeca435a509c" is_pre_election: true
I20260811 16:37:36.392020 28032 raft_consensus.cc:2454] T 13355f4ecfa74ebcb945b98b54adc400 P 23d6ab10333843b9b28ebeca435a509c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc93071d362845daab3d1592f5fb591e in term 0.
I20260811 16:37:36.392086 27765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13355f4ecfa74ebcb945b98b54adc400" candidate_uuid: "bc93071d362845daab3d1592f5fb591e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e78b35a6f034657b418d0f93f0762fa" is_pre_election: true
I20260811 16:37:36.392179 27765 raft_consensus.cc:2454] T 13355f4ecfa74ebcb945b98b54adc400 P 3e78b35a6f034657b418d0f93f0762fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc93071d362845daab3d1592f5fb591e in term 0.
I20260811 16:37:36.392216 27432 leader_election.cc:302] T 13355f4ecfa74ebcb945b98b54adc400 P bc93071d362845daab3d1592f5fb591e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23d6ab10333843b9b28ebeca435a509c, bc93071d362845daab3d1592f5fb591e; no voters:
I20260811 16:37:36.392333 28160 raft_consensus.cc:2781] T 13355f4ecfa74ebcb945b98b54adc400 P bc93071d362845daab3d1592f5fb591e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:37:36.392382 28160 raft_consensus.cc:482] T 13355f4ecfa74ebcb945b98b54adc400 P bc93071d362845daab3d1592f5fb591e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:37:36.392403 28160 raft_consensus.cc:3037] T 13355f4ecfa74ebcb945b98b54adc400 P bc93071d362845daab3d1592f5fb591e [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:37:36.393067 28160 raft_consensus.cc:504] T 13355f4ecfa74ebcb945b98b54adc400 P bc93071d362845daab3d1592f5fb591e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc93071d362845daab3d1592f5fb591e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40883 } } peers { permanent_uuid: "3e78b35a6f034657b418d0f93f0762fa" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 46513 } } peers { permanent_uuid: "23d6ab10333843b9b28ebeca435a509c" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42601 } }
I20260811 16:37:36.393184 28160 leader_election.cc:288] T 13355f4ecfa74ebcb945b98b54adc400 P bc93071d362845daab3d1592f5fb591e [CANDIDATE]: Term 1 election: Requested vote from peers 3e78b35a6f034657b418d0f93f0762fa (127.24.175.194:46513), 23d6ab10333843b9b28ebeca435a509c (127.24.175.195:42601)
I20260811 16:37:36.393347 27765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13355f4ecfa74ebcb945b98b54adc400" candidate_uuid: "bc93071d362845daab3d1592f5fb591e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e78b35a6f034657b418d0f93f0762fa"
I20260811 16:37:36.393369 28032 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13355f4ecfa74ebcb945b98b54adc400" candidate_uuid: "bc93071d362845daab3d1592f5fb591e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23d6ab10333843b9b28ebeca435a509c"
I20260811 16:37:36.393417 27765 raft_consensus.cc:3037] T 13355f4ecfa74ebcb945b98b54adc400 P 3e78b35a6f034657b418d0f93f0762fa [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:37:36.393433 28032 raft_consensus.cc:3037] T 13355f4ecfa74ebcb945b98b54adc400 P 23d6ab10333843b9b28ebeca435a509c [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:37:36.393997 27765 raft_consensus.cc:2454] T 13355f4ecfa74ebcb945b98b54adc400 P 3e78b35a6f034657b418d0f93f0762fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc93071d362845daab3d1592f5fb591e in term 1.
I20260811 16:37:36.394093 28032 raft_consensus.cc:2454] T 13355f4ecfa74ebcb945b98b54adc400 P 23d6ab10333843b9b28ebeca435a509c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc93071d362845daab3d1592f5fb591e in term 1.
I20260811 16:37:36.394182 27432 leader_election.cc:302] T 13355f4ecfa74ebcb945b98b54adc400 P bc93071d362845daab3d1592f5fb591e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e78b35a6f034657b418d0f93f0762fa, bc93071d362845daab3d1592f5fb591e; no voters:
I20260811 16:37:36.394274 28160 raft_consensus.cc:2781] T 13355f4ecfa74ebcb945b98b54adc400 P bc93071d362845daab3d1592f5fb591e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:37:36.394387 28160 raft_consensus.cc:686] T 13355f4ecfa74ebcb945b98b54adc400 P bc93071d362845daab3d1592f5fb591e [term 1 LEADER]: Becoming Leader. State: Replica: bc93071d362845daab3d1592f5fb591e, State: Running, Role: LEADER
I20260811 16:37:36.394455 28160 consensus_queue.cc:237] T 13355f4ecfa74ebcb945b98b54adc400 P bc93071d362845daab3d1592f5fb591e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc93071d362845daab3d1592f5fb591e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40883 } } peers { permanent_uuid: "3e78b35a6f034657b418d0f93f0762fa" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 46513 } } peers { permanent_uuid: "23d6ab10333843b9b28ebeca435a509c" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42601 } }
I20260811 16:37:36.395088 27279 catalog_manager.cc:5495] T 13355f4ecfa74ebcb945b98b54adc400 P bc93071d362845daab3d1592f5fb591e reported cstate change: term changed from 0 to 1, leader changed from <none> to bc93071d362845daab3d1592f5fb591e (127.24.175.193). New cstate: current_term: 1 leader_uuid: "bc93071d362845daab3d1592f5fb591e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc93071d362845daab3d1592f5fb591e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e78b35a6f034657b418d0f93f0762fa" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 46513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23d6ab10333843b9b28ebeca435a509c" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42601 } health_report { overall_health: UNKNOWN } } }
Aug 11 16:37:36 dist-test-slave-zj8q krb5kdc[27194](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466255, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.254@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:37:36.428893 28209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:36.422820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:43961 (local address 127.0.0.1:55560)
0811 16:37:36.422944 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:36.422954 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:36.423011 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:36.423119 (+ 108us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:36.423119 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:36.423404 (+ 285us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:37:36.423450 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:36.423451 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.424027 (+ 576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.424028 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:36.424577 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:36.424578 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.424846 (+ 268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.424846 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:36.424882 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:36.425310 (+ 428us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:37:36.425314 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:37:36.426732 (+ 1418us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:37:36.427942 (+ 1210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:36.427949 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:36.427952 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:36.428144 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:36.428302 (+ 158us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:36.428303 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:36.428303 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:36.428357 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:36.428566 (+ 209us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:37:36.428583 (+ 17us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:37:36.428631 (+ 48us) client_negotiation.cc:769] Sending connection context
0811 16:37:36.428697 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 16:37:36.428795 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":76,"threads_started":1}
I20260811 16:37:36.428936 27352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:36.422851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55560 (local address 127.24.175.254:43961)
0811 16:37:36.422902 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:36.422905 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:36.423005 (+ 100us) server_negotiation.cc:407] Connection header received
0811 16:37:36.423058 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:36.423058 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:36.423067 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:36.423108 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:36.423498 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.423966 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.424629 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.424796 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.424838 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:36.426805 (+ 1967us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:36.426807 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:36.426807 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:37:36.426813 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:36.427871 (+ 1058us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:36.428200 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:36.428201 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:36.428201 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:36.428255 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:36.428400 (+ 145us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:36.428401 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:36.428401 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:36.428490 (+ 89us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:36.428534 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:36.428716 (+ 182us) server_negotiation.cc:299] Negotiation successful
0811 16:37:36.428837 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":60,"server-negotiator.queue_time_us":27}
I20260811 16:37:36.432161 27279 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:55560:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 16:37:36.432471 27279 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:37:36.433849 27732 tablet_service.cc:1467] Processing CreateTablet for tablet df535933c79b492c9c51c74d098a7cc8 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=73d36027d7f74c789e4fe48323e4e9b0]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 16:37:36.434039 27732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df535933c79b492c9c51c74d098a7cc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:37:36.433842 27499 tablet_service.cc:1467] Processing CreateTablet for tablet df535933c79b492c9c51c74d098a7cc8 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=73d36027d7f74c789e4fe48323e4e9b0]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 16:37:36.435839 28143 tablet_bootstrap.cc:492] T df535933c79b492c9c51c74d098a7cc8 P 3e78b35a6f034657b418d0f93f0762fa: Bootstrap starting.
I20260811 16:37:36.435894 27499 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df535933c79b492c9c51c74d098a7cc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:37:36.436254 28143 tablet_bootstrap.cc:654] T df535933c79b492c9c51c74d098a7cc8 P 3e78b35a6f034657b418d0f93f0762fa: Neither blocks nor log segments found. Creating new log.
I20260811 16:37:36.436653 27976 tablet_service.cc:1467] Processing CreateTablet for tablet df535933c79b492c9c51c74d098a7cc8 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=73d36027d7f74c789e4fe48323e4e9b0]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 16:37:36.436787 27976 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df535933c79b492c9c51c74d098a7cc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:37:36.437161 28152 tablet_bootstrap.cc:492] T df535933c79b492c9c51c74d098a7cc8 P bc93071d362845daab3d1592f5fb591e: Bootstrap starting.
I20260811 16:37:36.437319 28143 tablet_bootstrap.cc:492] T df535933c79b492c9c51c74d098a7cc8 P 3e78b35a6f034657b418d0f93f0762fa: No bootstrap required, opened a new log
I20260811 16:37:36.437357 28143 ts_tablet_manager.cc:1397] T df535933c79b492c9c51c74d098a7cc8 P 3e78b35a6f034657b418d0f93f0762fa: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 16:37:36.437472 28143 raft_consensus.cc:348] T df535933c79b492c9c51c74d098a7cc8 P 3e78b35a6f034657b418d0f93f0762fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc93071d362845daab3d1592f5fb591e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40883 } } peers { permanent_uuid: "3e78b35a6f034657b418d0f93f0762fa" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 46513 } } peers { permanent_uuid: "23d6ab10333843b9b28ebeca435a509c" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42601 } }
I20260811 16:37:36.437520 28143 raft_consensus.cc:374] T df535933c79b492c9c51c74d098a7cc8 P 3e78b35a6f034657b418d0f93f0762fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:37:36.437532 28143 raft_consensus.cc:729] T df535933c79b492c9c51c74d098a7cc8 P 3e78b35a6f034657b418d0f93f0762fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e78b35a6f034657b418d0f93f0762fa, State: Initialized, Role: FOLLOWER
I20260811 16:37:36.437568 28143 consensus_queue.cc:260] T df535933c79b492c9c51c74d098a7cc8 P 3e78b35a6f034657b418d0f93f0762fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc93071d362845daab3d1592f5fb591e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40883 } } peers { permanent_uuid: "3e78b35a6f034657b418d0f93f0762fa" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 46513 } } peers { permanent_uuid: "23d6ab10333843b9b28ebeca435a509c" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42601 } }
I20260811 16:37:36.437589 28152 tablet_bootstrap.cc:654] T df535933c79b492c9c51c74d098a7cc8 P bc93071d362845daab3d1592f5fb591e: Neither blocks nor log segments found. Creating new log.
I20260811 16:37:36.437652 28143 ts_tablet_manager.cc:1428] T df535933c79b492c9c51c74d098a7cc8 P 3e78b35a6f034657b418d0f93f0762fa: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:36.437693 28155 tablet_replica.cc:439] T df535933c79b492c9c51c74d098a7cc8 P 3e78b35a6f034657b418d0f93f0762fa: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc93071d362845daab3d1592f5fb591e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40883 } } peers { permanent_uuid: "3e78b35a6f034657b418d0f93f0762fa" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 46513 } } peers { permanent_uuid: "23d6ab10333843b9b28ebeca435a509c" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42601 } } }
I20260811 16:37:36.437763 28155 tablet_replica.cc:442] T df535933c79b492c9c51c74d098a7cc8 P 3e78b35a6f034657b418d0f93f0762fa: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 16:37:36.438212 28144 tablet_bootstrap.cc:492] T df535933c79b492c9c51c74d098a7cc8 P 23d6ab10333843b9b28ebeca435a509c: Bootstrap starting.
I20260811 16:37:36.438505 28144 tablet_bootstrap.cc:654] T df535933c79b492c9c51c74d098a7cc8 P 23d6ab10333843b9b28ebeca435a509c: Neither blocks nor log segments found. Creating new log.
I20260811 16:37:36.438841 28152 tablet_bootstrap.cc:492] T df535933c79b492c9c51c74d098a7cc8 P bc93071d362845daab3d1592f5fb591e: No bootstrap required, opened a new log
I20260811 16:37:36.438887 28152 ts_tablet_manager.cc:1397] T df535933c79b492c9c51c74d098a7cc8 P bc93071d362845daab3d1592f5fb591e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 16:37:36.439018 28144 tablet_bootstrap.cc:492] T df535933c79b492c9c51c74d098a7cc8 P 23d6ab10333843b9b28ebeca435a509c: No bootstrap required, opened a new log
I20260811 16:37:36.439020 28152 raft_consensus.cc:348] T df535933c79b492c9c51c74d098a7cc8 P bc93071d362845daab3d1592f5fb591e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc93071d362845daab3d1592f5fb591e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40883 } } peers { permanent_uuid: "3e78b35a6f034657b418d0f93f0762fa" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 46513 } } peers { permanent_uuid: "23d6ab10333843b9b28ebeca435a509c" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42601 } }
I20260811 16:37:36.439064 28144 ts_tablet_manager.cc:1397] T df535933c79b492c9c51c74d098a7cc8 P 23d6ab10333843b9b28ebeca435a509c: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260811 16:37:36.439074 28152 raft_consensus.cc:374] T df535933c79b492c9c51c74d098a7cc8 P bc93071d362845daab3d1592f5fb591e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:37:36.439095 28152 raft_consensus.cc:729] T df535933c79b492c9c51c74d098a7cc8 P bc93071d362845daab3d1592f5fb591e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc93071d362845daab3d1592f5fb591e, State: Initialized, Role: FOLLOWER
I20260811 16:37:36.439143 28152 consensus_queue.cc:260] T df535933c79b492c9c51c74d098a7cc8 P bc93071d362845daab3d1592f5fb591e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc93071d362845daab3d1592f5fb591e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40883 } } peers { permanent_uuid: "3e78b35a6f034657b418d0f93f0762fa" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 46513 } } peers { permanent_uuid: "23d6ab10333843b9b28ebeca435a509c" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42601 } }
I20260811 16:37:36.439164 28144 raft_consensus.cc:348] T df535933c79b492c9c51c74d098a7cc8 P 23d6ab10333843b9b28ebeca435a509c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc93071d362845daab3d1592f5fb591e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40883 } } peers { permanent_uuid: "3e78b35a6f034657b418d0f93f0762fa" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 46513 } } peers { permanent_uuid: "23d6ab10333843b9b28ebeca435a509c" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42601 } }
I20260811 16:37:36.439232 28152 ts_tablet_manager.cc:1428] T df535933c79b492c9c51c74d098a7cc8 P bc93071d362845daab3d1592f5fb591e: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:36.439244 28144 raft_consensus.cc:374] T df535933c79b492c9c51c74d098a7cc8 P 23d6ab10333843b9b28ebeca435a509c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:37:36.439273 28144 raft_consensus.cc:729] T df535933c79b492c9c51c74d098a7cc8 P 23d6ab10333843b9b28ebeca435a509c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23d6ab10333843b9b28ebeca435a509c, State: Initialized, Role: FOLLOWER
I20260811 16:37:36.439316 28144 consensus_queue.cc:260] T df535933c79b492c9c51c74d098a7cc8 P 23d6ab10333843b9b28ebeca435a509c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc93071d362845daab3d1592f5fb591e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40883 } } peers { permanent_uuid: "3e78b35a6f034657b418d0f93f0762fa" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 46513 } } peers { permanent_uuid: "23d6ab10333843b9b28ebeca435a509c" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42601 } }
I20260811 16:37:36.439337 28160 tablet_replica.cc:439] T df535933c79b492c9c51c74d098a7cc8 P bc93071d362845daab3d1592f5fb591e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc93071d362845daab3d1592f5fb591e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40883 } } peers { permanent_uuid: "3e78b35a6f034657b418d0f93f0762fa" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 46513 } } peers { permanent_uuid: "23d6ab10333843b9b28ebeca435a509c" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42601 } } }
I20260811 16:37:36.439400 28144 ts_tablet_manager.cc:1428] T df535933c79b492c9c51c74d098a7cc8 P 23d6ab10333843b9b28ebeca435a509c: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 16:37:36.439404 28160 tablet_replica.cc:442] T df535933c79b492c9c51c74d098a7cc8 P bc93071d362845daab3d1592f5fb591e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 16:37:36.439486 28163 tablet_replica.cc:439] T df535933c79b492c9c51c74d098a7cc8 P 23d6ab10333843b9b28ebeca435a509c: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc93071d362845daab3d1592f5fb591e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40883 } } peers { permanent_uuid: "3e78b35a6f034657b418d0f93f0762fa" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 46513 } } peers { permanent_uuid: "23d6ab10333843b9b28ebeca435a509c" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42601 } } }
I20260811 16:37:36.439574 28163 tablet_replica.cc:442] T df535933c79b492c9c51c74d098a7cc8 P 23d6ab10333843b9b28ebeca435a509c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 16:37:36.698240 28155 raft_consensus.cc:482] T df535933c79b492c9c51c74d098a7cc8 P 3e78b35a6f034657b418d0f93f0762fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:37:36.698333 28155 raft_consensus.cc:504] T df535933c79b492c9c51c74d098a7cc8 P 3e78b35a6f034657b418d0f93f0762fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc93071d362845daab3d1592f5fb591e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40883 } } peers { permanent_uuid: "3e78b35a6f034657b418d0f93f0762fa" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 46513 } } peers { permanent_uuid: "23d6ab10333843b9b28ebeca435a509c" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42601 } }
I20260811 16:37:36.698670 28155 leader_election.cc:288] T df535933c79b492c9c51c74d098a7cc8 P 3e78b35a6f034657b418d0f93f0762fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc93071d362845daab3d1592f5fb591e (127.24.175.193:40883), 23d6ab10333843b9b28ebeca435a509c (127.24.175.195:42601)
I20260811 16:37:36.701440 28139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:36.699095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:49333 (local address 127.24.175.195:42601)
0811 16:37:36.699161 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:36.699163 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:36.699170 (+ 7us) server_negotiation.cc:407] Connection header received
0811 16:37:36.699195 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:36.699196 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:36.699202 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:36.699266 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:37:36.699395 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.699870 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.700772 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.701145 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.701212 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:36.701221 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:36.701340 (+ 119us) server_negotiation.cc:299] Negotiation successful
0811 16:37:36.701376 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 16:37:36.701488 28219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:36.698907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:60393 (local address 127.24.175.193:40883)
0811 16:37:36.699014 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:36.699016 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:36.699028 (+ 12us) server_negotiation.cc:407] Connection header received
0811 16:37:36.699068 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:36.699069 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:36.699081 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:36.699167 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:37:36.699323 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.699815 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.700783 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.701172 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.701237 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:36.701245 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:36.701377 (+ 132us) server_negotiation.cc:299] Negotiation successful
0811 16:37:36.701415 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86,"thread_start_us":56,"threads_started":1}
I20260811 16:37:36.701498 28221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:36.698989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.195:42601 (local address 127.24.175.194:49333)
0811 16:37:36.699079 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:36.699087 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:36.699121 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:36.699271 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:36.699272 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:36.699274 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:37:36.699341 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:36.699342 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.699939 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.699940 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:36.700693 (+ 753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:36.700695 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.701212 (+ 517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.701213 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:36.701281 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:36.701284 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:37:36.701330 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 16:37:36.701369 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":80,"thread_start_us":36,"threads_started":1}
I20260811 16:37:36.701613 28218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:36.698837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.193:40883 (local address 127.24.175.194:60393)
0811 16:37:36.698945 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:36.698956 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:36.699016 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:36.699173 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:36.699175 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:36.699178 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:37:36.699258 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:36.699260 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.699885 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.699886 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:36.700695 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:36.700697 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.701244 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.701245 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:36.701318 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:36.701321 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:37:36.701367 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 16:37:36.701409 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":89,"thread_start_us":49,"threads_started":1}
I20260811 16:37:36.701717 28032 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df535933c79b492c9c51c74d098a7cc8" candidate_uuid: "3e78b35a6f034657b418d0f93f0762fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23d6ab10333843b9b28ebeca435a509c" is_pre_election: true
I20260811 16:37:36.701814 28032 raft_consensus.cc:2454] T df535933c79b492c9c51c74d098a7cc8 P 23d6ab10333843b9b28ebeca435a509c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e78b35a6f034657b418d0f93f0762fa in term 0.
I20260811 16:37:36.701881 27530 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df535933c79b492c9c51c74d098a7cc8" candidate_uuid: "3e78b35a6f034657b418d0f93f0762fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc93071d362845daab3d1592f5fb591e" is_pre_election: true
I20260811 16:37:36.701972 27530 raft_consensus.cc:2454] T df535933c79b492c9c51c74d098a7cc8 P bc93071d362845daab3d1592f5fb591e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e78b35a6f034657b418d0f93f0762fa in term 0.
I20260811 16:37:36.701961 27659 leader_election.cc:302] T df535933c79b492c9c51c74d098a7cc8 P 3e78b35a6f034657b418d0f93f0762fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23d6ab10333843b9b28ebeca435a509c, 3e78b35a6f034657b418d0f93f0762fa; no voters:
I20260811 16:37:36.702092 28155 raft_consensus.cc:2781] T df535933c79b492c9c51c74d098a7cc8 P 3e78b35a6f034657b418d0f93f0762fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:37:36.702131 28155 raft_consensus.cc:482] T df535933c79b492c9c51c74d098a7cc8 P 3e78b35a6f034657b418d0f93f0762fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:37:36.702143 28155 raft_consensus.cc:3037] T df535933c79b492c9c51c74d098a7cc8 P 3e78b35a6f034657b418d0f93f0762fa [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:37:36.702822 28155 raft_consensus.cc:504] T df535933c79b492c9c51c74d098a7cc8 P 3e78b35a6f034657b418d0f93f0762fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc93071d362845daab3d1592f5fb591e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40883 } } peers { permanent_uuid: "3e78b35a6f034657b418d0f93f0762fa" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 46513 } } peers { permanent_uuid: "23d6ab10333843b9b28ebeca435a509c" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42601 } }
I20260811 16:37:36.702935 28155 leader_election.cc:288] T df535933c79b492c9c51c74d098a7cc8 P 3e78b35a6f034657b418d0f93f0762fa [CANDIDATE]: Term 1 election: Requested vote from peers bc93071d362845daab3d1592f5fb591e (127.24.175.193:40883), 23d6ab10333843b9b28ebeca435a509c (127.24.175.195:42601)
I20260811 16:37:36.703083 27530 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df535933c79b492c9c51c74d098a7cc8" candidate_uuid: "3e78b35a6f034657b418d0f93f0762fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc93071d362845daab3d1592f5fb591e"
I20260811 16:37:36.703142 27530 raft_consensus.cc:3037] T df535933c79b492c9c51c74d098a7cc8 P bc93071d362845daab3d1592f5fb591e [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:37:36.703106 28032 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df535933c79b492c9c51c74d098a7cc8" candidate_uuid: "3e78b35a6f034657b418d0f93f0762fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23d6ab10333843b9b28ebeca435a509c"
I20260811 16:37:36.703187 28032 raft_consensus.cc:3037] T df535933c79b492c9c51c74d098a7cc8 P 23d6ab10333843b9b28ebeca435a509c [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:37:36.703696 27530 raft_consensus.cc:2454] T df535933c79b492c9c51c74d098a7cc8 P bc93071d362845daab3d1592f5fb591e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e78b35a6f034657b418d0f93f0762fa in term 1.
I20260811 16:37:36.703850 27659 leader_election.cc:302] T df535933c79b492c9c51c74d098a7cc8 P 3e78b35a6f034657b418d0f93f0762fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e78b35a6f034657b418d0f93f0762fa, bc93071d362845daab3d1592f5fb591e; no voters:
I20260811 16:37:36.703887 28032 raft_consensus.cc:2454] T df535933c79b492c9c51c74d098a7cc8 P 23d6ab10333843b9b28ebeca435a509c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e78b35a6f034657b418d0f93f0762fa in term 1.
I20260811 16:37:36.703965 28155 raft_consensus.cc:2781] T df535933c79b492c9c51c74d098a7cc8 P 3e78b35a6f034657b418d0f93f0762fa [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:37:36.704073 28155 raft_consensus.cc:686] T df535933c79b492c9c51c74d098a7cc8 P 3e78b35a6f034657b418d0f93f0762fa [term 1 LEADER]: Becoming Leader. State: Replica: 3e78b35a6f034657b418d0f93f0762fa, State: Running, Role: LEADER
I20260811 16:37:36.704160 28155 consensus_queue.cc:237] T df535933c79b492c9c51c74d098a7cc8 P 3e78b35a6f034657b418d0f93f0762fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc93071d362845daab3d1592f5fb591e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40883 } } peers { permanent_uuid: "3e78b35a6f034657b418d0f93f0762fa" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 46513 } } peers { permanent_uuid: "23d6ab10333843b9b28ebeca435a509c" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42601 } }
I20260811 16:37:36.704459 28222 tablet_replica.cc:439] T df535933c79b492c9c51c74d098a7cc8 P 3e78b35a6f034657b418d0f93f0762fa: TxnStatusTablet state changed. Reason: New leader 3e78b35a6f034657b418d0f93f0762fa. Latest consensus state: current_term: 1 leader_uuid: "3e78b35a6f034657b418d0f93f0762fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc93071d362845daab3d1592f5fb591e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40883 } } peers { permanent_uuid: "3e78b35a6f034657b418d0f93f0762fa" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 46513 } } peers { permanent_uuid: "23d6ab10333843b9b28ebeca435a509c" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42601 } } }
I20260811 16:37:36.704602 28222 tablet_replica.cc:442] T df535933c79b492c9c51c74d098a7cc8 P 3e78b35a6f034657b418d0f93f0762fa: This TxnStatusTablet replica's current role is: LEADER
I20260811 16:37:36.704777 28225 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 16:37:36.704881 28225 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 16:37:36.704885 27279 catalog_manager.cc:5495] T df535933c79b492c9c51c74d098a7cc8 P 3e78b35a6f034657b418d0f93f0762fa reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e78b35a6f034657b418d0f93f0762fa (127.24.175.194). New cstate: current_term: 1 leader_uuid: "3e78b35a6f034657b418d0f93f0762fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc93071d362845daab3d1592f5fb591e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e78b35a6f034657b418d0f93f0762fa" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 46513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "23d6ab10333843b9b28ebeca435a509c" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42601 } health_report { overall_health: UNKNOWN } } }
I20260811 16:37:36.721625 28136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:36.719407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39468 (local address 127.24.175.194:46513)
0811 16:37:36.719461 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:36.719463 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:36.719471 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:37:36.719551 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:36.719552 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:36.719583 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:36.719634 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:37:36.719756 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.720185 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.720939 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.721118 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.721169 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:36.721348 (+ 179us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:37:36.721435 (+ 87us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:37:36.721492 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:36.721546 (+ 54us) server_negotiation.cc:299] Negotiation successful
0811 16:37:36.721565 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 16:37:36.721664 28209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:36.719350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.194:46513 (local address 127.0.0.1:39468)
0811 16:37:36.719419 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:36.719429 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:36.719479 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:36.719648 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:36.719648 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:36.719650 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 16:37:36.719699 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:36.719701 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.720258 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.720259 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:36.720856 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:36.720858 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.721182 (+ 324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.721183 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:36.721258 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:36.721272 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 16:37:36.721493 (+ 221us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 16:37:36.721501 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 16:37:36.721543 (+ 42us) client_negotiation.cc:240] Negotiation successful
0811 16:37:36.721598 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260811 16:37:36.722841 27530 raft_consensus.cc:1261] T df535933c79b492c9c51c74d098a7cc8 P bc93071d362845daab3d1592f5fb591e [term 1 FOLLOWER]: Refusing update from remote peer 3e78b35a6f034657b418d0f93f0762fa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:37:36.722872 28032 raft_consensus.cc:1261] T df535933c79b492c9c51c74d098a7cc8 P 23d6ab10333843b9b28ebeca435a509c [term 1 FOLLOWER]: Refusing update from remote peer 3e78b35a6f034657b418d0f93f0762fa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:37:36.723104 28155 consensus_queue.cc:1035] T df535933c79b492c9c51c74d098a7cc8 P 3e78b35a6f034657b418d0f93f0762fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "23d6ab10333843b9b28ebeca435a509c" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:37:36.723224 28222 consensus_queue.cc:1035] T df535933c79b492c9c51c74d098a7cc8 P 3e78b35a6f034657b418d0f93f0762fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc93071d362845daab3d1592f5fb591e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:37:36.723834 28163 tablet_replica.cc:439] T df535933c79b492c9c51c74d098a7cc8 P 23d6ab10333843b9b28ebeca435a509c: TxnStatusTablet state changed. Reason: New leader 3e78b35a6f034657b418d0f93f0762fa. Latest consensus state: current_term: 1 leader_uuid: "3e78b35a6f034657b418d0f93f0762fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc93071d362845daab3d1592f5fb591e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40883 } } peers { permanent_uuid: "3e78b35a6f034657b418d0f93f0762fa" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 46513 } } peers { permanent_uuid: "23d6ab10333843b9b28ebeca435a509c" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42601 } } }
I20260811 16:37:36.723925 28163 tablet_replica.cc:442] T df535933c79b492c9c51c74d098a7cc8 P 23d6ab10333843b9b28ebeca435a509c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 16:37:36.724146 28160 tablet_replica.cc:439] T df535933c79b492c9c51c74d098a7cc8 P bc93071d362845daab3d1592f5fb591e: TxnStatusTablet state changed. Reason: New leader 3e78b35a6f034657b418d0f93f0762fa. Latest consensus state: current_term: 1 leader_uuid: "3e78b35a6f034657b418d0f93f0762fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc93071d362845daab3d1592f5fb591e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40883 } } peers { permanent_uuid: "3e78b35a6f034657b418d0f93f0762fa" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 46513 } } peers { permanent_uuid: "23d6ab10333843b9b28ebeca435a509c" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42601 } } }
I20260811 16:37:36.724257 28160 tablet_replica.cc:442] T df535933c79b492c9c51c74d098a7cc8 P bc93071d362845daab3d1592f5fb591e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 16:37:36.724881 28155 tablet_replica.cc:439] T df535933c79b492c9c51c74d098a7cc8 P 3e78b35a6f034657b418d0f93f0762fa: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3e78b35a6f034657b418d0f93f0762fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc93071d362845daab3d1592f5fb591e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40883 } } peers { permanent_uuid: "3e78b35a6f034657b418d0f93f0762fa" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 46513 } } peers { permanent_uuid: "23d6ab10333843b9b28ebeca435a509c" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42601 } } }
I20260811 16:37:36.724961 28155 tablet_replica.cc:442] T df535933c79b492c9c51c74d098a7cc8 P 3e78b35a6f034657b418d0f93f0762fa: This TxnStatusTablet replica's current role is: LEADER
I20260811 16:37:36.725004 28155 tablet_replica.cc:439] T df535933c79b492c9c51c74d098a7cc8 P 3e78b35a6f034657b418d0f93f0762fa: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3e78b35a6f034657b418d0f93f0762fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc93071d362845daab3d1592f5fb591e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40883 } } peers { permanent_uuid: "3e78b35a6f034657b418d0f93f0762fa" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 46513 } } peers { permanent_uuid: "23d6ab10333843b9b28ebeca435a509c" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42601 } } }
I20260811 16:37:36.725044 28155 tablet_replica.cc:442] T df535933c79b492c9c51c74d098a7cc8 P 3e78b35a6f034657b418d0f93f0762fa: This TxnStatusTablet replica's current role is: LEADER
I20260811 16:37:36.725051 28160 tablet_replica.cc:439] T df535933c79b492c9c51c74d098a7cc8 P bc93071d362845daab3d1592f5fb591e: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3e78b35a6f034657b418d0f93f0762fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc93071d362845daab3d1592f5fb591e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40883 } } peers { permanent_uuid: "3e78b35a6f034657b418d0f93f0762fa" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 46513 } } peers { permanent_uuid: "23d6ab10333843b9b28ebeca435a509c" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42601 } } }
I20260811 16:37:36.725114 28160 tablet_replica.cc:442] T df535933c79b492c9c51c74d098a7cc8 P bc93071d362845daab3d1592f5fb591e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 16:37:36.725423 28163 tablet_replica.cc:439] T df535933c79b492c9c51c74d098a7cc8 P 23d6ab10333843b9b28ebeca435a509c: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3e78b35a6f034657b418d0f93f0762fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc93071d362845daab3d1592f5fb591e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40883 } } peers { permanent_uuid: "3e78b35a6f034657b418d0f93f0762fa" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 46513 } } peers { permanent_uuid: "23d6ab10333843b9b28ebeca435a509c" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42601 } } }
I20260811 16:37:36.725507 28163 tablet_replica.cc:442] T df535933c79b492c9c51c74d098a7cc8 P 23d6ab10333843b9b28ebeca435a509c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 16:37:36.729807 28219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:36.727415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44646 (local address 127.24.175.193:40883)
0811 16:37:36.727455 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:36.727456 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:36.727467 (+ 11us) server_negotiation.cc:407] Connection header received
0811 16:37:36.727550 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:36.727551 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:36.727566 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:36.727615 (+ 49us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:37:36.727726 (+ 111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.728153 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.729190 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.729372 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.729413 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:36.729569 (+ 156us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:37:36.729652 (+ 83us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:37:36.729708 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:36.729746 (+ 38us) server_negotiation.cc:299] Negotiation successful
0811 16:37:36.729762 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 16:37:36.734527 28136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:36.732150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:58639 (local address 127.24.175.194:46513)
0811 16:37:36.732189 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:36.732190 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:36.732271 (+ 81us) server_negotiation.cc:407] Connection header received
0811 16:37:36.732329 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:36.732330 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:36.732336 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:36.732376 (+ 40us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:37:36.732489 (+ 113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.732913 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.733980 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.734145 (+ 165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.734204 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:36.734371 (+ 167us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:37:36.734392 (+ 21us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:37:36.734420 (+ 28us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:36.734472 (+ 52us) server_negotiation.cc:299] Negotiation successful
0811 16:37:36.734484 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 16:37:36.734606 28255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:36.732064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.194:46513 (local address 127.24.175.193:58639)
0811 16:37:36.732206 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:36.732217 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:36.732277 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:36.732386 (+ 109us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:36.732387 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:36.732388 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 16:37:36.732438 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:36.732439 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.732981 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.732981 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:36.733913 (+ 932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:36.733915 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.734228 (+ 313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.734229 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:36.734286 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:36.734301 (+ 15us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 16:37:36.734423 (+ 122us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 16:37:36.734425 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 16:37:36.734470 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 16:37:36.734512 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":75,"threads_started":1}
I20260811 16:37:36.736603 28032 raft_consensus.cc:1261] T 13355f4ecfa74ebcb945b98b54adc400 P 23d6ab10333843b9b28ebeca435a509c [term 1 FOLLOWER]: Refusing update from remote peer bc93071d362845daab3d1592f5fb591e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:37:36.736656 27765 raft_consensus.cc:1261] T 13355f4ecfa74ebcb945b98b54adc400 P 3e78b35a6f034657b418d0f93f0762fa [term 1 FOLLOWER]: Refusing update from remote peer bc93071d362845daab3d1592f5fb591e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:37:36.736900 28201 consensus_queue.cc:1035] T 13355f4ecfa74ebcb945b98b54adc400 P bc93071d362845daab3d1592f5fb591e [LEADER]: Connected to new peer: Peer: permanent_uuid: "23d6ab10333843b9b28ebeca435a509c" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:37:36.737020 28160 consensus_queue.cc:1035] T 13355f4ecfa74ebcb945b98b54adc400 P bc93071d362845daab3d1592f5fb591e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e78b35a6f034657b418d0f93f0762fa" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 46513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:37:36.745332 28219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:36.742937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:47675 (local address 127.24.175.193:40883)
0811 16:37:36.742974 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:36.742975 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:36.742984 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:37:36.743049 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:36.743049 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:36.743057 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:36.743090 (+ 33us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:37:36.743231 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.743647 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.744737 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.744916 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.744964 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:36.745163 (+ 199us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:37:36.745185 (+ 22us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:37:36.745213 (+ 28us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:36.745269 (+ 56us) server_negotiation.cc:299] Negotiation successful
0811 16:37:36.745284 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 16:37:36.745412 28269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:36.742780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.193:40883 (local address 127.24.175.194:47675)
0811 16:37:36.742927 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:36.742938 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:36.742989 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:36.743100 (+ 111us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:36.743101 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:36.743103 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 16:37:36.743174 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:36.743175 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.743706 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.743707 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:36.744666 (+ 959us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:36.744668 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.744999 (+ 331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.745000 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:36.745072 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:36.745095 (+ 23us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 16:37:36.745221 (+ 126us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 16:37:36.745222 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 16:37:36.745267 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 16:37:36.745308 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":66,"threads_started":1}
I20260811 16:37:36.753979 27278 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55550:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:37:36.754067 27278 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55550:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:37:36.754667 27278 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 09ee313a70b4468aac60cbec7bd2489e: Sending DeleteTablet for 3 replicas of tablet 13355f4ecfa74ebcb945b98b54adc400
I20260811 16:37:36.754884 27499 tablet_service.cc:1514] Processing DeleteTablet for tablet 13355f4ecfa74ebcb945b98b54adc400 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:37:36 UTC) from {username='kudu', principal='kudu/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:44640
I20260811 16:37:36.754940 27976 tablet_service.cc:1514] Processing DeleteTablet for tablet 13355f4ecfa74ebcb945b98b54adc400 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:37:36 UTC) from {username='kudu', principal='kudu/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:49176
I20260811 16:37:36.755175 27732 tablet_service.cc:1514] Processing DeleteTablet for tablet 13355f4ecfa74ebcb945b98b54adc400 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:37:36 UTC) from {username='kudu', principal='kudu/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:39454
I20260811 16:37:36.755676 28275 tablet_replica.cc:330] T 13355f4ecfa74ebcb945b98b54adc400 P 23d6ab10333843b9b28ebeca435a509c: stopping tablet replica
I20260811 16:37:36.755749 28275 raft_consensus.cc:2229] T 13355f4ecfa74ebcb945b98b54adc400 P 23d6ab10333843b9b28ebeca435a509c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:37:36.755789 28275 raft_consensus.cc:2258] T 13355f4ecfa74ebcb945b98b54adc400 P 23d6ab10333843b9b28ebeca435a509c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:37:36.755921 28279 tablet_replica.cc:330] T 13355f4ecfa74ebcb945b98b54adc400 P 3e78b35a6f034657b418d0f93f0762fa: stopping tablet replica
I20260811 16:37:36.755976 28279 raft_consensus.cc:2229] T 13355f4ecfa74ebcb945b98b54adc400 P 3e78b35a6f034657b418d0f93f0762fa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:37:36.756014 28279 raft_consensus.cc:2258] T 13355f4ecfa74ebcb945b98b54adc400 P 3e78b35a6f034657b418d0f93f0762fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:37:36.756211 28275 ts_tablet_manager.cc:1905] T 13355f4ecfa74ebcb945b98b54adc400 P 23d6ab10333843b9b28ebeca435a509c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:37:36.756254 28279 ts_tablet_manager.cc:1905] T 13355f4ecfa74ebcb945b98b54adc400 P 3e78b35a6f034657b418d0f93f0762fa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:37:36.757889 28273 tablet_replica.cc:330] T 13355f4ecfa74ebcb945b98b54adc400 P bc93071d362845daab3d1592f5fb591e: stopping tablet replica
I20260811 16:37:36.757944 28273 raft_consensus.cc:2229] T 13355f4ecfa74ebcb945b98b54adc400 P bc93071d362845daab3d1592f5fb591e [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:37:36.758044 28273 raft_consensus.cc:2258] T 13355f4ecfa74ebcb945b98b54adc400 P bc93071d362845daab3d1592f5fb591e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:37:36.758106 28279 ts_tablet_manager.cc:1918] T 13355f4ecfa74ebcb945b98b54adc400 P 3e78b35a6f034657b418d0f93f0762fa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 16:37:36.758234 28279 log.cc:1196] T 13355f4ecfa74ebcb945b98b54adc400 P 3e78b35a6f034657b418d0f93f0762fa: Deleting WAL directory at /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/ts-1/wal/wals/13355f4ecfa74ebcb945b98b54adc400
I20260811 16:37:36.758395 28273 ts_tablet_manager.cc:1905] T 13355f4ecfa74ebcb945b98b54adc400 P bc93071d362845daab3d1592f5fb591e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:37:36.758553 28279 ts_tablet_manager.cc:1939] T 13355f4ecfa74ebcb945b98b54adc400 P 3e78b35a6f034657b418d0f93f0762fa: Deleting consensus metadata
I20260811 16:37:36.758550 28275 ts_tablet_manager.cc:1918] T 13355f4ecfa74ebcb945b98b54adc400 P 23d6ab10333843b9b28ebeca435a509c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 16:37:36.758860 27252 catalog_manager.cc:4841] TS 3e78b35a6f034657b418d0f93f0762fa (127.24.175.194:46513): tablet 13355f4ecfa74ebcb945b98b54adc400 (table test-table [id=cbe66d7a40bc4f79b498c754c34cec66]) successfully deleted
I20260811 16:37:36.759802 28273 ts_tablet_manager.cc:1918] T 13355f4ecfa74ebcb945b98b54adc400 P bc93071d362845daab3d1592f5fb591e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 16:37:36.759853 28273 log.cc:1196] T 13355f4ecfa74ebcb945b98b54adc400 P bc93071d362845daab3d1592f5fb591e: Deleting WAL directory at /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/ts-0/wal/wals/13355f4ecfa74ebcb945b98b54adc400
I20260811 16:37:36.760035 28273 ts_tablet_manager.cc:1939] T 13355f4ecfa74ebcb945b98b54adc400 P bc93071d362845daab3d1592f5fb591e: Deleting consensus metadata
I20260811 16:37:36.760139 28275 log.cc:1196] T 13355f4ecfa74ebcb945b98b54adc400 P 23d6ab10333843b9b28ebeca435a509c: Deleting WAL directory at /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466249441839-25279-0/minicluster-data/ts-2/wal/wals/13355f4ecfa74ebcb945b98b54adc400
I20260811 16:37:36.760380 28275 ts_tablet_manager.cc:1939] T 13355f4ecfa74ebcb945b98b54adc400 P 23d6ab10333843b9b28ebeca435a509c: Deleting consensus metadata
I20260811 16:37:36.760401 27252 catalog_manager.cc:4841] TS bc93071d362845daab3d1592f5fb591e (127.24.175.193:40883): tablet 13355f4ecfa74ebcb945b98b54adc400 (table test-table [id=cbe66d7a40bc4f79b498c754c34cec66]) successfully deleted
I20260811 16:37:36.760667 27252 catalog_manager.cc:4841] TS 23d6ab10333843b9b28ebeca435a509c (127.24.175.195:42601): tablet 13355f4ecfa74ebcb945b98b54adc400 (table test-table [id=cbe66d7a40bc4f79b498c754c34cec66]) successfully deleted
Aug 11 16:37:36 dist-test-slave-zj8q krb5kdc[27194](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466256, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.24.175.193@KRBTEST.COM
I20260811 16:37:36.768002 28219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:36.755600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44648 (local address 127.24.175.193:40883)
0811 16:37:36.755633 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:36.755635 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:36.760697 (+ 5062us) server_negotiation.cc:407] Connection header received
0811 16:37:36.760813 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:36.760814 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:36.760824 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:36.760870 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:36.761361 (+ 491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.761808 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.762523 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.762720 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.762774 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:36.765372 (+ 2598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:36.765381 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:36.765381 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:37:36.765388 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:36.766915 (+ 1527us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:36.767229 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:36.767232 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:36.767233 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:36.767299 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:36.767467 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:36.767468 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:36.767468 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:36.767614 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:36.767775 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:36.767813 (+ 38us) server_negotiation.cc:299] Negotiation successful
0811 16:37:36.767895 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
W20260811 16:37:36.768432 27609 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44648
I20260811 16:37:36.775040 27352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:36.769275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55566 (local address 127.24.175.254:43961)
0811 16:37:36.769317 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:36.769319 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:36.769485 (+ 166us) server_negotiation.cc:407] Connection header received
0811 16:37:36.769541 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:36.769542 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:36.769554 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:36.769607 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:36.770063 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.770670 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.771339 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:36.771540 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:36.771592 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:36.772668 (+ 1076us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:36.772669 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:36.772670 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:37:36.772677 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:36.774044 (+ 1367us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:36.774386 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:36.774387 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:36.774388 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:36.774443 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:36.774600 (+ 157us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:36.774601 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:36.774601 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:36.774703 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:36.774791 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:36.774882 (+ 91us) server_negotiation.cc:299] Negotiation successful
0811 16:37:36.774954 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
W20260811 16:37:36.775240 27278 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55566
I20260811 16:37:36.775794 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 27397
I20260811 16:37:36.787945 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 27629
I20260811 16:37:36.797278 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 27873
I20260811 16:37:36.808501 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 27213
2026-08-11T16:37:36Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2977 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:37:36 dist-test-slave-zj8q krb5kdc[28293](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:37:36 dist-test-slave-zj8q krb5kdc[28293](info): set up 2 sockets
Aug 11 16:37:36 dist-test-slave-zj8q krb5kdc[28293](info): commencing operation
krb5kdc: starting...
W20260811 16:37:37.970510 25279 mini_kdc.cc:121] Time spent starting KDC: real 1.135s user 0.005s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Aug 11 16:37:38 dist-test-slave-zj8q krb5kdc[28293](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466258, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:37:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:37:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab.
Entry for principal kudu/127.24.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab.
I20260811 16:37:38.085517 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:38335
--webserver_interface=127.24.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:36159
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.175.254:38335
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:37:38.166801 28312 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:37:38.167047 28312 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:37:38.167083 28312 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:37:38.168236 28312 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:37:38.168282 28312 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 16:37:38.168299 28312 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:37:38.168316 28312 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:37:38.168332 28312 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:37:38.168356 28312 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:37:38.169857 28312 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:36159
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.175.254:38335
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:38335
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28312
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:37:38.170102 28312 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:37:38.170320 28312 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:37:38.174891 28325 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:38.174896 28328 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:38.174919 28324 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:37:38.175118 28312 server_base.cc:1034] running on GCE node
I20260811 16:37:38.175391 28312 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:37:38.175659 28312 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:37:38.176791 28312 hybrid_clock.cc:648] HybridClock initialized: now 1786466258176778 us; error 27 us; skew 500 ppm
Aug 11 16:37:38 dist-test-slave-zj8q krb5kdc[28293](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466258, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:37:38.179097 28312 init.cc:377] Logged in from keytab as kudu/127.24.175.254@KRBTEST.COM (short username kudu)
I20260811 16:37:38.179488 28312 webserver.cc:460] Webserver started at http://127.24.175.254:39289/ using document root <none> and password file <none>
I20260811 16:37:38.179672 28312 fs_manager.cc:359] Metadata directory not provided
I20260811 16:37:38.179709 28312 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:37:38.179800 28312 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:37:38.180737 28312 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/master-0/data/instance:
uuid: "09d25b60ed7241c8bcb7d373cfb7d769"
format_stamp: "Formatted at 2026-08-11 16:37:38 on dist-test-slave-zj8q"
server_key: "1d509bf78a0d8403515e66b7d7c4ef75"
server_key_iv: "ff7bee1f8cb89bc4113d00da574d8354"
server_key_version: "encryptionkey@0"
I20260811 16:37:38.181018 28312 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/master-0/wal/instance:
uuid: "09d25b60ed7241c8bcb7d373cfb7d769"
format_stamp: "Formatted at 2026-08-11 16:37:38 on dist-test-slave-zj8q"
server_key: "1d509bf78a0d8403515e66b7d7c4ef75"
server_key_iv: "ff7bee1f8cb89bc4113d00da574d8354"
server_key_version: "encryptionkey@0"
I20260811 16:37:38.182183 28312 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:37:38.182832 28335 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:38.182965 28312 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 16:37:38.183048 28312 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/master-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/master-0/wal
uuid: "09d25b60ed7241c8bcb7d373cfb7d769"
format_stamp: "Formatted at 2026-08-11 16:37:38 on dist-test-slave-zj8q"
server_key: "1d509bf78a0d8403515e66b7d7c4ef75"
server_key_iv: "ff7bee1f8cb89bc4113d00da574d8354"
server_key_version: "encryptionkey@0"
I20260811 16:37:38.183105 28312 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:37:38.192178 28312 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:37:38.193949 28312 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:37:38.194078 28312 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:37:38.198457 28312 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.254:38335
I20260811 16:37:38.198530 28445 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.254:38335 every 8 connection(s)
I20260811 16:37:38.198797 28312 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
I20260811 16:37:38.199436 28446 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:37:38.199533 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 28312
I20260811 16:37:38.199620 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/master-0/wal/instance
I20260811 16:37:38.199780 25279 external_mini_cluster.cc:1428] Setting key 377ab1dda027ae297b744c9dfdeec55f
I20260811 16:37:38.202670 28446 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09d25b60ed7241c8bcb7d373cfb7d769: Bootstrap starting.
I20260811 16:37:38.203276 28446 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 09d25b60ed7241c8bcb7d373cfb7d769: Neither blocks nor log segments found. Creating new log.
I20260811 16:37:38.203572 28446 log.cc:824] T 00000000000000000000000000000000 P 09d25b60ed7241c8bcb7d373cfb7d769: Log is configured to *not* fsync() on all Append() calls
I20260811 16:37:38.204311 28446 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09d25b60ed7241c8bcb7d373cfb7d769: No bootstrap required, opened a new log
Aug 11 16:37:38 dist-test-slave-zj8q krb5kdc[28293](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466258, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:37:38.206630 28446 raft_consensus.cc:348] T 00000000000000000000000000000000 P 09d25b60ed7241c8bcb7d373cfb7d769 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09d25b60ed7241c8bcb7d373cfb7d769" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 38335 } }
I20260811 16:37:38.206768 28446 raft_consensus.cc:374] T 00000000000000000000000000000000 P 09d25b60ed7241c8bcb7d373cfb7d769 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:37:38.206794 28446 raft_consensus.cc:729] T 00000000000000000000000000000000 P 09d25b60ed7241c8bcb7d373cfb7d769 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09d25b60ed7241c8bcb7d373cfb7d769, State: Initialized, Role: FOLLOWER
I20260811 16:37:38.206923 28446 consensus_queue.cc:260] T 00000000000000000000000000000000 P 09d25b60ed7241c8bcb7d373cfb7d769 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09d25b60ed7241c8bcb7d373cfb7d769" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 38335 } }
I20260811 16:37:38.207007 28446 raft_consensus.cc:388] T 00000000000000000000000000000000 P 09d25b60ed7241c8bcb7d373cfb7d769 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:37:38.207082 28446 raft_consensus.cc:482] T 00000000000000000000000000000000 P 09d25b60ed7241c8bcb7d373cfb7d769 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:37:38.207126 28446 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 09d25b60ed7241c8bcb7d373cfb7d769 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:37:38.207736 28446 raft_consensus.cc:504] T 00000000000000000000000000000000 P 09d25b60ed7241c8bcb7d373cfb7d769 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09d25b60ed7241c8bcb7d373cfb7d769" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 38335 } }
I20260811 16:37:38.207826 28446 leader_election.cc:302] T 00000000000000000000000000000000 P 09d25b60ed7241c8bcb7d373cfb7d769 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 09d25b60ed7241c8bcb7d373cfb7d769; no voters:
I20260811 16:37:38.207990 28446 leader_election.cc:288] T 00000000000000000000000000000000 P 09d25b60ed7241c8bcb7d373cfb7d769 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:37:38.208036 28457 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 09d25b60ed7241c8bcb7d373cfb7d769 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:37:38.208189 28457 raft_consensus.cc:686] T 00000000000000000000000000000000 P 09d25b60ed7241c8bcb7d373cfb7d769 [term 1 LEADER]: Becoming Leader. State: Replica: 09d25b60ed7241c8bcb7d373cfb7d769, State: Running, Role: LEADER
I20260811 16:37:38.208273 28446 sys_catalog.cc:564] T 00000000000000000000000000000000 P 09d25b60ed7241c8bcb7d373cfb7d769 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:37:38.208328 28457 consensus_queue.cc:237] T 00000000000000000000000000000000 P 09d25b60ed7241c8bcb7d373cfb7d769 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09d25b60ed7241c8bcb7d373cfb7d769" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 38335 } }
I20260811 16:37:38.208689 28457 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09d25b60ed7241c8bcb7d373cfb7d769 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 09d25b60ed7241c8bcb7d373cfb7d769. Latest consensus state: current_term: 1 leader_uuid: "09d25b60ed7241c8bcb7d373cfb7d769" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09d25b60ed7241c8bcb7d373cfb7d769" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 38335 } } }
I20260811 16:37:38.208791 28457 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09d25b60ed7241c8bcb7d373cfb7d769 [sys.catalog]: This master's current role is: LEADER
I20260811 16:37:38.208691 28461 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09d25b60ed7241c8bcb7d373cfb7d769 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "09d25b60ed7241c8bcb7d373cfb7d769" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09d25b60ed7241c8bcb7d373cfb7d769" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 38335 } } }
I20260811 16:37:38.209117 28461 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09d25b60ed7241c8bcb7d373cfb7d769 [sys.catalog]: This master's current role is: LEADER
I20260811 16:37:38.209674 28477 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:37:38.209949 28455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:38.200246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55414 (local address 127.24.175.254:38335)
0811 16:37:38.200397 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:38.200405 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:38.200430 (+ 25us) server_negotiation.cc:407] Connection header received
0811 16:37:38.200883 (+ 453us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:38.200889 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:38.200934 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:38.201041 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:38.201790 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:38.202700 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:38.203412 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:38.203973 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:38.204086 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:38.206569 (+ 2483us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:38.206573 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:38.206573 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:37:38.206584 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:38.208288 (+ 1704us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:38.208675 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:38.208678 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:38.208678 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:38.208805 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:38.209035 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:38.209035 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:38.209036 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:38.209336 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:38.209511 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:38.209654 (+ 143us) server_negotiation.cc:299] Negotiation successful
0811 16:37:38.209791 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":59,"threads_started":1}
I20260811 16:37:38.210357 28477 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:37:38.211689 28477 catalog_manager.cc:1347] Generated new cluster ID: 2e6efc1d211d47fe8e85febdb8fe5343
I20260811 16:37:38.211740 28477 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:37:38.228466 28477 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:37:38.229132 28477 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:37:38.231657 28477 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 09d25b60ed7241c8bcb7d373cfb7d769: Generated new TSK 0
I20260811 16:37:38.231813 28477 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.175.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab.
Entry for principal kudu/127.24.175.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab.
I20260811 16:37:38.256486 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.193:0
--local_ip_for_outbound_sockets=127.24.175.193
--webserver_interface=127.24.175.193
--webserver_port=0
--tserver_master_addrs=127.24.175.254:38335
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab
--principal=kudu/127.24.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:36159
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:37:38.338253 28497 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:37:38.338444 28497 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:37:38.338467 28497 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:37:38.339623 28497 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:37:38.339663 28497 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:37:38.339681 28497 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 16:37:38.339692 28497 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 16:37:38.339710 28497 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.193
I20260811 16:37:38.341225 28497 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:36159
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab
--principal=kudu/127.24.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.175.193
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.24.175.254:38335
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28497
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.193
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:37:38.341439 28497 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:37:38.341660 28497 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:37:38.346444 28508 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:38.346458 28506 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:38.346455 28511 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:37:38.346670 28497 server_base.cc:1034] running on GCE node
I20260811 16:37:38.346868 28497 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:37:38.347074 28497 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:37:38.348218 28497 hybrid_clock.cc:648] HybridClock initialized: now 1786466258348203 us; error 29 us; skew 500 ppm
Aug 11 16:37:38 dist-test-slave-zj8q krb5kdc[28293](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466258, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:37:38.350544 28497 init.cc:377] Logged in from keytab as kudu/127.24.175.193@KRBTEST.COM (short username kudu)
I20260811 16:37:38.350922 28497 webserver.cc:460] Webserver started at http://127.24.175.193:43483/ using document root <none> and password file <none>
I20260811 16:37:38.351099 28497 fs_manager.cc:359] Metadata directory not provided
I20260811 16:37:38.351140 28497 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:37:38.351228 28497 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:37:38.352173 28497 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/ts-0/data/instance:
uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da"
format_stamp: "Formatted at 2026-08-11 16:37:38 on dist-test-slave-zj8q"
server_key: "31b5a5a843ff02ffe3b1a7da86e01d67"
server_key_iv: "7e1441ad7a04372ef0de9f57463e405f"
server_key_version: "encryptionkey@0"
I20260811 16:37:38.352465 28497 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/ts-0/wal/instance:
uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da"
format_stamp: "Formatted at 2026-08-11 16:37:38 on dist-test-slave-zj8q"
server_key: "31b5a5a843ff02ffe3b1a7da86e01d67"
server_key_iv: "7e1441ad7a04372ef0de9f57463e405f"
server_key_version: "encryptionkey@0"
I20260811 16:37:38.353616 28497 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 16:37:38.354259 28524 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:38.354400 28497 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:38.354477 28497 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/ts-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/ts-0/wal
uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da"
format_stamp: "Formatted at 2026-08-11 16:37:38 on dist-test-slave-zj8q"
server_key: "31b5a5a843ff02ffe3b1a7da86e01d67"
server_key_iv: "7e1441ad7a04372ef0de9f57463e405f"
server_key_version: "encryptionkey@0"
I20260811 16:37:38.354544 28497 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:37:38.362345 28497 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:37:38.363929 28497 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:37:38.364032 28497 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:37:38.364450 28497 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:37:38.364490 28497 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:38.364509 28497 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:37:38.364521 28497 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:38.370713 28497 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.193:40147
I20260811 16:37:38.370803 28723 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.193:40147 every 8 connection(s)
Aug 11 16:37:38 dist-test-slave-zj8q krb5kdc[28293](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466258, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.193@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:37:38.371086 28497 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
I20260811 16:37:38.373660 28455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:38.364896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:41747 (local address 127.24.175.254:38335)
0811 16:37:38.364957 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:38.364960 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:38.365124 (+ 164us) server_negotiation.cc:407] Connection header received
0811 16:37:38.365568 (+ 444us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:38.365569 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:38.365584 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:38.365651 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:38.366443 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:38.367181 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:38.368648 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:38.368959 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:38.369027 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:38.371523 (+ 2496us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:38.371525 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:38.371525 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:37:38.371532 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:38.372626 (+ 1094us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:38.372976 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:38.372976 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:38.372977 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:38.373022 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:38.373200 (+ 178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:38.373200 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:38.373201 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:38.373305 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:38.373350 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:38.373537 (+ 187us) server_negotiation.cc:299] Negotiation successful
0811 16:37:38.373596 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 16:37:38.373847 28536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:38.364846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:38335 (local address 127.24.175.193:41747)
0811 16:37:38.364998 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:38.365045 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:38.365477 (+ 432us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:38.365719 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:38.365723 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:38.366039 (+ 316us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:37:38.366341 (+ 302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:38.366348 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:38.367288 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:38.367289 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:38.368558 (+ 1269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:38.368561 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:38.369046 (+ 485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:38.369047 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:38.369147 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:38.369641 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:37:38.369652 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:37:38.371441 (+ 1789us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:37:38.372695 (+ 1254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:38.372703 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:38.372705 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:38.372919 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:38.373066 (+ 147us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:38.373066 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:38.373066 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:38.373158 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:38.373346 (+ 188us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:37:38.373349 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:37:38.373453 (+ 104us) client_negotiation.cc:769] Sending connection context
0811 16:37:38.373534 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 16:37:38.373648 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":85,"threads_started":1}
I20260811 16:37:38.374315 28724 heartbeater.cc:347] Connected to a master server at 127.24.175.254:38335
I20260811 16:37:38.374395 28724 heartbeater.cc:464] Registering TS with master...
I20260811 16:37:38.374547 28724 heartbeater.cc:511] Master 127.24.175.254:38335 requested a full tablet report, sending...
I20260811 16:37:38.375095 28366 ts_manager.cc:194] Registered new tserver with Master: e4cb0de34ebf4e7a9c6caf56e5f1c4da (127.24.175.193:40147)
I20260811 16:37:38.375922 28366 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.175.193@KRBTEST.COM'} at 127.24.175.193:41747
I20260811 16:37:38.380127 28734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:38.375280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:38335 (local address 127.24.175.193:58795)
0811 16:37:38.375441 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:38.375450 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:38.375496 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:38.375605 (+ 109us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:38.375605 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:38.375740 (+ 135us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:37:38.375793 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:38.375794 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:38.376524 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:38.376525 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:38.377034 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:38.377035 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:38.377334 (+ 299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:38.377335 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:38.377382 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:38.377717 (+ 335us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:37:38.377721 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:37:38.378013 (+ 292us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:37:38.379426 (+ 1413us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:38.379427 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:38.379427 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:38.379564 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:38.379694 (+ 130us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:38.379694 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:38.379695 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:38.379734 (+ 39us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:38.379914 (+ 180us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:37:38.379914 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:37:38.379955 (+ 41us) client_negotiation.cc:769] Sending connection context
0811 16:37:38.379998 (+ 43us) client_negotiation.cc:240] Negotiation successful
0811 16:37:38.380063 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":76,"threads_started":1}
I20260811 16:37:38.380132 28455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:38.375350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:58795 (local address 127.24.175.254:38335)
0811 16:37:38.375394 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:38.375396 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:38.375500 (+ 104us) server_negotiation.cc:407] Connection header received
0811 16:37:38.375541 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:38.375542 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:38.375552 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:38.375602 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:38.375841 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:38.376437 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:38.377098 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:38.377281 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:38.377333 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:38.378081 (+ 748us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:38.378082 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:38.378083 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:37:38.378089 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:38.379364 (+ 1275us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:38.379608 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:38.379609 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:38.379609 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:38.379650 (+ 41us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:38.379780 (+ 130us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:38.379781 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:38.379781 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:38.379871 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:38.379921 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:38.380014 (+ 93us) server_negotiation.cc:299] Negotiation successful
0811 16:37:38.380078 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 16:37:38.381270 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 28497
I20260811 16:37:38.381351 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/ts-0/wal/instance
I20260811 16:37:38.381515 25279 external_mini_cluster.cc:1428] Setting key 1b9f8f8269d528d5c99b8df0acca374d
WARNING: no policy specified for kudu/127.24.175.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab.
Entry for principal kudu/127.24.175.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab.
I20260811 16:37:38.403995 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.194:0
--local_ip_for_outbound_sockets=127.24.175.194
--webserver_interface=127.24.175.194
--webserver_port=0
--tserver_master_addrs=127.24.175.254:38335
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab
--principal=kudu/127.24.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:36159
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:37:38.484058 28739 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:37:38.484249 28739 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:37:38.484272 28739 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:37:38.485373 28739 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:37:38.485414 28739 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:37:38.485431 28739 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 16:37:38.485442 28739 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 16:37:38.485460 28739 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.194
I20260811 16:37:38.486960 28739 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:36159
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab
--principal=kudu/127.24.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.175.194
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.24.175.254:38335
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28739
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.194
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:37:38.487166 28739 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:37:38.487367 28739 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:37:38.492295 28746 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:38.492329 28750 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:38.492296 28748 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:37:38.492565 28739 server_base.cc:1034] running on GCE node
I20260811 16:37:38.492756 28739 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:37:38.492970 28739 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:37:38.494102 28739 hybrid_clock.cc:648] HybridClock initialized: now 1786466258494084 us; error 35 us; skew 500 ppm
Aug 11 16:37:38 dist-test-slave-zj8q krb5kdc[28293](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466258, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:37:38.496511 28739 init.cc:377] Logged in from keytab as kudu/127.24.175.194@KRBTEST.COM (short username kudu)
I20260811 16:37:38.496932 28739 webserver.cc:460] Webserver started at http://127.24.175.194:34761/ using document root <none> and password file <none>
I20260811 16:37:38.497124 28739 fs_manager.cc:359] Metadata directory not provided
I20260811 16:37:38.497170 28739 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:37:38.497294 28739 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:37:38.498327 28739 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/ts-1/data/instance:
uuid: "c613eb3a1d434d34b84e77215cfba948"
format_stamp: "Formatted at 2026-08-11 16:37:38 on dist-test-slave-zj8q"
server_key: "d8bdebf162da534081cc106a78942364"
server_key_iv: "6c4ecad4ebe6f6d56becbe363a0ec015"
server_key_version: "encryptionkey@0"
I20260811 16:37:38.498652 28739 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/ts-1/wal/instance:
uuid: "c613eb3a1d434d34b84e77215cfba948"
format_stamp: "Formatted at 2026-08-11 16:37:38 on dist-test-slave-zj8q"
server_key: "d8bdebf162da534081cc106a78942364"
server_key_iv: "6c4ecad4ebe6f6d56becbe363a0ec015"
server_key_version: "encryptionkey@0"
I20260811 16:37:38.499831 28739 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:37:38.500494 28764 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:38.500648 28739 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:37:38.500731 28739 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/ts-1/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/ts-1/wal
uuid: "c613eb3a1d434d34b84e77215cfba948"
format_stamp: "Formatted at 2026-08-11 16:37:38 on dist-test-slave-zj8q"
server_key: "d8bdebf162da534081cc106a78942364"
server_key_iv: "6c4ecad4ebe6f6d56becbe363a0ec015"
server_key_version: "encryptionkey@0"
I20260811 16:37:38.500790 28739 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:37:38.521066 28739 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:37:38.522723 28739 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:37:38.522853 28739 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:37:38.523362 28739 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:37:38.523403 28739 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:38.523432 28739 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:37:38.523463 28739 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 16:37:38 dist-test-slave-zj8q krb5kdc[28293](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466258, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.194@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:37:38.530333 28739 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.194:38489
I20260811 16:37:38.530436 28949 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.194:38489 every 8 connection(s)
I20260811 16:37:38.530714 28739 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
I20260811 16:37:38.532390 28455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:38.523710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:46031 (local address 127.24.175.254:38335)
0811 16:37:38.523779 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:38.523782 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:38.523985 (+ 203us) server_negotiation.cc:407] Connection header received
0811 16:37:38.524467 (+ 482us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:38.524469 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:38.524483 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:38.524558 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:38.525188 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:38.525951 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:38.527069 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:38.527269 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:38.527327 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:38.529828 (+ 2501us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:38.529830 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:38.529830 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:37:38.529838 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:38.531390 (+ 1552us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:38.531718 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:38.531719 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:38.531719 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:38.531769 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:38.531929 (+ 160us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:38.531929 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:38.531930 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:38.532024 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:38.532070 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:38.532261 (+ 191us) server_negotiation.cc:299] Negotiation successful
0811 16:37:38.532326 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 16:37:38.532521 28777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:38.523703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:38335 (local address 127.24.175.194:46031)
0811 16:37:38.523861 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:38.523901 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:38.524370 (+ 469us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:38.524644 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:38.524648 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:38.524883 (+ 235us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:37:38.525109 (+ 226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:38.525114 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:38.526067 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:38.526068 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:38.526977 (+ 909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:38.526981 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:38.527343 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:38.527344 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:38.527472 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:38.527953 (+ 481us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:37:38.527963 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:37:38.529738 (+ 1775us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:37:38.531456 (+ 1718us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:38.531459 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:38.531460 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:38.531659 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:38.531809 (+ 150us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:38.531809 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:38.531810 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:38.531890 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:38.532066 (+ 176us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:37:38.532068 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:37:38.532167 (+ 99us) client_negotiation.cc:769] Sending connection context
0811 16:37:38.532246 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 16:37:38.532356 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":82,"threads_started":1}
I20260811 16:37:38.532958 28951 heartbeater.cc:347] Connected to a master server at 127.24.175.254:38335
I20260811 16:37:38.533035 28951 heartbeater.cc:464] Registering TS with master...
I20260811 16:37:38.533196 28951 heartbeater.cc:511] Master 127.24.175.254:38335 requested a full tablet report, sending...
I20260811 16:37:38.533576 28367 ts_manager.cc:194] Registered new tserver with Master: c613eb3a1d434d34b84e77215cfba948 (127.24.175.194:38489)
I20260811 16:37:38.534066 28367 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.175.194@KRBTEST.COM'} at 127.24.175.194:46031
I20260811 16:37:38.538340 28455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:38.533938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:44251 (local address 127.24.175.254:38335)
0811 16:37:38.533976 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:38.533978 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:38.534027 (+ 49us) server_negotiation.cc:407] Connection header received
0811 16:37:38.534091 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:38.534091 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:38.534099 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:38.534147 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:38.534504 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:38.534941 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:38.535613 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:38.535788 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:38.535828 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:38.536496 (+ 668us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:38.536497 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:38.536497 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:37:38.536503 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:38.537484 (+ 981us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:38.537765 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:38.537765 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:38.537766 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:38.537807 (+ 41us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:38.537925 (+ 118us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:38.537925 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:38.537926 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:38.538043 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:38.538090 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:38.538227 (+ 137us) server_negotiation.cc:299] Negotiation successful
0811 16:37:38.538286 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 16:37:38.538357 28967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:38.533858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:38335 (local address 127.24.175.194:44251)
0811 16:37:38.533975 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:38.533985 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:38.534040 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:38.534190 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:38.534192 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:38.534355 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:37:38.534430 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:38.534433 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:38.535017 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:38.535017 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:38.535547 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:38.535549 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:38.535834 (+ 285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:38.535834 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:38.535888 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:38.536177 (+ 289us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:37:38.536180 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:37:38.536423 (+ 243us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:37:38.537545 (+ 1122us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:38.537546 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:38.537547 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:38.537704 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:38.537843 (+ 139us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:38.537844 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:38.537844 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:38.537885 (+ 41us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:38.538089 (+ 204us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:37:38.538089 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:37:38.538123 (+ 34us) client_negotiation.cc:769] Sending connection context
0811 16:37:38.538202 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 16:37:38.538289 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":66,"threads_started":1}
I20260811 16:37:38.538544 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 28739
I20260811 16:37:38.538635 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/ts-1/wal/instance
I20260811 16:37:38.538805 25279 external_mini_cluster.cc:1428] Setting key f297c1db48f0796aabe63a4052be094e
WARNING: no policy specified for kudu/127.24.175.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab.
Entry for principal kudu/127.24.175.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab.
I20260811 16:37:38.561674 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.195:0
--local_ip_for_outbound_sockets=127.24.175.195
--webserver_interface=127.24.175.195
--webserver_port=0
--tserver_master_addrs=127.24.175.254:38335
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab
--principal=kudu/127.24.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:36159
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:37:38.641764 28970 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:37:38.641976 28970 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:37:38.642001 28970 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:37:38.643178 28970 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:37:38.643220 28970 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:37:38.643241 28970 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 16:37:38.643265 28970 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 16:37:38.643296 28970 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.195
I20260811 16:37:38.644847 28970 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:36159
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab
--principal=kudu/127.24.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.175.195
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.24.175.254:38335
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28970
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.195
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:37:38.645076 28970 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:37:38.645284 28970 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:37:38.650080 28980 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:38.650081 28979 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:37:38.650169 28970 server_base.cc:1034] running on GCE node
W20260811 16:37:38.650128 28983 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:37:38.650449 28970 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:37:38.650673 28970 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:37:38.651810 28970 hybrid_clock.cc:648] HybridClock initialized: now 1786466258651801 us; error 32 us; skew 500 ppm
Aug 11 16:37:38 dist-test-slave-zj8q krb5kdc[28293](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466258, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:37:38.654119 28970 init.cc:377] Logged in from keytab as kudu/127.24.175.195@KRBTEST.COM (short username kudu)
I20260811 16:37:38.654523 28970 webserver.cc:460] Webserver started at http://127.24.175.195:32943/ using document root <none> and password file <none>
I20260811 16:37:38.654719 28970 fs_manager.cc:359] Metadata directory not provided
I20260811 16:37:38.654775 28970 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:37:38.654898 28970 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:37:38.655959 28970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/ts-2/data/instance:
uuid: "e37cc4ca1b0d44579f8dd7fa986123d8"
format_stamp: "Formatted at 2026-08-11 16:37:38 on dist-test-slave-zj8q"
server_key: "0e88339cc7aedd949a20984e9c94e823"
server_key_iv: "b1ffd71ec06679bce24f70f2ea9c4e3e"
server_key_version: "encryptionkey@0"
I20260811 16:37:38.656279 28970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/ts-2/wal/instance:
uuid: "e37cc4ca1b0d44579f8dd7fa986123d8"
format_stamp: "Formatted at 2026-08-11 16:37:38 on dist-test-slave-zj8q"
server_key: "0e88339cc7aedd949a20984e9c94e823"
server_key_iv: "b1ffd71ec06679bce24f70f2ea9c4e3e"
server_key_version: "encryptionkey@0"
I20260811 16:37:38.657480 28970 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:37:38.658174 28996 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:38.658339 28970 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:37:38.658423 28970 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/ts-2/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/ts-2/wal
uuid: "e37cc4ca1b0d44579f8dd7fa986123d8"
format_stamp: "Formatted at 2026-08-11 16:37:38 on dist-test-slave-zj8q"
server_key: "0e88339cc7aedd949a20984e9c94e823"
server_key_iv: "b1ffd71ec06679bce24f70f2ea9c4e3e"
server_key_version: "encryptionkey@0"
I20260811 16:37:38.658483 28970 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:37:38.671370 28970 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:37:38.672942 28970 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:37:38.673064 28970 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:37:38.673494 28970 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:37:38.673535 28970 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:38.673561 28970 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:37:38.673579 28970 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 16:37:38 dist-test-slave-zj8q krb5kdc[28293](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466258, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.195@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:37:38.680269 28970 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.195:37023
I20260811 16:37:38.680433 29184 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.195:37023 every 8 connection(s)
I20260811 16:37:38.680655 28970 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
I20260811 16:37:38.683697 28455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:38.673930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.195:55049 (local address 127.24.175.254:38335)
0811 16:37:38.673995 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:38.673997 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:38.674144 (+ 147us) server_negotiation.cc:407] Connection header received
0811 16:37:38.674674 (+ 530us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:38.674676 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:38.674688 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:38.674754 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:38.675374 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:38.676187 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:38.677643 (+ 1456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:38.677945 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:38.678015 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:38.680662 (+ 2647us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:38.680664 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:38.680664 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:37:38.680673 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:38.682523 (+ 1850us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:38.682906 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:38.682907 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:38.682907 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:38.682954 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:38.683155 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:38.683155 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:38.683156 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:38.683256 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:38.683300 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:38.683542 (+ 242us) server_negotiation.cc:299] Negotiation successful
0811 16:37:38.683613 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 16:37:38.683843 29010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:38.673873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:38335 (local address 127.24.175.195:55049)
0811 16:37:38.674026 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:38.674065 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:38.674572 (+ 507us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:38.674838 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:38.674842 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:38.675103 (+ 261us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:37:38.675282 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:38.675286 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:38.676287 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:38.676289 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:38.677548 (+ 1259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:38.677552 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:38.678030 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:38.678031 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:38.678201 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:38.678822 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:37:38.678831 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:37:38.680551 (+ 1720us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:37:38.682594 (+ 2043us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:38.682600 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:38.682602 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:38.682843 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:38.682999 (+ 156us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:38.682999 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:38.683000 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:38.683112 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:38.683297 (+ 185us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:37:38.683301 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:37:38.683418 (+ 117us) client_negotiation.cc:769] Sending connection context
0811 16:37:38.683524 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 16:37:38.683646 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":89,"threads_started":1}
I20260811 16:37:38.684319 29185 heartbeater.cc:347] Connected to a master server at 127.24.175.254:38335
I20260811 16:37:38.684405 29185 heartbeater.cc:464] Registering TS with master...
I20260811 16:37:38.684571 29185 heartbeater.cc:511] Master 127.24.175.254:38335 requested a full tablet report, sending...
I20260811 16:37:38.684957 28366 ts_manager.cc:194] Registered new tserver with Master: e37cc4ca1b0d44579f8dd7fa986123d8 (127.24.175.195:37023)
I20260811 16:37:38.685441 28366 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.175.195@KRBTEST.COM'} at 127.24.175.195:55049
I20260811 16:37:38.685917 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 28970
I20260811 16:37:38.686025 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/ts-2/wal/instance
I20260811 16:37:38.686267 25279 external_mini_cluster.cc:1428] Setting key 24a219b6ed84f7beb00ab264b6bec209
I20260811 16:37:38.687095 25279 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 16:37:38.690953 28455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:38.685434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.195:36645 (local address 127.24.175.254:38335)
0811 16:37:38.685467 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:38.685469 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:38.685496 (+ 27us) server_negotiation.cc:407] Connection header received
0811 16:37:38.685514 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:38.685515 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:38.685535 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:38.685580 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:38.685913 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:38.686567 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:38.687481 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:38.687661 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:38.687711 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:38.688561 (+ 850us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:38.688562 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:38.688562 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:37:38.688568 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:38.689919 (+ 1351us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:38.690270 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:38.690270 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:38.690271 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:38.690332 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:38.690503 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:38.690504 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:38.690504 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:38.690629 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:38.690694 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:38.690830 (+ 136us) server_negotiation.cc:299] Negotiation successful
0811 16:37:38.690897 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260811 16:37:38.690980 29194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:38.685277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:38335 (local address 127.24.175.195:36645)
0811 16:37:38.685399 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:38.685410 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:38.685462 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:38.685592 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:38.685593 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:38.685742 (+ 149us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:37:38.685812 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:38.685814 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:38.686695 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:38.686696 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:38.687411 (+ 715us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:38.687414 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:38.687728 (+ 314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:38.687730 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:38.687804 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:38.688149 (+ 345us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:37:38.688154 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:37:38.688488 (+ 334us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:37:38.689996 (+ 1508us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:38.689997 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:38.689997 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:38.690198 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:38.690387 (+ 189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:38.690387 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:38.690388 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:38.690452 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:38.690686 (+ 234us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:37:38.690687 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:37:38.690733 (+ 46us) client_negotiation.cc:769] Sending connection context
0811 16:37:38.690803 (+ 70us) client_negotiation.cc:240] Negotiation successful
0811 16:37:38.690892 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":73,"threads_started":1}
Aug 11 16:37:38 dist-test-slave-zj8q krb5kdc[28293](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466258, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 16:37:38 dist-test-slave-zj8q krb5kdc[28293](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466258, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:37:38.710242 28455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:38.703873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55424 (local address 127.24.175.254:38335)
0811 16:37:38.703920 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:38.703922 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:38.703928 (+ 6us) server_negotiation.cc:407] Connection header received
0811 16:37:38.703961 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:38.703962 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:38.703970 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:38.704006 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:38.704520 (+ 514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:38.704988 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:38.705680 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:38.705854 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:38.705895 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:38.707823 (+ 1928us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:38.707825 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:38.707825 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:37:38.707832 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:38.708889 (+ 1057us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:38.709250 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:38.709251 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:38.709252 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:38.709316 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:38.709575 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:38.709576 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:38.709576 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:38.709685 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:38.709774 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:38.710033 (+ 259us) server_negotiation.cc:299] Negotiation successful
0811 16:37:38.710112 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 16:37:38.711539 28366 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55424:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:37:38.713032 28366 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:37:38.718838 29207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:38.714964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.193:40147 (local address 127.0.0.1:60166)
0811 16:37:38.715109 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:38.715269 (+ 160us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:38.715300 (+ 31us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:38.715660 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:38.715661 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:38.715663 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:37:38.715762 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:38.715764 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:38.716625 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:38.716626 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:38.717787 (+ 1161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:38.717790 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:38.718555 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:38.718556 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:38.718634 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:38.718647 (+ 13us) client_negotiation.cc:769] Sending connection context
0811 16:37:38.718710 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 16:37:38.718764 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"mutex_wait_us":23,"thread_start_us":45,"threads_started":1}
I20260811 16:37:38.718863 29212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:38.715157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60166 (local address 127.24.175.193:40147)
0811 16:37:38.715490 (+ 333us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:38.715493 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:38.715502 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:37:38.715534 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:38.715535 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:38.715548 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:38.715656 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:37:38.715845 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:38.716548 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:38.717878 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:38.718485 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:38.718548 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:38.718602 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:38.718737 (+ 135us) server_negotiation.cc:299] Negotiation successful
0811 16:37:38.718776 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":304,"thread_start_us":72,"threads_started":1}
I20260811 16:37:38.719192 29208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:38.714963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.194:38489 (local address 127.0.0.1:37094)
0811 16:37:38.715106 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:38.715141 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:38.715203 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:38.715635 (+ 432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:38.715639 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:38.715641 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:37:38.715749 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:38.715751 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:38.717013 (+ 1262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:38.717014 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:38.718066 (+ 1052us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:38.718069 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:38.718977 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:38.718979 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:38.719040 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:38.719045 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 16:37:38.719095 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 16:37:38.719132 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"mutex_wait_us":22,"thread_start_us":47,"threads_started":1}
I20260811 16:37:38.719316 29211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:38.714981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.195:37023 (local address 127.0.0.1:58278)
0811 16:37:38.715160 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:38.715168 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:38.715204 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:38.715927 (+ 723us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:38.715928 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:38.715930 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:37:38.715987 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:38.715989 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:38.717144 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:38.717145 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:38.718001 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:38.718004 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:38.719069 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:38.719070 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:38.719151 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:38.719156 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 16:37:38.719205 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 16:37:38.719247 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"mutex_wait_us":2,"thread_start_us":51,"threads_started":1}
I20260811 16:37:38.719470 29216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:38.715320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37094 (local address 127.24.175.194:38489)
0811 16:37:38.715484 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:38.715488 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:38.715496 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:37:38.715526 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:38.715527 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:38.715539 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:38.715599 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:37:38.715837 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:38.716927 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:38.718168 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:38.718853 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:38.718962 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:38.719023 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:38.719347 (+ 324us) server_negotiation.cc:299] Negotiation successful
0811 16:37:38.719391 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":84,"threads_started":1}
I20260811 16:37:38.719601 29213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:38.715184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58278 (local address 127.24.175.195:37023)
0811 16:37:38.715771 (+ 587us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:38.715775 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:38.715784 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:37:38.715817 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:38.715819 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:38.715833 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:38.716053 (+ 220us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:37:38.716107 (+ 54us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:38.717077 (+ 970us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:38.718074 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:38.718846 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:38.719065 (+ 219us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:38.719120 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:38.719472 (+ 352us) server_negotiation.cc:299] Negotiation successful
0811 16:37:38.719514 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":553,"thread_start_us":65,"threads_started":1}
I20260811 16:37:38.719662 28608 tablet_service.cc:1467] Processing CreateTablet for tablet ab6fd402192d43ac88d93b513b4f5bdf (DEFAULT_TABLE table=test-table [id=386c1db5fce94cc5a358bd0e166820f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:37:38.720067 28608 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab6fd402192d43ac88d93b513b4f5bdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:37:38.720039 28854 tablet_service.cc:1467] Processing CreateTablet for tablet ab6fd402192d43ac88d93b513b4f5bdf (DEFAULT_TABLE table=test-table [id=386c1db5fce94cc5a358bd0e166820f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:37:38.720294 28854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab6fd402192d43ac88d93b513b4f5bdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:37:38.720219 29083 tablet_service.cc:1467] Processing CreateTablet for tablet ab6fd402192d43ac88d93b513b4f5bdf (DEFAULT_TABLE table=test-table [id=386c1db5fce94cc5a358bd0e166820f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:37:38.720515 29083 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab6fd402192d43ac88d93b513b4f5bdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:37:38.722921 29219 tablet_bootstrap.cc:492] T ab6fd402192d43ac88d93b513b4f5bdf P c613eb3a1d434d34b84e77215cfba948: Bootstrap starting.
I20260811 16:37:38.723521 29219 tablet_bootstrap.cc:654] T ab6fd402192d43ac88d93b513b4f5bdf P c613eb3a1d434d34b84e77215cfba948: Neither blocks nor log segments found. Creating new log.
I20260811 16:37:38.723675 29220 tablet_bootstrap.cc:492] T ab6fd402192d43ac88d93b513b4f5bdf P e37cc4ca1b0d44579f8dd7fa986123d8: Bootstrap starting.
I20260811 16:37:38.723851 29219 log.cc:824] T ab6fd402192d43ac88d93b513b4f5bdf P c613eb3a1d434d34b84e77215cfba948: Log is configured to *not* fsync() on all Append() calls
I20260811 16:37:38.724421 29223 tablet_bootstrap.cc:492] T ab6fd402192d43ac88d93b513b4f5bdf P e4cb0de34ebf4e7a9c6caf56e5f1c4da: Bootstrap starting.
I20260811 16:37:38.724512 29220 tablet_bootstrap.cc:654] T ab6fd402192d43ac88d93b513b4f5bdf P e37cc4ca1b0d44579f8dd7fa986123d8: Neither blocks nor log segments found. Creating new log.
I20260811 16:37:38.724658 29219 tablet_bootstrap.cc:492] T ab6fd402192d43ac88d93b513b4f5bdf P c613eb3a1d434d34b84e77215cfba948: No bootstrap required, opened a new log
I20260811 16:37:38.724728 29219 ts_tablet_manager.cc:1397] T ab6fd402192d43ac88d93b513b4f5bdf P c613eb3a1d434d34b84e77215cfba948: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 16:37:38.724845 29220 log.cc:824] T ab6fd402192d43ac88d93b513b4f5bdf P e37cc4ca1b0d44579f8dd7fa986123d8: Log is configured to *not* fsync() on all Append() calls
I20260811 16:37:38.725020 29223 tablet_bootstrap.cc:654] T ab6fd402192d43ac88d93b513b4f5bdf P e4cb0de34ebf4e7a9c6caf56e5f1c4da: Neither blocks nor log segments found. Creating new log.
I20260811 16:37:38.725348 29223 log.cc:824] T ab6fd402192d43ac88d93b513b4f5bdf P e4cb0de34ebf4e7a9c6caf56e5f1c4da: Log is configured to *not* fsync() on all Append() calls
I20260811 16:37:38.725683 29220 tablet_bootstrap.cc:492] T ab6fd402192d43ac88d93b513b4f5bdf P e37cc4ca1b0d44579f8dd7fa986123d8: No bootstrap required, opened a new log
I20260811 16:37:38.725744 29220 ts_tablet_manager.cc:1397] T ab6fd402192d43ac88d93b513b4f5bdf P e37cc4ca1b0d44579f8dd7fa986123d8: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:37:38.726119 29223 tablet_bootstrap.cc:492] T ab6fd402192d43ac88d93b513b4f5bdf P e4cb0de34ebf4e7a9c6caf56e5f1c4da: No bootstrap required, opened a new log
I20260811 16:37:38.726235 29223 ts_tablet_manager.cc:1397] T ab6fd402192d43ac88d93b513b4f5bdf P e4cb0de34ebf4e7a9c6caf56e5f1c4da: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 16:37:38.726517 29219 raft_consensus.cc:348] T ab6fd402192d43ac88d93b513b4f5bdf P c613eb3a1d434d34b84e77215cfba948 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c613eb3a1d434d34b84e77215cfba948" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38489 } } peers { permanent_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40147 } } peers { permanent_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 37023 } }
I20260811 16:37:38.726646 29219 raft_consensus.cc:374] T ab6fd402192d43ac88d93b513b4f5bdf P c613eb3a1d434d34b84e77215cfba948 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:37:38.726677 29219 raft_consensus.cc:729] T ab6fd402192d43ac88d93b513b4f5bdf P c613eb3a1d434d34b84e77215cfba948 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c613eb3a1d434d34b84e77215cfba948, State: Initialized, Role: FOLLOWER
I20260811 16:37:38.726790 29219 consensus_queue.cc:260] T ab6fd402192d43ac88d93b513b4f5bdf P c613eb3a1d434d34b84e77215cfba948 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c613eb3a1d434d34b84e77215cfba948" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38489 } } peers { permanent_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40147 } } peers { permanent_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 37023 } }
I20260811 16:37:38.727049 29219 ts_tablet_manager.cc:1428] T ab6fd402192d43ac88d93b513b4f5bdf P c613eb3a1d434d34b84e77215cfba948: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 16:37:38.727057 28951 heartbeater.cc:503] Master 127.24.175.254:38335 was elected leader, sending a full tablet report...
I20260811 16:37:38.727722 29220 raft_consensus.cc:348] T ab6fd402192d43ac88d93b513b4f5bdf P e37cc4ca1b0d44579f8dd7fa986123d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c613eb3a1d434d34b84e77215cfba948" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38489 } } peers { permanent_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40147 } } peers { permanent_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 37023 } }
I20260811 16:37:38.727886 29220 raft_consensus.cc:374] T ab6fd402192d43ac88d93b513b4f5bdf P e37cc4ca1b0d44579f8dd7fa986123d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:37:38.727924 29220 raft_consensus.cc:729] T ab6fd402192d43ac88d93b513b4f5bdf P e37cc4ca1b0d44579f8dd7fa986123d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e37cc4ca1b0d44579f8dd7fa986123d8, State: Initialized, Role: FOLLOWER
I20260811 16:37:38.728036 29220 consensus_queue.cc:260] T ab6fd402192d43ac88d93b513b4f5bdf P e37cc4ca1b0d44579f8dd7fa986123d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c613eb3a1d434d34b84e77215cfba948" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38489 } } peers { permanent_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40147 } } peers { permanent_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 37023 } }
I20260811 16:37:38.728120 29223 raft_consensus.cc:348] T ab6fd402192d43ac88d93b513b4f5bdf P e4cb0de34ebf4e7a9c6caf56e5f1c4da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c613eb3a1d434d34b84e77215cfba948" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38489 } } peers { permanent_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40147 } } peers { permanent_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 37023 } }
I20260811 16:37:38.728273 29223 raft_consensus.cc:374] T ab6fd402192d43ac88d93b513b4f5bdf P e4cb0de34ebf4e7a9c6caf56e5f1c4da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:37:38.728305 29220 ts_tablet_manager.cc:1428] T ab6fd402192d43ac88d93b513b4f5bdf P e37cc4ca1b0d44579f8dd7fa986123d8: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 16:37:38.728317 29223 raft_consensus.cc:729] T ab6fd402192d43ac88d93b513b4f5bdf P e4cb0de34ebf4e7a9c6caf56e5f1c4da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4cb0de34ebf4e7a9c6caf56e5f1c4da, State: Initialized, Role: FOLLOWER
I20260811 16:37:38.728336 29185 heartbeater.cc:503] Master 127.24.175.254:38335 was elected leader, sending a full tablet report...
I20260811 16:37:38.728420 29223 consensus_queue.cc:260] T ab6fd402192d43ac88d93b513b4f5bdf P e4cb0de34ebf4e7a9c6caf56e5f1c4da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c613eb3a1d434d34b84e77215cfba948" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38489 } } peers { permanent_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40147 } } peers { permanent_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 37023 } }
I20260811 16:37:38.728660 29223 ts_tablet_manager.cc:1428] T ab6fd402192d43ac88d93b513b4f5bdf P e4cb0de34ebf4e7a9c6caf56e5f1c4da: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 16:37:38.728780 28724 heartbeater.cc:503] Master 127.24.175.254:38335 was elected leader, sending a full tablet report...
W20260811 16:37:38.781255 28952 tablet.cc:2369] T ab6fd402192d43ac88d93b513b4f5bdf P c613eb3a1d434d34b84e77215cfba948: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 16:37:38.871846 28726 tablet.cc:2369] T ab6fd402192d43ac88d93b513b4f5bdf P e4cb0de34ebf4e7a9c6caf56e5f1c4da: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:37:38.920711 29231 raft_consensus.cc:482] T ab6fd402192d43ac88d93b513b4f5bdf P e37cc4ca1b0d44579f8dd7fa986123d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:37:38.920856 29231 raft_consensus.cc:504] T ab6fd402192d43ac88d93b513b4f5bdf P e37cc4ca1b0d44579f8dd7fa986123d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c613eb3a1d434d34b84e77215cfba948" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38489 } } peers { permanent_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40147 } } peers { permanent_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 37023 } }
I20260811 16:37:38.921228 29231 leader_election.cc:288] T ab6fd402192d43ac88d93b513b4f5bdf P e37cc4ca1b0d44579f8dd7fa986123d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c613eb3a1d434d34b84e77215cfba948 (127.24.175.194:38489), e4cb0de34ebf4e7a9c6caf56e5f1c4da (127.24.175.193:40147)
I20260811 16:37:38.923978 29212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:38.921454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.195:51695 (local address 127.24.175.193:40147)
0811 16:37:38.921495 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:38.921497 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:38.921510 (+ 13us) server_negotiation.cc:407] Connection header received
0811 16:37:38.921596 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:38.921596 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:38.921607 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:38.921673 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:37:38.921830 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:38.922416 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:38.923325 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:38.923665 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:38.923716 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:38.923723 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:38.923871 (+ 148us) server_negotiation.cc:299] Negotiation successful
0811 16:37:38.923909 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 16:37:38.923997 29216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:38.921454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.195:56005 (local address 127.24.175.194:38489)
0811 16:37:38.921495 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:38.921498 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:38.921680 (+ 182us) server_negotiation.cc:407] Connection header received
0811 16:37:38.921732 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:38.921733 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:38.921744 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:38.921793 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:37:38.921948 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:38.922448 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:38.923332 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:38.923697 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:38.923763 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:38.923772 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:38.923904 (+ 132us) server_negotiation.cc:299] Negotiation successful
0811 16:37:38.923940 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 16:37:38.923975 29010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:38.921414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.193:40147 (local address 127.24.175.195:51695)
0811 16:37:38.921472 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:38.921482 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:38.921528 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:38.921689 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:38.921690 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:38.921692 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:37:38.921769 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:38.921771 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:38.922486 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:38.922487 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:38.923242 (+ 755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:38.923244 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:38.923731 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:38.923732 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:38.923809 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:38.923813 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:37:38.923857 (+ 44us) client_negotiation.cc:240] Negotiation successful
0811 16:37:38.923891 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260811 16:37:38.924238 29235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:38.921416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.194:38489 (local address 127.24.175.195:56005)
0811 16:37:38.921588 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:38.921599 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:38.921677 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:38.921799 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:38.921800 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:38.921801 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:37:38.921882 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:38.921884 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:38.922519 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:38.922520 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:38.923243 (+ 723us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:38.923245 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:38.923770 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:38.923771 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:38.923833 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:38.923836 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:37:38.923887 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 16:37:38.923920 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"mutex_wait_us":15,"thread_start_us":99,"threads_started":1}
I20260811 16:37:38.924350 28648 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab6fd402192d43ac88d93b513b4f5bdf" candidate_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" is_pre_election: true
I20260811 16:37:38.924501 28648 raft_consensus.cc:2454] T ab6fd402192d43ac88d93b513b4f5bdf P e4cb0de34ebf4e7a9c6caf56e5f1c4da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37cc4ca1b0d44579f8dd7fa986123d8 in term 0.
I20260811 16:37:38.924551 28887 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab6fd402192d43ac88d93b513b4f5bdf" candidate_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c613eb3a1d434d34b84e77215cfba948" is_pre_election: true
I20260811 16:37:38.924696 28887 raft_consensus.cc:2454] T ab6fd402192d43ac88d93b513b4f5bdf P c613eb3a1d434d34b84e77215cfba948 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37cc4ca1b0d44579f8dd7fa986123d8 in term 0.
I20260811 16:37:38.924737 28999 leader_election.cc:302] T ab6fd402192d43ac88d93b513b4f5bdf P e37cc4ca1b0d44579f8dd7fa986123d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e37cc4ca1b0d44579f8dd7fa986123d8, e4cb0de34ebf4e7a9c6caf56e5f1c4da; no voters:
I20260811 16:37:38.924933 29231 raft_consensus.cc:2781] T ab6fd402192d43ac88d93b513b4f5bdf P e37cc4ca1b0d44579f8dd7fa986123d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:37:38.924983 29231 raft_consensus.cc:482] T ab6fd402192d43ac88d93b513b4f5bdf P e37cc4ca1b0d44579f8dd7fa986123d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:37:38.925004 29231 raft_consensus.cc:3037] T ab6fd402192d43ac88d93b513b4f5bdf P e37cc4ca1b0d44579f8dd7fa986123d8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:37:38.925700 29231 raft_consensus.cc:504] T ab6fd402192d43ac88d93b513b4f5bdf P e37cc4ca1b0d44579f8dd7fa986123d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c613eb3a1d434d34b84e77215cfba948" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38489 } } peers { permanent_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40147 } } peers { permanent_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 37023 } }
I20260811 16:37:38.925828 29231 leader_election.cc:288] T ab6fd402192d43ac88d93b513b4f5bdf P e37cc4ca1b0d44579f8dd7fa986123d8 [CANDIDATE]: Term 1 election: Requested vote from peers c613eb3a1d434d34b84e77215cfba948 (127.24.175.194:38489), e4cb0de34ebf4e7a9c6caf56e5f1c4da (127.24.175.193:40147)
I20260811 16:37:38.925974 28887 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab6fd402192d43ac88d93b513b4f5bdf" candidate_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c613eb3a1d434d34b84e77215cfba948"
I20260811 16:37:38.925985 28648 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab6fd402192d43ac88d93b513b4f5bdf" candidate_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da"
I20260811 16:37:38.926045 28887 raft_consensus.cc:3037] T ab6fd402192d43ac88d93b513b4f5bdf P c613eb3a1d434d34b84e77215cfba948 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:37:38.926056 28648 raft_consensus.cc:3037] T ab6fd402192d43ac88d93b513b4f5bdf P e4cb0de34ebf4e7a9c6caf56e5f1c4da [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:37:38.926718 28887 raft_consensus.cc:2454] T ab6fd402192d43ac88d93b513b4f5bdf P c613eb3a1d434d34b84e77215cfba948 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37cc4ca1b0d44579f8dd7fa986123d8 in term 1.
I20260811 16:37:38.926772 28648 raft_consensus.cc:2454] T ab6fd402192d43ac88d93b513b4f5bdf P e4cb0de34ebf4e7a9c6caf56e5f1c4da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37cc4ca1b0d44579f8dd7fa986123d8 in term 1.
I20260811 16:37:38.927186 29001 leader_election.cc:302] T ab6fd402192d43ac88d93b513b4f5bdf P e37cc4ca1b0d44579f8dd7fa986123d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c613eb3a1d434d34b84e77215cfba948, e37cc4ca1b0d44579f8dd7fa986123d8; no voters:
I20260811 16:37:38.927320 29231 raft_consensus.cc:2781] T ab6fd402192d43ac88d93b513b4f5bdf P e37cc4ca1b0d44579f8dd7fa986123d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:37:38.927450 29231 raft_consensus.cc:686] T ab6fd402192d43ac88d93b513b4f5bdf P e37cc4ca1b0d44579f8dd7fa986123d8 [term 1 LEADER]: Becoming Leader. State: Replica: e37cc4ca1b0d44579f8dd7fa986123d8, State: Running, Role: LEADER
I20260811 16:37:38.927534 29231 consensus_queue.cc:237] T ab6fd402192d43ac88d93b513b4f5bdf P e37cc4ca1b0d44579f8dd7fa986123d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c613eb3a1d434d34b84e77215cfba948" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38489 } } peers { permanent_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40147 } } peers { permanent_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 37023 } }
I20260811 16:37:38.928318 28367 catalog_manager.cc:5495] T ab6fd402192d43ac88d93b513b4f5bdf P e37cc4ca1b0d44579f8dd7fa986123d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to e37cc4ca1b0d44579f8dd7fa986123d8 (127.24.175.195). New cstate: current_term: 1 leader_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c613eb3a1d434d34b84e77215cfba948" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 37023 } health_report { overall_health: HEALTHY } } }
W20260811 16:37:38.931278 29186 tablet.cc:2369] T ab6fd402192d43ac88d93b513b4f5bdf P e37cc4ca1b0d44579f8dd7fa986123d8: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 11 16:37:38 dist-test-slave-zj8q krb5kdc[28293](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466258, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.254@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:37:38.965041 29252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:38.958706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:38335 (local address 127.0.0.1:55438)
0811 16:37:38.958868 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:38.958877 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:38.958937 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:38.959056 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:38.959057 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:38.959370 (+ 313us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:37:38.959417 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:38.959420 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:38.960031 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:38.960032 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:38.960590 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:38.960592 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:38.960912 (+ 320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:38.960913 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:38.960966 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:38.961419 (+ 453us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:37:38.961424 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:37:38.962747 (+ 1323us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:37:38.964075 (+ 1328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:38.964082 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:38.964085 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:38.964268 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:38.964430 (+ 162us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:38.964431 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:38.964431 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:38.964487 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:38.964681 (+ 194us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:37:38.964689 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:37:38.964759 (+ 70us) client_negotiation.cc:769] Sending connection context
0811 16:37:38.964817 (+ 58us) client_negotiation.cc:240] Negotiation successful
0811 16:37:38.964933 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":96,"threads_started":1}
I20260811 16:37:38.965090 28455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:38.958766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55438 (local address 127.24.175.254:38335)
0811 16:37:38.958821 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:38.958824 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:38.958929 (+ 105us) server_negotiation.cc:407] Connection header received
0811 16:37:38.958982 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:38.958982 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:38.958992 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:38.959035 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:38.959492 (+ 457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:38.959966 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:38.960657 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:38.960857 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:38.960909 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:38.962820 (+ 1911us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:38.962821 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:38.962822 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:37:38.962829 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:38.964005 (+ 1176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:38.964328 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:38.964329 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:38.964330 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:38.964379 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:38.964533 (+ 154us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:38.964534 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:38.964534 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:38.964631 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:38.964685 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:38.964848 (+ 163us) server_negotiation.cc:299] Negotiation successful
0811 16:37:38.964992 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":82,"server-negotiator.queue_time_us":31}
I20260811 16:37:38.966962 28367 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:55438:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 16:37:38.967159 28367 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:37:38.968560 28854 tablet_service.cc:1467] Processing CreateTablet for tablet 5fd310a2bf4545c38c36451b1013a8d3 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=64cabe4f3d0844cdaf1101fb75a084ab]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 16:37:38.968592 29083 tablet_service.cc:1467] Processing CreateTablet for tablet 5fd310a2bf4545c38c36451b1013a8d3 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=64cabe4f3d0844cdaf1101fb75a084ab]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 16:37:38.968559 28608 tablet_service.cc:1467] Processing CreateTablet for tablet 5fd310a2bf4545c38c36451b1013a8d3 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=64cabe4f3d0844cdaf1101fb75a084ab]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 16:37:38.968719 28854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5fd310a2bf4545c38c36451b1013a8d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:37:38.968747 29083 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5fd310a2bf4545c38c36451b1013a8d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:37:38.968748 28608 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5fd310a2bf4545c38c36451b1013a8d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:37:38.969838 29219 tablet_bootstrap.cc:492] T 5fd310a2bf4545c38c36451b1013a8d3 P c613eb3a1d434d34b84e77215cfba948: Bootstrap starting.
I20260811 16:37:38.970213 29223 tablet_bootstrap.cc:492] T 5fd310a2bf4545c38c36451b1013a8d3 P e4cb0de34ebf4e7a9c6caf56e5f1c4da: Bootstrap starting.
I20260811 16:37:38.970489 29219 tablet_bootstrap.cc:654] T 5fd310a2bf4545c38c36451b1013a8d3 P c613eb3a1d434d34b84e77215cfba948: Neither blocks nor log segments found. Creating new log.
I20260811 16:37:38.970507 29220 tablet_bootstrap.cc:492] T 5fd310a2bf4545c38c36451b1013a8d3 P e37cc4ca1b0d44579f8dd7fa986123d8: Bootstrap starting.
I20260811 16:37:38.970553 29223 tablet_bootstrap.cc:654] T 5fd310a2bf4545c38c36451b1013a8d3 P e4cb0de34ebf4e7a9c6caf56e5f1c4da: Neither blocks nor log segments found. Creating new log.
I20260811 16:37:38.970908 29220 tablet_bootstrap.cc:654] T 5fd310a2bf4545c38c36451b1013a8d3 P e37cc4ca1b0d44579f8dd7fa986123d8: Neither blocks nor log segments found. Creating new log.
I20260811 16:37:38.971104 29223 tablet_bootstrap.cc:492] T 5fd310a2bf4545c38c36451b1013a8d3 P e4cb0de34ebf4e7a9c6caf56e5f1c4da: No bootstrap required, opened a new log
I20260811 16:37:38.971158 29223 ts_tablet_manager.cc:1397] T 5fd310a2bf4545c38c36451b1013a8d3 P e4cb0de34ebf4e7a9c6caf56e5f1c4da: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 16:37:38.971187 29219 tablet_bootstrap.cc:492] T 5fd310a2bf4545c38c36451b1013a8d3 P c613eb3a1d434d34b84e77215cfba948: No bootstrap required, opened a new log
I20260811 16:37:38.971233 29219 ts_tablet_manager.cc:1397] T 5fd310a2bf4545c38c36451b1013a8d3 P c613eb3a1d434d34b84e77215cfba948: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 16:37:38.971324 29223 raft_consensus.cc:348] T 5fd310a2bf4545c38c36451b1013a8d3 P e4cb0de34ebf4e7a9c6caf56e5f1c4da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40147 } } peers { permanent_uuid: "c613eb3a1d434d34b84e77215cfba948" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38489 } } peers { permanent_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 37023 } }
I20260811 16:37:38.971400 29223 raft_consensus.cc:374] T 5fd310a2bf4545c38c36451b1013a8d3 P e4cb0de34ebf4e7a9c6caf56e5f1c4da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:37:38.971421 29223 raft_consensus.cc:729] T 5fd310a2bf4545c38c36451b1013a8d3 P e4cb0de34ebf4e7a9c6caf56e5f1c4da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4cb0de34ebf4e7a9c6caf56e5f1c4da, State: Initialized, Role: FOLLOWER
I20260811 16:37:38.971371 29219 raft_consensus.cc:348] T 5fd310a2bf4545c38c36451b1013a8d3 P c613eb3a1d434d34b84e77215cfba948 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40147 } } peers { permanent_uuid: "c613eb3a1d434d34b84e77215cfba948" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38489 } } peers { permanent_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 37023 } }
I20260811 16:37:38.971444 29219 raft_consensus.cc:374] T 5fd310a2bf4545c38c36451b1013a8d3 P c613eb3a1d434d34b84e77215cfba948 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:37:38.971472 29219 raft_consensus.cc:729] T 5fd310a2bf4545c38c36451b1013a8d3 P c613eb3a1d434d34b84e77215cfba948 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c613eb3a1d434d34b84e77215cfba948, State: Initialized, Role: FOLLOWER
I20260811 16:37:38.971472 29223 consensus_queue.cc:260] T 5fd310a2bf4545c38c36451b1013a8d3 P e4cb0de34ebf4e7a9c6caf56e5f1c4da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40147 } } peers { permanent_uuid: "c613eb3a1d434d34b84e77215cfba948" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38489 } } peers { permanent_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 37023 } }
I20260811 16:37:38.971517 29219 consensus_queue.cc:260] T 5fd310a2bf4545c38c36451b1013a8d3 P c613eb3a1d434d34b84e77215cfba948 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40147 } } peers { permanent_uuid: "c613eb3a1d434d34b84e77215cfba948" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38489 } } peers { permanent_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 37023 } }
I20260811 16:37:38.971580 29223 ts_tablet_manager.cc:1428] T 5fd310a2bf4545c38c36451b1013a8d3 P e4cb0de34ebf4e7a9c6caf56e5f1c4da: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:38.971599 29219 ts_tablet_manager.cc:1428] T 5fd310a2bf4545c38c36451b1013a8d3 P c613eb3a1d434d34b84e77215cfba948: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:38.971642 29233 tablet_replica.cc:439] T 5fd310a2bf4545c38c36451b1013a8d3 P e4cb0de34ebf4e7a9c6caf56e5f1c4da: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40147 } } peers { permanent_uuid: "c613eb3a1d434d34b84e77215cfba948" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38489 } } peers { permanent_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 37023 } } }
I20260811 16:37:38.971735 29233 tablet_replica.cc:442] T 5fd310a2bf4545c38c36451b1013a8d3 P e4cb0de34ebf4e7a9c6caf56e5f1c4da: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 16:37:38.971742 29230 tablet_replica.cc:439] T 5fd310a2bf4545c38c36451b1013a8d3 P c613eb3a1d434d34b84e77215cfba948: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40147 } } peers { permanent_uuid: "c613eb3a1d434d34b84e77215cfba948" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38489 } } peers { permanent_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 37023 } } }
I20260811 16:37:38.971818 29230 tablet_replica.cc:442] T 5fd310a2bf4545c38c36451b1013a8d3 P c613eb3a1d434d34b84e77215cfba948: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 16:37:38.972201 29220 tablet_bootstrap.cc:492] T 5fd310a2bf4545c38c36451b1013a8d3 P e37cc4ca1b0d44579f8dd7fa986123d8: No bootstrap required, opened a new log
I20260811 16:37:38.972256 29220 ts_tablet_manager.cc:1397] T 5fd310a2bf4545c38c36451b1013a8d3 P e37cc4ca1b0d44579f8dd7fa986123d8: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 16:37:38.972405 29220 raft_consensus.cc:348] T 5fd310a2bf4545c38c36451b1013a8d3 P e37cc4ca1b0d44579f8dd7fa986123d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40147 } } peers { permanent_uuid: "c613eb3a1d434d34b84e77215cfba948" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38489 } } peers { permanent_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 37023 } }
I20260811 16:37:38.972492 29220 raft_consensus.cc:374] T 5fd310a2bf4545c38c36451b1013a8d3 P e37cc4ca1b0d44579f8dd7fa986123d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:37:38.972512 29220 raft_consensus.cc:729] T 5fd310a2bf4545c38c36451b1013a8d3 P e37cc4ca1b0d44579f8dd7fa986123d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e37cc4ca1b0d44579f8dd7fa986123d8, State: Initialized, Role: FOLLOWER
I20260811 16:37:38.972554 29220 consensus_queue.cc:260] T 5fd310a2bf4545c38c36451b1013a8d3 P e37cc4ca1b0d44579f8dd7fa986123d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40147 } } peers { permanent_uuid: "c613eb3a1d434d34b84e77215cfba948" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38489 } } peers { permanent_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 37023 } }
I20260811 16:37:38.972648 29220 ts_tablet_manager.cc:1428] T 5fd310a2bf4545c38c36451b1013a8d3 P e37cc4ca1b0d44579f8dd7fa986123d8: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:38.972718 29231 tablet_replica.cc:439] T 5fd310a2bf4545c38c36451b1013a8d3 P e37cc4ca1b0d44579f8dd7fa986123d8: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40147 } } peers { permanent_uuid: "c613eb3a1d434d34b84e77215cfba948" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38489 } } peers { permanent_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 37023 } } }
I20260811 16:37:38.972801 29231 tablet_replica.cc:442] T 5fd310a2bf4545c38c36451b1013a8d3 P e37cc4ca1b0d44579f8dd7fa986123d8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 16:37:39.201189 29231 raft_consensus.cc:482] T 5fd310a2bf4545c38c36451b1013a8d3 P e37cc4ca1b0d44579f8dd7fa986123d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:37:39.201282 29231 raft_consensus.cc:504] T 5fd310a2bf4545c38c36451b1013a8d3 P e37cc4ca1b0d44579f8dd7fa986123d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40147 } } peers { permanent_uuid: "c613eb3a1d434d34b84e77215cfba948" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38489 } } peers { permanent_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 37023 } }
I20260811 16:37:39.201439 29231 leader_election.cc:288] T 5fd310a2bf4545c38c36451b1013a8d3 P e37cc4ca1b0d44579f8dd7fa986123d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4cb0de34ebf4e7a9c6caf56e5f1c4da (127.24.175.193:40147), c613eb3a1d434d34b84e77215cfba948 (127.24.175.194:38489)
I20260811 16:37:39.201646 28648 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fd310a2bf4545c38c36451b1013a8d3" candidate_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" is_pre_election: true
I20260811 16:37:39.201653 28887 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fd310a2bf4545c38c36451b1013a8d3" candidate_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c613eb3a1d434d34b84e77215cfba948" is_pre_election: true
I20260811 16:37:39.201746 28887 raft_consensus.cc:2454] T 5fd310a2bf4545c38c36451b1013a8d3 P c613eb3a1d434d34b84e77215cfba948 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37cc4ca1b0d44579f8dd7fa986123d8 in term 0.
I20260811 16:37:39.201742 28648 raft_consensus.cc:2454] T 5fd310a2bf4545c38c36451b1013a8d3 P e4cb0de34ebf4e7a9c6caf56e5f1c4da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37cc4ca1b0d44579f8dd7fa986123d8 in term 0.
I20260811 16:37:39.201876 29001 leader_election.cc:302] T 5fd310a2bf4545c38c36451b1013a8d3 P e37cc4ca1b0d44579f8dd7fa986123d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c613eb3a1d434d34b84e77215cfba948, e37cc4ca1b0d44579f8dd7fa986123d8; no voters:
I20260811 16:37:39.201990 29231 raft_consensus.cc:2781] T 5fd310a2bf4545c38c36451b1013a8d3 P e37cc4ca1b0d44579f8dd7fa986123d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:37:39.202039 29231 raft_consensus.cc:482] T 5fd310a2bf4545c38c36451b1013a8d3 P e37cc4ca1b0d44579f8dd7fa986123d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:37:39.202054 29231 raft_consensus.cc:3037] T 5fd310a2bf4545c38c36451b1013a8d3 P e37cc4ca1b0d44579f8dd7fa986123d8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:37:39.202773 29231 raft_consensus.cc:504] T 5fd310a2bf4545c38c36451b1013a8d3 P e37cc4ca1b0d44579f8dd7fa986123d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40147 } } peers { permanent_uuid: "c613eb3a1d434d34b84e77215cfba948" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38489 } } peers { permanent_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 37023 } }
I20260811 16:37:39.202894 29231 leader_election.cc:288] T 5fd310a2bf4545c38c36451b1013a8d3 P e37cc4ca1b0d44579f8dd7fa986123d8 [CANDIDATE]: Term 1 election: Requested vote from peers e4cb0de34ebf4e7a9c6caf56e5f1c4da (127.24.175.193:40147), c613eb3a1d434d34b84e77215cfba948 (127.24.175.194:38489)
I20260811 16:37:39.203068 28648 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fd310a2bf4545c38c36451b1013a8d3" candidate_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da"
I20260811 16:37:39.203107 28887 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fd310a2bf4545c38c36451b1013a8d3" candidate_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c613eb3a1d434d34b84e77215cfba948"
I20260811 16:37:39.203164 28648 raft_consensus.cc:3037] T 5fd310a2bf4545c38c36451b1013a8d3 P e4cb0de34ebf4e7a9c6caf56e5f1c4da [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:37:39.203177 28887 raft_consensus.cc:3037] T 5fd310a2bf4545c38c36451b1013a8d3 P c613eb3a1d434d34b84e77215cfba948 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:37:39.203806 28648 raft_consensus.cc:2454] T 5fd310a2bf4545c38c36451b1013a8d3 P e4cb0de34ebf4e7a9c6caf56e5f1c4da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37cc4ca1b0d44579f8dd7fa986123d8 in term 1.
I20260811 16:37:39.203832 28887 raft_consensus.cc:2454] T 5fd310a2bf4545c38c36451b1013a8d3 P c613eb3a1d434d34b84e77215cfba948 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37cc4ca1b0d44579f8dd7fa986123d8 in term 1.
I20260811 16:37:39.203976 28999 leader_election.cc:302] T 5fd310a2bf4545c38c36451b1013a8d3 P e37cc4ca1b0d44579f8dd7fa986123d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e37cc4ca1b0d44579f8dd7fa986123d8, e4cb0de34ebf4e7a9c6caf56e5f1c4da; no voters:
I20260811 16:37:39.204078 29231 raft_consensus.cc:2781] T 5fd310a2bf4545c38c36451b1013a8d3 P e37cc4ca1b0d44579f8dd7fa986123d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:37:39.204141 29231 raft_consensus.cc:686] T 5fd310a2bf4545c38c36451b1013a8d3 P e37cc4ca1b0d44579f8dd7fa986123d8 [term 1 LEADER]: Becoming Leader. State: Replica: e37cc4ca1b0d44579f8dd7fa986123d8, State: Running, Role: LEADER
I20260811 16:37:39.204193 29231 consensus_queue.cc:237] T 5fd310a2bf4545c38c36451b1013a8d3 P e37cc4ca1b0d44579f8dd7fa986123d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40147 } } peers { permanent_uuid: "c613eb3a1d434d34b84e77215cfba948" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38489 } } peers { permanent_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 37023 } }
I20260811 16:37:39.204459 29236 tablet_replica.cc:439] T 5fd310a2bf4545c38c36451b1013a8d3 P e37cc4ca1b0d44579f8dd7fa986123d8: TxnStatusTablet state changed. Reason: New leader e37cc4ca1b0d44579f8dd7fa986123d8. Latest consensus state: current_term: 1 leader_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40147 } } peers { permanent_uuid: "c613eb3a1d434d34b84e77215cfba948" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38489 } } peers { permanent_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 37023 } } }
I20260811 16:37:39.204543 29236 tablet_replica.cc:442] T 5fd310a2bf4545c38c36451b1013a8d3 P e37cc4ca1b0d44579f8dd7fa986123d8: This TxnStatusTablet replica's current role is: LEADER
I20260811 16:37:39.204715 29258 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 16:37:39.204859 29258 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 16:37:39.204891 28367 catalog_manager.cc:5495] T 5fd310a2bf4545c38c36451b1013a8d3 P e37cc4ca1b0d44579f8dd7fa986123d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to e37cc4ca1b0d44579f8dd7fa986123d8 (127.24.175.195). New cstate: current_term: 1 leader_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c613eb3a1d434d34b84e77215cfba948" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 37023 } health_report { overall_health: HEALTHY } } }
I20260811 16:37:39.253947 29252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:39.251202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.195:37023 (local address 127.0.0.1:58280)
0811 16:37:39.251281 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:39.251293 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:39.251340 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:39.251677 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:39.251678 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:39.251680 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 16:37:39.251743 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:39.251745 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:39.252376 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:39.252377 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:39.252954 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:39.252956 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:39.253432 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:39.253433 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:39.253500 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:39.253514 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 16:37:39.253767 (+ 253us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 16:37:39.253777 (+ 10us) client_negotiation.cc:769] Sending connection context
0811 16:37:39.253824 (+ 47us) client_negotiation.cc:240] Negotiation successful
0811 16:37:39.253877 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260811 16:37:39.253957 29264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:39.251416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58280 (local address 127.24.175.195:37023)
0811 16:37:39.251519 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:39.251521 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:39.251529 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:37:39.251570 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:39.251570 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:39.251587 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:39.251653 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:37:39.251803 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:39.252302 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:39.253112 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:39.253356 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:39.253415 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:39.253599 (+ 184us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:37:39.253699 (+ 100us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:37:39.253770 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:39.253829 (+ 59us) server_negotiation.cc:299] Negotiation successful
0811 16:37:39.253850 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84,"thread_start_us":49,"threads_started":1}
I20260811 16:37:39.255926 28887 raft_consensus.cc:1261] T 5fd310a2bf4545c38c36451b1013a8d3 P c613eb3a1d434d34b84e77215cfba948 [term 1 FOLLOWER]: Refusing update from remote peer e37cc4ca1b0d44579f8dd7fa986123d8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:37:39.256002 28648 raft_consensus.cc:1261] T 5fd310a2bf4545c38c36451b1013a8d3 P e4cb0de34ebf4e7a9c6caf56e5f1c4da [term 1 FOLLOWER]: Refusing update from remote peer e37cc4ca1b0d44579f8dd7fa986123d8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:37:39.256304 29236 consensus_queue.cc:1035] T 5fd310a2bf4545c38c36451b1013a8d3 P e37cc4ca1b0d44579f8dd7fa986123d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c613eb3a1d434d34b84e77215cfba948" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:37:39.256450 29231 consensus_queue.cc:1035] T 5fd310a2bf4545c38c36451b1013a8d3 P e37cc4ca1b0d44579f8dd7fa986123d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:37:39.257726 29233 tablet_replica.cc:439] T 5fd310a2bf4545c38c36451b1013a8d3 P e4cb0de34ebf4e7a9c6caf56e5f1c4da: TxnStatusTablet state changed. Reason: New leader e37cc4ca1b0d44579f8dd7fa986123d8. Latest consensus state: current_term: 1 leader_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40147 } } peers { permanent_uuid: "c613eb3a1d434d34b84e77215cfba948" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38489 } } peers { permanent_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 37023 } } }
I20260811 16:37:39.257716 29230 tablet_replica.cc:439] T 5fd310a2bf4545c38c36451b1013a8d3 P c613eb3a1d434d34b84e77215cfba948: TxnStatusTablet state changed. Reason: New leader e37cc4ca1b0d44579f8dd7fa986123d8. Latest consensus state: current_term: 1 leader_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40147 } } peers { permanent_uuid: "c613eb3a1d434d34b84e77215cfba948" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38489 } } peers { permanent_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 37023 } } }
I20260811 16:37:39.257809 29233 tablet_replica.cc:442] T 5fd310a2bf4545c38c36451b1013a8d3 P e4cb0de34ebf4e7a9c6caf56e5f1c4da: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 16:37:39.257815 29230 tablet_replica.cc:442] T 5fd310a2bf4545c38c36451b1013a8d3 P c613eb3a1d434d34b84e77215cfba948: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 16:37:39.258944 29231 tablet_replica.cc:439] T 5fd310a2bf4545c38c36451b1013a8d3 P e37cc4ca1b0d44579f8dd7fa986123d8: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40147 } } peers { permanent_uuid: "c613eb3a1d434d34b84e77215cfba948" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38489 } } peers { permanent_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 37023 } } }
I20260811 16:37:39.259027 29231 tablet_replica.cc:442] T 5fd310a2bf4545c38c36451b1013a8d3 P e37cc4ca1b0d44579f8dd7fa986123d8: This TxnStatusTablet replica's current role is: LEADER
I20260811 16:37:39.259240 29233 tablet_replica.cc:439] T 5fd310a2bf4545c38c36451b1013a8d3 P e4cb0de34ebf4e7a9c6caf56e5f1c4da: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40147 } } peers { permanent_uuid: "c613eb3a1d434d34b84e77215cfba948" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38489 } } peers { permanent_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 37023 } } }
I20260811 16:37:39.259321 29233 tablet_replica.cc:442] T 5fd310a2bf4545c38c36451b1013a8d3 P e4cb0de34ebf4e7a9c6caf56e5f1c4da: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 16:37:39.259375 29267 mvcc.cc:205] Tried to move back new op lower bound from 7317365797909819392 to 7317365797700845568. Current Snapshot: MvccSnapshot[applied={T|T < 7317365797909819392}]
I20260811 16:37:39.259716 29266 mvcc.cc:205] Tried to move back new op lower bound from 7317365797909819392 to 7317365797700845568. Current Snapshot: MvccSnapshot[applied={T|T < 7317365797909819392}]
I20260811 16:37:39.259927 29230 tablet_replica.cc:439] T 5fd310a2bf4545c38c36451b1013a8d3 P c613eb3a1d434d34b84e77215cfba948: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40147 } } peers { permanent_uuid: "c613eb3a1d434d34b84e77215cfba948" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38489 } } peers { permanent_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 37023 } } }
I20260811 16:37:39.260005 29230 tablet_replica.cc:442] T 5fd310a2bf4545c38c36451b1013a8d3 P c613eb3a1d434d34b84e77215cfba948: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 16:37:39.260403 29271 tablet_replica.cc:439] T 5fd310a2bf4545c38c36451b1013a8d3 P e37cc4ca1b0d44579f8dd7fa986123d8: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40147 } } peers { permanent_uuid: "c613eb3a1d434d34b84e77215cfba948" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38489 } } peers { permanent_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 37023 } } }
I20260811 16:37:39.260535 29271 tablet_replica.cc:442] T 5fd310a2bf4545c38c36451b1013a8d3 P e37cc4ca1b0d44579f8dd7fa986123d8: This TxnStatusTablet replica's current role is: LEADER
I20260811 16:37:39.264313 29264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:39.262332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58296 (local address 127.24.175.195:37023)
0811 16:37:39.262369 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:39.262371 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:39.262377 (+ 6us) server_negotiation.cc:407] Connection header received
0811 16:37:39.262398 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:39.262398 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:39.262407 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:39.262457 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:37:39.262570 (+ 113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:39.263022 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:39.263725 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:39.263925 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:39.263977 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:39.264103 (+ 126us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:37:39.264134 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:37:39.264177 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:39.264231 (+ 54us) server_negotiation.cc:299] Negotiation successful
0811 16:37:39.264250 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 16:37:39.269079 29264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:39.266682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.195:52929 (local address 127.24.175.195:37023)
0811 16:37:39.266735 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:39.266736 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:39.266810 (+ 74us) server_negotiation.cc:407] Connection header received
0811 16:37:39.266870 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:39.266870 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:39.266878 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:39.266919 (+ 41us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:37:39.267046 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:39.267459 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:39.268489 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:39.268650 (+ 161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:39.268689 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:39.268920 (+ 231us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:37:39.268941 (+ 21us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:37:39.268970 (+ 29us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:39.269024 (+ 54us) server_negotiation.cc:299] Negotiation successful
0811 16:37:39.269037 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 16:37:39.269193 29285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:39.266611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.195:37023 (local address 127.24.175.195:52929)
0811 16:37:39.266743 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:39.266754 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:39.266817 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:39.266924 (+ 107us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:39.266925 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:39.266927 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 16:37:39.266985 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:39.266986 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:39.267526 (+ 540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:39.267528 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:39.268413 (+ 885us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:39.268417 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:39.268738 (+ 321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:39.268740 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:39.268819 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:39.268833 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 16:37:39.268975 (+ 142us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 16:37:39.268976 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 16:37:39.269031 (+ 55us) client_negotiation.cc:240] Negotiation successful
0811 16:37:39.269077 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":73,"threads_started":1}
I20260811 16:37:39.271266 28648 raft_consensus.cc:1261] T ab6fd402192d43ac88d93b513b4f5bdf P e4cb0de34ebf4e7a9c6caf56e5f1c4da [term 1 FOLLOWER]: Refusing update from remote peer e37cc4ca1b0d44579f8dd7fa986123d8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:37:39.271389 28887 raft_consensus.cc:1261] T ab6fd402192d43ac88d93b513b4f5bdf P c613eb3a1d434d34b84e77215cfba948 [term 1 FOLLOWER]: Refusing update from remote peer e37cc4ca1b0d44579f8dd7fa986123d8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:37:39.271476 29236 consensus_queue.cc:1035] T ab6fd402192d43ac88d93b513b4f5bdf P e37cc4ca1b0d44579f8dd7fa986123d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:37:39.271560 29271 consensus_queue.cc:1035] T ab6fd402192d43ac88d93b513b4f5bdf P e37cc4ca1b0d44579f8dd7fa986123d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c613eb3a1d434d34b84e77215cfba948" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:37:39.272714 29265 mvcc.cc:205] Tried to move back new op lower bound from 7317365797973954560 to 7317365796567789568. Current Snapshot: MvccSnapshot[applied={T|T < 7317365797973954560}]
I20260811 16:37:39.283166 28367 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55424:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:37:39.283273 28367 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55424:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:37:39.283983 28367 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 09d25b60ed7241c8bcb7d373cfb7d769: Sending DeleteTablet for 3 replicas of tablet ab6fd402192d43ac88d93b513b4f5bdf
I20260811 16:37:39.284279 28854 tablet_service.cc:1514] Processing DeleteTablet for tablet ab6fd402192d43ac88d93b513b4f5bdf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:37:39 UTC) from {username='kudu', principal='kudu/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:37094
I20260811 16:37:39.284351 29083 tablet_service.cc:1514] Processing DeleteTablet for tablet ab6fd402192d43ac88d93b513b4f5bdf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:37:39 UTC) from {username='kudu', principal='kudu/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:58278
I20260811 16:37:39.284453 28367 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55424:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:37:39.284592 28367 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:37:39.284610 28608 tablet_service.cc:1514] Processing DeleteTablet for tablet ab6fd402192d43ac88d93b513b4f5bdf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:37:39 UTC) from {username='kudu', principal='kudu/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:60166
I20260811 16:37:39.284781 29292 tablet_replica.cc:330] T ab6fd402192d43ac88d93b513b4f5bdf P c613eb3a1d434d34b84e77215cfba948: stopping tablet replica
I20260811 16:37:39.284947 29292 raft_consensus.cc:2229] T ab6fd402192d43ac88d93b513b4f5bdf P c613eb3a1d434d34b84e77215cfba948 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:37:39.284960 29293 tablet_replica.cc:330] T ab6fd402192d43ac88d93b513b4f5bdf P e37cc4ca1b0d44579f8dd7fa986123d8: stopping tablet replica
I20260811 16:37:39.285065 29293 raft_consensus.cc:2229] T ab6fd402192d43ac88d93b513b4f5bdf P e37cc4ca1b0d44579f8dd7fa986123d8 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:37:39.285224 29293 raft_consensus.cc:2258] T ab6fd402192d43ac88d93b513b4f5bdf P e37cc4ca1b0d44579f8dd7fa986123d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:37:39.285744 28608 tablet_service.cc:1467] Processing CreateTablet for tablet 630babad8c8143fc95d2a949ea08b58d (DEFAULT_TABLE table=test-table [id=e5a9c6ba12d34ab8a86b86b7b84b8509]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:37:39.285765 29083 tablet_service.cc:1467] Processing CreateTablet for tablet 630babad8c8143fc95d2a949ea08b58d (DEFAULT_TABLE table=test-table [id=e5a9c6ba12d34ab8a86b86b7b84b8509]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:37:39.285879 28608 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 630babad8c8143fc95d2a949ea08b58d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:37:39.285881 29083 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 630babad8c8143fc95d2a949ea08b58d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:37:39.285868 28854 tablet_service.cc:1467] Processing CreateTablet for tablet 630babad8c8143fc95d2a949ea08b58d (DEFAULT_TABLE table=test-table [id=e5a9c6ba12d34ab8a86b86b7b84b8509]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:37:39.285969 28854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 630babad8c8143fc95d2a949ea08b58d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:37:39.287235 29220 tablet_bootstrap.cc:492] T 630babad8c8143fc95d2a949ea08b58d P e37cc4ca1b0d44579f8dd7fa986123d8: Bootstrap starting.
I20260811 16:37:39.287303 29223 tablet_bootstrap.cc:492] T 630babad8c8143fc95d2a949ea08b58d P e4cb0de34ebf4e7a9c6caf56e5f1c4da: Bootstrap starting.
I20260811 16:37:39.287519 29293 ts_tablet_manager.cc:1905] T ab6fd402192d43ac88d93b513b4f5bdf P e37cc4ca1b0d44579f8dd7fa986123d8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:37:39.287660 29220 tablet_bootstrap.cc:654] T 630babad8c8143fc95d2a949ea08b58d P e37cc4ca1b0d44579f8dd7fa986123d8: Neither blocks nor log segments found. Creating new log.
I20260811 16:37:39.287941 29223 tablet_bootstrap.cc:654] T 630babad8c8143fc95d2a949ea08b58d P e4cb0de34ebf4e7a9c6caf56e5f1c4da: Neither blocks nor log segments found. Creating new log.
I20260811 16:37:39.287985 29219 tablet_bootstrap.cc:492] T 630babad8c8143fc95d2a949ea08b58d P c613eb3a1d434d34b84e77215cfba948: Bootstrap starting.
I20260811 16:37:39.288370 29219 tablet_bootstrap.cc:654] T 630babad8c8143fc95d2a949ea08b58d P c613eb3a1d434d34b84e77215cfba948: Neither blocks nor log segments found. Creating new log.
I20260811 16:37:39.289045 29219 tablet_bootstrap.cc:492] T 630babad8c8143fc95d2a949ea08b58d P c613eb3a1d434d34b84e77215cfba948: No bootstrap required, opened a new log
I20260811 16:37:39.289084 29219 ts_tablet_manager.cc:1397] T 630babad8c8143fc95d2a949ea08b58d P c613eb3a1d434d34b84e77215cfba948: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 16:37:39.289188 29219 raft_consensus.cc:348] T 630babad8c8143fc95d2a949ea08b58d P c613eb3a1d434d34b84e77215cfba948 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40147 } } peers { permanent_uuid: "c613eb3a1d434d34b84e77215cfba948" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38489 } } peers { permanent_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 37023 } }
I20260811 16:37:39.289245 29219 raft_consensus.cc:374] T 630babad8c8143fc95d2a949ea08b58d P c613eb3a1d434d34b84e77215cfba948 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:37:39.289258 29219 raft_consensus.cc:729] T 630babad8c8143fc95d2a949ea08b58d P c613eb3a1d434d34b84e77215cfba948 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c613eb3a1d434d34b84e77215cfba948, State: Initialized, Role: FOLLOWER
I20260811 16:37:39.289314 29219 consensus_queue.cc:260] T 630babad8c8143fc95d2a949ea08b58d P c613eb3a1d434d34b84e77215cfba948 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40147 } } peers { permanent_uuid: "c613eb3a1d434d34b84e77215cfba948" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38489 } } peers { permanent_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 37023 } }
I20260811 16:37:39.289412 29219 ts_tablet_manager.cc:1428] T 630babad8c8143fc95d2a949ea08b58d P c613eb3a1d434d34b84e77215cfba948: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:39.289697 29292 raft_consensus.cc:2258] T ab6fd402192d43ac88d93b513b4f5bdf P c613eb3a1d434d34b84e77215cfba948 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:37:39.289810 29293 ts_tablet_manager.cc:1918] T ab6fd402192d43ac88d93b513b4f5bdf P e37cc4ca1b0d44579f8dd7fa986123d8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 16:37:39.289923 29293 log.cc:1196] T ab6fd402192d43ac88d93b513b4f5bdf P e37cc4ca1b0d44579f8dd7fa986123d8: Deleting WAL directory at /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/ts-2/wal/wals/ab6fd402192d43ac88d93b513b4f5bdf
I20260811 16:37:39.290059 29292 ts_tablet_manager.cc:1905] T ab6fd402192d43ac88d93b513b4f5bdf P c613eb3a1d434d34b84e77215cfba948: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:37:39.290364 29293 ts_tablet_manager.cc:1939] T ab6fd402192d43ac88d93b513b4f5bdf P e37cc4ca1b0d44579f8dd7fa986123d8: Deleting consensus metadata
I20260811 16:37:39.290512 29294 tablet_replica.cc:330] T ab6fd402192d43ac88d93b513b4f5bdf P e4cb0de34ebf4e7a9c6caf56e5f1c4da: stopping tablet replica
I20260811 16:37:39.290575 29220 tablet_bootstrap.cc:492] T 630babad8c8143fc95d2a949ea08b58d P e37cc4ca1b0d44579f8dd7fa986123d8: No bootstrap required, opened a new log
I20260811 16:37:39.290622 29220 ts_tablet_manager.cc:1397] T 630babad8c8143fc95d2a949ea08b58d P e37cc4ca1b0d44579f8dd7fa986123d8: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260811 16:37:39.290618 29294 raft_consensus.cc:2229] T ab6fd402192d43ac88d93b513b4f5bdf P e4cb0de34ebf4e7a9c6caf56e5f1c4da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:37:39.290678 29294 raft_consensus.cc:2258] T ab6fd402192d43ac88d93b513b4f5bdf P e4cb0de34ebf4e7a9c6caf56e5f1c4da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:37:39.290759 29220 raft_consensus.cc:348] T 630babad8c8143fc95d2a949ea08b58d P e37cc4ca1b0d44579f8dd7fa986123d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40147 } } peers { permanent_uuid: "c613eb3a1d434d34b84e77215cfba948" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38489 } } peers { permanent_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 37023 } }
I20260811 16:37:39.290838 29220 raft_consensus.cc:374] T 630babad8c8143fc95d2a949ea08b58d P e37cc4ca1b0d44579f8dd7fa986123d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:37:39.290861 29220 raft_consensus.cc:729] T 630babad8c8143fc95d2a949ea08b58d P e37cc4ca1b0d44579f8dd7fa986123d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e37cc4ca1b0d44579f8dd7fa986123d8, State: Initialized, Role: FOLLOWER
I20260811 16:37:39.290899 29220 consensus_queue.cc:260] T 630babad8c8143fc95d2a949ea08b58d P e37cc4ca1b0d44579f8dd7fa986123d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40147 } } peers { permanent_uuid: "c613eb3a1d434d34b84e77215cfba948" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38489 } } peers { permanent_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 37023 } }
I20260811 16:37:39.290992 29220 ts_tablet_manager.cc:1428] T 630babad8c8143fc95d2a949ea08b58d P e37cc4ca1b0d44579f8dd7fa986123d8: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 16:37:39.291141 29223 tablet_bootstrap.cc:492] T 630babad8c8143fc95d2a949ea08b58d P e4cb0de34ebf4e7a9c6caf56e5f1c4da: No bootstrap required, opened a new log
I20260811 16:37:39.291193 29223 ts_tablet_manager.cc:1397] T 630babad8c8143fc95d2a949ea08b58d P e4cb0de34ebf4e7a9c6caf56e5f1c4da: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20260811 16:37:39.291230 28340 catalog_manager.cc:4841] TS e37cc4ca1b0d44579f8dd7fa986123d8 (127.24.175.195:37023): tablet ab6fd402192d43ac88d93b513b4f5bdf (table test-table [id=386c1db5fce94cc5a358bd0e166820f8]) successfully deleted
I20260811 16:37:39.291344 29223 raft_consensus.cc:348] T 630babad8c8143fc95d2a949ea08b58d P e4cb0de34ebf4e7a9c6caf56e5f1c4da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40147 } } peers { permanent_uuid: "c613eb3a1d434d34b84e77215cfba948" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38489 } } peers { permanent_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 37023 } }
I20260811 16:37:39.291419 29223 raft_consensus.cc:374] T 630babad8c8143fc95d2a949ea08b58d P e4cb0de34ebf4e7a9c6caf56e5f1c4da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:37:39.291437 29223 raft_consensus.cc:729] T 630babad8c8143fc95d2a949ea08b58d P e4cb0de34ebf4e7a9c6caf56e5f1c4da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4cb0de34ebf4e7a9c6caf56e5f1c4da, State: Initialized, Role: FOLLOWER
I20260811 16:37:39.291478 29223 consensus_queue.cc:260] T 630babad8c8143fc95d2a949ea08b58d P e4cb0de34ebf4e7a9c6caf56e5f1c4da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40147 } } peers { permanent_uuid: "c613eb3a1d434d34b84e77215cfba948" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38489 } } peers { permanent_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 37023 } }
I20260811 16:37:39.291558 29223 ts_tablet_manager.cc:1428] T 630babad8c8143fc95d2a949ea08b58d P e4cb0de34ebf4e7a9c6caf56e5f1c4da: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:39.291831 29294 ts_tablet_manager.cc:1905] T ab6fd402192d43ac88d93b513b4f5bdf P e4cb0de34ebf4e7a9c6caf56e5f1c4da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:37:39.293035 29294 ts_tablet_manager.cc:1918] T ab6fd402192d43ac88d93b513b4f5bdf P e4cb0de34ebf4e7a9c6caf56e5f1c4da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 16:37:39.293111 29294 log.cc:1196] T ab6fd402192d43ac88d93b513b4f5bdf P e4cb0de34ebf4e7a9c6caf56e5f1c4da: Deleting WAL directory at /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/ts-0/wal/wals/ab6fd402192d43ac88d93b513b4f5bdf
I20260811 16:37:39.293355 29294 ts_tablet_manager.cc:1939] T ab6fd402192d43ac88d93b513b4f5bdf P e4cb0de34ebf4e7a9c6caf56e5f1c4da: Deleting consensus metadata
I20260811 16:37:39.293782 28341 catalog_manager.cc:4841] TS e4cb0de34ebf4e7a9c6caf56e5f1c4da (127.24.175.193:40147): tablet ab6fd402192d43ac88d93b513b4f5bdf (table test-table [id=386c1db5fce94cc5a358bd0e166820f8]) successfully deleted
I20260811 16:37:39.293982 29292 ts_tablet_manager.cc:1918] T ab6fd402192d43ac88d93b513b4f5bdf P c613eb3a1d434d34b84e77215cfba948: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 16:37:39.294035 29292 log.cc:1196] T ab6fd402192d43ac88d93b513b4f5bdf P c613eb3a1d434d34b84e77215cfba948: Deleting WAL directory at /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/ts-1/wal/wals/ab6fd402192d43ac88d93b513b4f5bdf
I20260811 16:37:39.294270 29292 ts_tablet_manager.cc:1939] T ab6fd402192d43ac88d93b513b4f5bdf P c613eb3a1d434d34b84e77215cfba948: Deleting consensus metadata
I20260811 16:37:39.294608 28345 catalog_manager.cc:4841] TS c613eb3a1d434d34b84e77215cfba948 (127.24.175.194:38489): tablet ab6fd402192d43ac88d93b513b4f5bdf (table test-table [id=386c1db5fce94cc5a358bd0e166820f8]) successfully deleted
I20260811 16:37:39.420040 29233 raft_consensus.cc:482] T 630babad8c8143fc95d2a949ea08b58d P e4cb0de34ebf4e7a9c6caf56e5f1c4da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:37:39.420150 29233 raft_consensus.cc:504] T 630babad8c8143fc95d2a949ea08b58d P e4cb0de34ebf4e7a9c6caf56e5f1c4da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40147 } } peers { permanent_uuid: "c613eb3a1d434d34b84e77215cfba948" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38489 } } peers { permanent_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 37023 } }
I20260811 16:37:39.420477 29233 leader_election.cc:288] T 630babad8c8143fc95d2a949ea08b58d P e4cb0de34ebf4e7a9c6caf56e5f1c4da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c613eb3a1d434d34b84e77215cfba948 (127.24.175.194:38489), e37cc4ca1b0d44579f8dd7fa986123d8 (127.24.175.195:37023)
I20260811 16:37:39.423880 29216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:39.420709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:53475 (local address 127.24.175.194:38489)
0811 16:37:39.420815 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:39.420818 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:39.420856 (+ 38us) server_negotiation.cc:407] Connection header received
0811 16:37:39.420967 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:39.420968 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:39.420978 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:39.421007 (+ 29us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:37:39.421207 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:39.421997 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:39.423223 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:39.423585 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:39.423646 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:39.423655 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:39.423777 (+ 122us) server_negotiation.cc:299] Negotiation successful
0811 16:37:39.423818 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 16:37:39.423894 29303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:39.420644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.194:38489 (local address 127.24.175.193:53475)
0811 16:37:39.420781 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:39.420792 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:39.420889 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:39.421069 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:39.421070 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:39.421072 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:37:39.421138 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:39.421139 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:39.422078 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:39.422080 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:39.423145 (+ 1065us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:39.423148 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:39.423652 (+ 504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:39.423653 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:39.423705 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:39.423710 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 16:37:39.423764 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 16:37:39.423804 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"mutex_wait_us":5,"thread_start_us":116,"threads_started":1}
I20260811 16:37:39.424285 28886 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "630babad8c8143fc95d2a949ea08b58d" candidate_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c613eb3a1d434d34b84e77215cfba948" is_pre_election: true
I20260811 16:37:39.424389 28886 raft_consensus.cc:2454] T 630babad8c8143fc95d2a949ea08b58d P c613eb3a1d434d34b84e77215cfba948 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4cb0de34ebf4e7a9c6caf56e5f1c4da in term 0.
I20260811 16:37:39.424548 28531 leader_election.cc:302] T 630babad8c8143fc95d2a949ea08b58d P e4cb0de34ebf4e7a9c6caf56e5f1c4da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c613eb3a1d434d34b84e77215cfba948, e4cb0de34ebf4e7a9c6caf56e5f1c4da; no voters:
I20260811 16:37:39.424674 29233 raft_consensus.cc:2781] T 630babad8c8143fc95d2a949ea08b58d P e4cb0de34ebf4e7a9c6caf56e5f1c4da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:37:39.424703 29233 raft_consensus.cc:482] T 630babad8c8143fc95d2a949ea08b58d P e4cb0de34ebf4e7a9c6caf56e5f1c4da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:37:39.424721 29233 raft_consensus.cc:3037] T 630babad8c8143fc95d2a949ea08b58d P e4cb0de34ebf4e7a9c6caf56e5f1c4da [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:37:39.425064 29304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:39.420644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.195:37023 (local address 127.24.175.193:44675)
0811 16:37:39.420859 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:39.420868 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:39.420907 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:39.421079 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:39.421079 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:39.421081 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:37:39.421138 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:39.421139 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:39.422866 (+ 1727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:39.422867 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:39.423978 (+ 1111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:39.423981 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:39.424839 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:39.424840 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:39.424899 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:39.424903 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:37:39.424952 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 16:37:39.424985 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":199,"mutex_wait_us":6,"thread_start_us":61,"threads_started":1}
I20260811 16:37:39.425098 29264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:39.420858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:44675 (local address 127.24.175.195:37023)
0811 16:37:39.420895 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:39.420897 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:39.420906 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:37:39.421001 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:39.421002 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:39.421010 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:39.421078 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:37:39.422029 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:39.422760 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:39.424092 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:39.424641 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:39.424687 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:39.424695 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:39.424970 (+ 275us) server_negotiation.cc:299] Negotiation successful
0811 16:37:39.425019 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 16:37:39.425423 29113 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "630babad8c8143fc95d2a949ea08b58d" candidate_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" is_pre_election: true
I20260811 16:37:39.425562 29113 raft_consensus.cc:2454] T 630babad8c8143fc95d2a949ea08b58d P e37cc4ca1b0d44579f8dd7fa986123d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4cb0de34ebf4e7a9c6caf56e5f1c4da in term 0.
I20260811 16:37:39.425609 29233 raft_consensus.cc:504] T 630babad8c8143fc95d2a949ea08b58d P e4cb0de34ebf4e7a9c6caf56e5f1c4da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40147 } } peers { permanent_uuid: "c613eb3a1d434d34b84e77215cfba948" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38489 } } peers { permanent_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 37023 } }
I20260811 16:37:39.425745 29233 leader_election.cc:288] T 630babad8c8143fc95d2a949ea08b58d P e4cb0de34ebf4e7a9c6caf56e5f1c4da [CANDIDATE]: Term 1 election: Requested vote from peers c613eb3a1d434d34b84e77215cfba948 (127.24.175.194:38489), e37cc4ca1b0d44579f8dd7fa986123d8 (127.24.175.195:37023)
I20260811 16:37:39.425875 28886 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "630babad8c8143fc95d2a949ea08b58d" candidate_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c613eb3a1d434d34b84e77215cfba948"
I20260811 16:37:39.425954 28886 raft_consensus.cc:3037] T 630babad8c8143fc95d2a949ea08b58d P c613eb3a1d434d34b84e77215cfba948 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:37:39.426237 29113 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "630babad8c8143fc95d2a949ea08b58d" candidate_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8"
I20260811 16:37:39.426306 29113 raft_consensus.cc:3037] T 630babad8c8143fc95d2a949ea08b58d P e37cc4ca1b0d44579f8dd7fa986123d8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:37:39.426751 28886 raft_consensus.cc:2454] T 630babad8c8143fc95d2a949ea08b58d P c613eb3a1d434d34b84e77215cfba948 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4cb0de34ebf4e7a9c6caf56e5f1c4da in term 1.
I20260811 16:37:39.426896 29113 raft_consensus.cc:2454] T 630babad8c8143fc95d2a949ea08b58d P e37cc4ca1b0d44579f8dd7fa986123d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4cb0de34ebf4e7a9c6caf56e5f1c4da in term 1.
I20260811 16:37:39.426918 28531 leader_election.cc:302] T 630babad8c8143fc95d2a949ea08b58d P e4cb0de34ebf4e7a9c6caf56e5f1c4da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c613eb3a1d434d34b84e77215cfba948, e4cb0de34ebf4e7a9c6caf56e5f1c4da; no voters:
I20260811 16:37:39.426994 29233 raft_consensus.cc:2781] T 630babad8c8143fc95d2a949ea08b58d P e4cb0de34ebf4e7a9c6caf56e5f1c4da [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:37:39.427122 29233 raft_consensus.cc:686] T 630babad8c8143fc95d2a949ea08b58d P e4cb0de34ebf4e7a9c6caf56e5f1c4da [term 1 LEADER]: Becoming Leader. State: Replica: e4cb0de34ebf4e7a9c6caf56e5f1c4da, State: Running, Role: LEADER
I20260811 16:37:39.427197 29233 consensus_queue.cc:237] T 630babad8c8143fc95d2a949ea08b58d P e4cb0de34ebf4e7a9c6caf56e5f1c4da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40147 } } peers { permanent_uuid: "c613eb3a1d434d34b84e77215cfba948" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38489 } } peers { permanent_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 37023 } }
I20260811 16:37:39.427942 28367 catalog_manager.cc:5495] T 630babad8c8143fc95d2a949ea08b58d P e4cb0de34ebf4e7a9c6caf56e5f1c4da reported cstate change: term changed from 0 to 1, leader changed from <none> to e4cb0de34ebf4e7a9c6caf56e5f1c4da (127.24.175.193). New cstate: current_term: 1 leader_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c613eb3a1d434d34b84e77215cfba948" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 37023 } health_report { overall_health: UNKNOWN } } }
I20260811 16:37:39.437585 29308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:39.435254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60170 (local address 127.24.175.193:40147)
0811 16:37:39.435400 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:39.435401 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:39.435407 (+ 6us) server_negotiation.cc:407] Connection header received
0811 16:37:39.435434 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:39.435435 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:39.435453 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:39.435527 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:37:39.435623 (+ 96us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:39.436098 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:39.436848 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:39.437065 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:39.437118 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:39.437269 (+ 151us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:37:39.437380 (+ 111us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:37:39.437442 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:39.437485 (+ 43us) server_negotiation.cc:299] Negotiation successful
0811 16:37:39.437507 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":84,"threads_started":1}
I20260811 16:37:39.442701 29311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:39.439782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.195:37023 (local address 127.24.175.193:56051)
0811 16:37:39.439907 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:39.439917 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:39.439973 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:39.440087 (+ 114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:39.440087 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:39.440089 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 16:37:39.440140 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:39.440141 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:39.440697 (+ 556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:39.440698 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:39.441914 (+ 1216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:39.441917 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:39.442321 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:39.442322 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:39.442386 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:39.442400 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 16:37:39.442548 (+ 148us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 16:37:39.442550 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 16:37:39.442585 (+ 35us) client_negotiation.cc:240] Negotiation successful
0811 16:37:39.442627 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":87,"thread_start_us":67,"threads_started":1}
I20260811 16:37:39.442687 29264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:39.439858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:56051 (local address 127.24.175.195:37023)
0811 16:37:39.439912 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:39.439915 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:39.439957 (+ 42us) server_negotiation.cc:407] Connection header received
0811 16:37:39.440024 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:39.440025 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:39.440034 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:39.440084 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:37:39.440194 (+ 110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:39.440632 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:39.441992 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:39.442231 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:39.442307 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:39.442466 (+ 159us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:37:39.442500 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:37:39.442542 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:39.442597 (+ 55us) server_negotiation.cc:299] Negotiation successful
0811 16:37:39.442616 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 16:37:39.444710 28886 raft_consensus.cc:1261] T 630babad8c8143fc95d2a949ea08b58d P c613eb3a1d434d34b84e77215cfba948 [term 1 FOLLOWER]: Refusing update from remote peer e4cb0de34ebf4e7a9c6caf56e5f1c4da: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:37:39.444841 29113 raft_consensus.cc:1261] T 630babad8c8143fc95d2a949ea08b58d P e37cc4ca1b0d44579f8dd7fa986123d8 [term 1 FOLLOWER]: Refusing update from remote peer e4cb0de34ebf4e7a9c6caf56e5f1c4da: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:37:39.444988 29305 consensus_queue.cc:1035] T 630babad8c8143fc95d2a949ea08b58d P e4cb0de34ebf4e7a9c6caf56e5f1c4da [LEADER]: Connected to new peer: Peer: permanent_uuid: "c613eb3a1d434d34b84e77215cfba948" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:37:39.445101 29233 consensus_queue.cc:1035] T 630babad8c8143fc95d2a949ea08b58d P e4cb0de34ebf4e7a9c6caf56e5f1c4da [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 37023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:37:39.452008 29308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:39.450044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.195:57469 (local address 127.24.175.193:40147)
0811 16:37:39.450087 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:39.450089 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:39.450095 (+ 6us) server_negotiation.cc:407] Connection header received
0811 16:37:39.450114 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:39.450114 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:39.450123 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:39.450207 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:37:39.450297 (+ 90us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:39.450717 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:39.451353 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:39.451597 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:39.451652 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:39.451844 (+ 192us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:37:39.451876 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:37:39.451915 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:39.451947 (+ 32us) server_negotiation.cc:299] Negotiation successful
0811 16:37:39.451964 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 16:37:39.452023 29285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:39.449843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.193:40147 (local address 127.24.175.195:57469)
0811 16:37:39.449910 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:39.449920 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:39.449954 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:39.450214 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:39.450215 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:39.450216 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 16:37:39.450253 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:39.450254 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:39.450764 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:39.450765 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:39.451287 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:39.451289 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:39.451703 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:39.451704 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:39.451771 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:39.451778 (+ 7us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 16:37:39.451915 (+ 137us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 16:37:39.451916 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 16:37:39.451944 (+ 28us) client_negotiation.cc:240] Negotiation successful
0811 16:37:39.451975 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51}
W20260811 16:37:39.452303 29267 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260811 16:37:40.970238 28365 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55424:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:37:40.970345 28365 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55424:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:37:40.971160 28365 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 09d25b60ed7241c8bcb7d373cfb7d769: Sending DeleteTablet for 3 replicas of tablet 630babad8c8143fc95d2a949ea08b58d
I20260811 16:37:40.971413 28608 tablet_service.cc:1514] Processing DeleteTablet for tablet 630babad8c8143fc95d2a949ea08b58d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:37:40 UTC) from {username='kudu', principal='kudu/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:60166
I20260811 16:37:40.971513 29083 tablet_service.cc:1514] Processing DeleteTablet for tablet 630babad8c8143fc95d2a949ea08b58d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:37:40 UTC) from {username='kudu', principal='kudu/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:58278
I20260811 16:37:40.973132 28854 tablet_service.cc:1514] Processing DeleteTablet for tablet 630babad8c8143fc95d2a949ea08b58d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:37:40 UTC) from {username='kudu', principal='kudu/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:37094
I20260811 16:37:40.973311 29368 tablet_replica.cc:330] T 630babad8c8143fc95d2a949ea08b58d P c613eb3a1d434d34b84e77215cfba948: stopping tablet replica
I20260811 16:37:40.973382 29368 raft_consensus.cc:2229] T 630babad8c8143fc95d2a949ea08b58d P c613eb3a1d434d34b84e77215cfba948 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:37:40.973450 29368 raft_consensus.cc:2258] T 630babad8c8143fc95d2a949ea08b58d P c613eb3a1d434d34b84e77215cfba948 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:37:40.973912 29368 ts_tablet_manager.cc:1905] T 630babad8c8143fc95d2a949ea08b58d P c613eb3a1d434d34b84e77215cfba948: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:37:40.974468 29361 tablet_replica.cc:330] T 630babad8c8143fc95d2a949ea08b58d P e4cb0de34ebf4e7a9c6caf56e5f1c4da: stopping tablet replica
I20260811 16:37:40.974525 29361 raft_consensus.cc:2229] T 630babad8c8143fc95d2a949ea08b58d P e4cb0de34ebf4e7a9c6caf56e5f1c4da [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:37:40.974615 29361 raft_consensus.cc:2258] T 630babad8c8143fc95d2a949ea08b58d P e4cb0de34ebf4e7a9c6caf56e5f1c4da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:37:40.974844 29361 ts_tablet_manager.cc:1905] T 630babad8c8143fc95d2a949ea08b58d P e4cb0de34ebf4e7a9c6caf56e5f1c4da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:37:40.975679 29368 ts_tablet_manager.cc:1918] T 630babad8c8143fc95d2a949ea08b58d P c613eb3a1d434d34b84e77215cfba948: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 16:37:40.975754 29368 log.cc:1196] T 630babad8c8143fc95d2a949ea08b58d P c613eb3a1d434d34b84e77215cfba948: Deleting WAL directory at /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/ts-1/wal/wals/630babad8c8143fc95d2a949ea08b58d
I20260811 16:37:40.975986 29368 ts_tablet_manager.cc:1939] T 630babad8c8143fc95d2a949ea08b58d P c613eb3a1d434d34b84e77215cfba948: Deleting consensus metadata
I20260811 16:37:40.976254 29361 ts_tablet_manager.cc:1918] T 630babad8c8143fc95d2a949ea08b58d P e4cb0de34ebf4e7a9c6caf56e5f1c4da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 16:37:40.976305 29361 log.cc:1196] T 630babad8c8143fc95d2a949ea08b58d P e4cb0de34ebf4e7a9c6caf56e5f1c4da: Deleting WAL directory at /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/ts-0/wal/wals/630babad8c8143fc95d2a949ea08b58d
I20260811 16:37:40.976538 29361 ts_tablet_manager.cc:1939] T 630babad8c8143fc95d2a949ea08b58d P e4cb0de34ebf4e7a9c6caf56e5f1c4da: Deleting consensus metadata
I20260811 16:37:40.976541 28345 catalog_manager.cc:4841] TS c613eb3a1d434d34b84e77215cfba948 (127.24.175.194:38489): tablet 630babad8c8143fc95d2a949ea08b58d (table test-table [id=e5a9c6ba12d34ab8a86b86b7b84b8509]) successfully deleted
I20260811 16:37:40.976807 29366 tablet_replica.cc:330] T 630babad8c8143fc95d2a949ea08b58d P e37cc4ca1b0d44579f8dd7fa986123d8: stopping tablet replica
I20260811 16:37:40.976867 29366 raft_consensus.cc:2229] T 630babad8c8143fc95d2a949ea08b58d P e37cc4ca1b0d44579f8dd7fa986123d8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:37:40.976867 28341 catalog_manager.cc:4841] TS e4cb0de34ebf4e7a9c6caf56e5f1c4da (127.24.175.193:40147): tablet 630babad8c8143fc95d2a949ea08b58d (table test-table [id=e5a9c6ba12d34ab8a86b86b7b84b8509]) successfully deleted
I20260811 16:37:40.976902 29366 raft_consensus.cc:2258] T 630babad8c8143fc95d2a949ea08b58d P e37cc4ca1b0d44579f8dd7fa986123d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:37:40.977111 29366 ts_tablet_manager.cc:1905] T 630babad8c8143fc95d2a949ea08b58d P e37cc4ca1b0d44579f8dd7fa986123d8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:37:40.978240 29366 ts_tablet_manager.cc:1918] T 630babad8c8143fc95d2a949ea08b58d P e37cc4ca1b0d44579f8dd7fa986123d8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 16:37:40.978292 29366 log.cc:1196] T 630babad8c8143fc95d2a949ea08b58d P e37cc4ca1b0d44579f8dd7fa986123d8: Deleting WAL directory at /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/ts-2/wal/wals/630babad8c8143fc95d2a949ea08b58d
I20260811 16:37:40.978461 29366 ts_tablet_manager.cc:1939] T 630babad8c8143fc95d2a949ea08b58d P e37cc4ca1b0d44579f8dd7fa986123d8: Deleting consensus metadata
I20260811 16:37:40.978761 28340 catalog_manager.cc:4841] TS e37cc4ca1b0d44579f8dd7fa986123d8 (127.24.175.195:37023): tablet 630babad8c8143fc95d2a949ea08b58d (table test-table [id=e5a9c6ba12d34ab8a86b86b7b84b8509]) successfully deleted
Aug 11 16:37:40 dist-test-slave-zj8q krb5kdc[28293](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466260, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 16:37:40 dist-test-slave-zj8q krb5kdc[28293](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466260, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:37:40.998369 29381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:40.988437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55448 (local address 127.24.175.254:38335)
0811 16:37:40.988626 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:40.988628 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:40.988708 (+ 80us) server_negotiation.cc:407] Connection header received
0811 16:37:40.988781 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:40.988782 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:40.988794 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:40.988855 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:40.989399 (+ 544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:40.989908 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:40.990696 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:40.990897 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:40.990957 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:40.995974 (+ 5017us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:40.995975 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:40.995975 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:37:40.995982 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:40.997246 (+ 1264us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:40.997598 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:40.997599 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:40.997599 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:40.997657 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:40.997825 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:40.997826 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:40.997826 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:40.997939 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:40.998039 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:40.998176 (+ 137us) server_negotiation.cc:299] Negotiation successful
0811 16:37:40.998267 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":92,"threads_started":1}
I20260811 16:37:40.999609 28365 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55448:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:37:40.999761 28365 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:37:41.001068 28854 tablet_service.cc:1467] Processing CreateTablet for tablet 7d0463e95f5343d0a9488127e38882e4 (DEFAULT_TABLE table=test-table [id=bb8a5cd9cd0b41aaa772599cb06216a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:37:41.001075 28608 tablet_service.cc:1467] Processing CreateTablet for tablet 7d0463e95f5343d0a9488127e38882e4 (DEFAULT_TABLE table=test-table [id=bb8a5cd9cd0b41aaa772599cb06216a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:37:41.001205 28608 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d0463e95f5343d0a9488127e38882e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:37:41.001211 28854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d0463e95f5343d0a9488127e38882e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:37:41.002216 29382 tablet_bootstrap.cc:492] T 7d0463e95f5343d0a9488127e38882e4 P c613eb3a1d434d34b84e77215cfba948: Bootstrap starting.
I20260811 16:37:41.002238 29083 tablet_service.cc:1467] Processing CreateTablet for tablet 7d0463e95f5343d0a9488127e38882e4 (DEFAULT_TABLE table=test-table [id=bb8a5cd9cd0b41aaa772599cb06216a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:37:41.002362 29083 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d0463e95f5343d0a9488127e38882e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:37:41.002530 29384 tablet_bootstrap.cc:492] T 7d0463e95f5343d0a9488127e38882e4 P e4cb0de34ebf4e7a9c6caf56e5f1c4da: Bootstrap starting.
I20260811 16:37:41.002597 29382 tablet_bootstrap.cc:654] T 7d0463e95f5343d0a9488127e38882e4 P c613eb3a1d434d34b84e77215cfba948: Neither blocks nor log segments found. Creating new log.
I20260811 16:37:41.002898 29384 tablet_bootstrap.cc:654] T 7d0463e95f5343d0a9488127e38882e4 P e4cb0de34ebf4e7a9c6caf56e5f1c4da: Neither blocks nor log segments found. Creating new log.
I20260811 16:37:41.003219 29382 tablet_bootstrap.cc:492] T 7d0463e95f5343d0a9488127e38882e4 P c613eb3a1d434d34b84e77215cfba948: No bootstrap required, opened a new log
I20260811 16:37:41.003264 29382 ts_tablet_manager.cc:1397] T 7d0463e95f5343d0a9488127e38882e4 P c613eb3a1d434d34b84e77215cfba948: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 16:37:41.003435 29382 raft_consensus.cc:348] T 7d0463e95f5343d0a9488127e38882e4 P c613eb3a1d434d34b84e77215cfba948 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40147 } } peers { permanent_uuid: "c613eb3a1d434d34b84e77215cfba948" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38489 } } peers { permanent_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 37023 } }
I20260811 16:37:41.003518 29382 raft_consensus.cc:374] T 7d0463e95f5343d0a9488127e38882e4 P c613eb3a1d434d34b84e77215cfba948 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:37:41.003533 29384 tablet_bootstrap.cc:492] T 7d0463e95f5343d0a9488127e38882e4 P e4cb0de34ebf4e7a9c6caf56e5f1c4da: No bootstrap required, opened a new log
I20260811 16:37:41.003541 29382 raft_consensus.cc:729] T 7d0463e95f5343d0a9488127e38882e4 P c613eb3a1d434d34b84e77215cfba948 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c613eb3a1d434d34b84e77215cfba948, State: Initialized, Role: FOLLOWER
I20260811 16:37:41.003573 29384 ts_tablet_manager.cc:1397] T 7d0463e95f5343d0a9488127e38882e4 P e4cb0de34ebf4e7a9c6caf56e5f1c4da: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 16:37:41.003623 29382 consensus_queue.cc:260] T 7d0463e95f5343d0a9488127e38882e4 P c613eb3a1d434d34b84e77215cfba948 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40147 } } peers { permanent_uuid: "c613eb3a1d434d34b84e77215cfba948" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38489 } } peers { permanent_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 37023 } }
I20260811 16:37:41.003672 29384 raft_consensus.cc:348] T 7d0463e95f5343d0a9488127e38882e4 P e4cb0de34ebf4e7a9c6caf56e5f1c4da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40147 } } peers { permanent_uuid: "c613eb3a1d434d34b84e77215cfba948" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38489 } } peers { permanent_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 37023 } }
I20260811 16:37:41.003785 29384 raft_consensus.cc:374] T 7d0463e95f5343d0a9488127e38882e4 P e4cb0de34ebf4e7a9c6caf56e5f1c4da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:37:41.003813 29384 raft_consensus.cc:729] T 7d0463e95f5343d0a9488127e38882e4 P e4cb0de34ebf4e7a9c6caf56e5f1c4da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4cb0de34ebf4e7a9c6caf56e5f1c4da, State: Initialized, Role: FOLLOWER
I20260811 16:37:41.003809 29382 ts_tablet_manager.cc:1428] T 7d0463e95f5343d0a9488127e38882e4 P c613eb3a1d434d34b84e77215cfba948: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260811 16:37:41.003875 29384 consensus_queue.cc:260] T 7d0463e95f5343d0a9488127e38882e4 P e4cb0de34ebf4e7a9c6caf56e5f1c4da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40147 } } peers { permanent_uuid: "c613eb3a1d434d34b84e77215cfba948" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38489 } } peers { permanent_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 37023 } }
I20260811 16:37:41.003995 29389 tablet_bootstrap.cc:492] T 7d0463e95f5343d0a9488127e38882e4 P e37cc4ca1b0d44579f8dd7fa986123d8: Bootstrap starting.
I20260811 16:37:41.004069 29384 ts_tablet_manager.cc:1428] T 7d0463e95f5343d0a9488127e38882e4 P e4cb0de34ebf4e7a9c6caf56e5f1c4da: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 16:37:41.004384 29389 tablet_bootstrap.cc:654] T 7d0463e95f5343d0a9488127e38882e4 P e37cc4ca1b0d44579f8dd7fa986123d8: Neither blocks nor log segments found. Creating new log.
I20260811 16:37:41.005014 29389 tablet_bootstrap.cc:492] T 7d0463e95f5343d0a9488127e38882e4 P e37cc4ca1b0d44579f8dd7fa986123d8: No bootstrap required, opened a new log
I20260811 16:37:41.005059 29389 ts_tablet_manager.cc:1397] T 7d0463e95f5343d0a9488127e38882e4 P e37cc4ca1b0d44579f8dd7fa986123d8: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 16:37:41.005162 29389 raft_consensus.cc:348] T 7d0463e95f5343d0a9488127e38882e4 P e37cc4ca1b0d44579f8dd7fa986123d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40147 } } peers { permanent_uuid: "c613eb3a1d434d34b84e77215cfba948" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38489 } } peers { permanent_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 37023 } }
I20260811 16:37:41.005213 29389 raft_consensus.cc:374] T 7d0463e95f5343d0a9488127e38882e4 P e37cc4ca1b0d44579f8dd7fa986123d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:37:41.005239 29389 raft_consensus.cc:729] T 7d0463e95f5343d0a9488127e38882e4 P e37cc4ca1b0d44579f8dd7fa986123d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e37cc4ca1b0d44579f8dd7fa986123d8, State: Initialized, Role: FOLLOWER
I20260811 16:37:41.005290 29389 consensus_queue.cc:260] T 7d0463e95f5343d0a9488127e38882e4 P e37cc4ca1b0d44579f8dd7fa986123d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40147 } } peers { permanent_uuid: "c613eb3a1d434d34b84e77215cfba948" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38489 } } peers { permanent_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 37023 } }
I20260811 16:37:41.005381 29389 ts_tablet_manager.cc:1428] T 7d0463e95f5343d0a9488127e38882e4 P e37cc4ca1b0d44579f8dd7fa986123d8: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:41.138033 29388 raft_consensus.cc:482] T 7d0463e95f5343d0a9488127e38882e4 P c613eb3a1d434d34b84e77215cfba948 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:37:41.138130 29388 raft_consensus.cc:504] T 7d0463e95f5343d0a9488127e38882e4 P c613eb3a1d434d34b84e77215cfba948 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40147 } } peers { permanent_uuid: "c613eb3a1d434d34b84e77215cfba948" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38489 } } peers { permanent_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 37023 } }
I20260811 16:37:41.138453 29388 leader_election.cc:288] T 7d0463e95f5343d0a9488127e38882e4 P c613eb3a1d434d34b84e77215cfba948 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4cb0de34ebf4e7a9c6caf56e5f1c4da (127.24.175.193:40147), e37cc4ca1b0d44579f8dd7fa986123d8 (127.24.175.195:37023)
I20260811 16:37:41.142442 29397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:41.138707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:49907 (local address 127.24.175.193:40147)
0811 16:37:41.138861 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:41.138863 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:41.138974 (+ 111us) server_negotiation.cc:407] Connection header received
0811 16:37:41.139021 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:41.139022 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:41.139032 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:41.139095 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:37:41.139278 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:41.139886 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:41.141348 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:41.142008 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:41.142087 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:41.142097 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:41.142315 (+ 218us) server_negotiation.cc:299] Negotiation successful
0811 16:37:41.142369 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":90,"threads_started":1}
I20260811 16:37:41.142467 29396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:41.138691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:60991 (local address 127.24.175.195:37023)
0811 16:37:41.138861 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:41.138863 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:41.138895 (+ 32us) server_negotiation.cc:407] Connection header received
0811 16:37:41.138982 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:41.138983 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:41.138996 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:41.139083 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:37:41.139609 (+ 526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:41.140193 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:41.141429 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:41.142040 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:41.142105 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:41.142113 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:41.142330 (+ 217us) server_negotiation.cc:299] Negotiation successful
0811 16:37:41.142407 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":102,"threads_started":1}
I20260811 16:37:41.142467 29394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:41.138635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.195:37023 (local address 127.24.175.194:60991)
0811 16:37:41.138833 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:41.138843 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:41.138910 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:41.139091 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:41.139093 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:41.139096 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:37:41.139529 (+ 433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:41.139533 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:41.140289 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:41.140290 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:41.141336 (+ 1046us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:41.141338 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:41.142109 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:41.142110 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:41.142234 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:41.142240 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 16:37:41.142295 (+ 55us) client_negotiation.cc:240] Negotiation successful
0811 16:37:41.142342 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"mutex_wait_us":4,"thread_start_us":114,"threads_started":1}
I20260811 16:37:41.142469 29392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:41.138637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.193:40147 (local address 127.24.175.194:49907)
0811 16:37:41.138908 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:41.138917 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:41.138967 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:41.139102 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:41.139103 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:41.139105 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:37:41.139208 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:41.139211 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:41.139979 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:41.139980 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:41.141248 (+ 1268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:41.141252 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:41.142111 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:41.142112 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:41.142234 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:41.142239 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 16:37:41.142289 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 16:37:41.142342 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"mutex_wait_us":50,"thread_start_us":93,"threads_started":1}
I20260811 16:37:41.142763 29113 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d0463e95f5343d0a9488127e38882e4" candidate_uuid: "c613eb3a1d434d34b84e77215cfba948" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" is_pre_election: true
I20260811 16:37:41.142859 29113 raft_consensus.cc:2454] T 7d0463e95f5343d0a9488127e38882e4 P e37cc4ca1b0d44579f8dd7fa986123d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c613eb3a1d434d34b84e77215cfba948 in term 0.
I20260811 16:37:41.142876 28648 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d0463e95f5343d0a9488127e38882e4" candidate_uuid: "c613eb3a1d434d34b84e77215cfba948" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" is_pre_election: true
I20260811 16:37:41.142952 28648 raft_consensus.cc:2454] T 7d0463e95f5343d0a9488127e38882e4 P e4cb0de34ebf4e7a9c6caf56e5f1c4da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c613eb3a1d434d34b84e77215cfba948 in term 0.
I20260811 16:37:41.143028 28765 leader_election.cc:302] T 7d0463e95f5343d0a9488127e38882e4 P c613eb3a1d434d34b84e77215cfba948 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c613eb3a1d434d34b84e77215cfba948, e37cc4ca1b0d44579f8dd7fa986123d8; no voters:
I20260811 16:37:41.143168 29388 raft_consensus.cc:2781] T 7d0463e95f5343d0a9488127e38882e4 P c613eb3a1d434d34b84e77215cfba948 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:37:41.143213 29388 raft_consensus.cc:482] T 7d0463e95f5343d0a9488127e38882e4 P c613eb3a1d434d34b84e77215cfba948 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:37:41.143235 29388 raft_consensus.cc:3037] T 7d0463e95f5343d0a9488127e38882e4 P c613eb3a1d434d34b84e77215cfba948 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:37:41.143919 29388 raft_consensus.cc:504] T 7d0463e95f5343d0a9488127e38882e4 P c613eb3a1d434d34b84e77215cfba948 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40147 } } peers { permanent_uuid: "c613eb3a1d434d34b84e77215cfba948" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38489 } } peers { permanent_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 37023 } }
I20260811 16:37:41.144058 29388 leader_election.cc:288] T 7d0463e95f5343d0a9488127e38882e4 P c613eb3a1d434d34b84e77215cfba948 [CANDIDATE]: Term 1 election: Requested vote from peers e4cb0de34ebf4e7a9c6caf56e5f1c4da (127.24.175.193:40147), e37cc4ca1b0d44579f8dd7fa986123d8 (127.24.175.195:37023)
I20260811 16:37:41.144230 28648 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d0463e95f5343d0a9488127e38882e4" candidate_uuid: "c613eb3a1d434d34b84e77215cfba948" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da"
I20260811 16:37:41.144233 29113 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d0463e95f5343d0a9488127e38882e4" candidate_uuid: "c613eb3a1d434d34b84e77215cfba948" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8"
I20260811 16:37:41.144310 29113 raft_consensus.cc:3037] T 7d0463e95f5343d0a9488127e38882e4 P e37cc4ca1b0d44579f8dd7fa986123d8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:37:41.144310 28648 raft_consensus.cc:3037] T 7d0463e95f5343d0a9488127e38882e4 P e4cb0de34ebf4e7a9c6caf56e5f1c4da [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:37:41.145043 29113 raft_consensus.cc:2454] T 7d0463e95f5343d0a9488127e38882e4 P e37cc4ca1b0d44579f8dd7fa986123d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c613eb3a1d434d34b84e77215cfba948 in term 1.
I20260811 16:37:41.145047 28648 raft_consensus.cc:2454] T 7d0463e95f5343d0a9488127e38882e4 P e4cb0de34ebf4e7a9c6caf56e5f1c4da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c613eb3a1d434d34b84e77215cfba948 in term 1.
I20260811 16:37:41.145218 28767 leader_election.cc:302] T 7d0463e95f5343d0a9488127e38882e4 P c613eb3a1d434d34b84e77215cfba948 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c613eb3a1d434d34b84e77215cfba948, e4cb0de34ebf4e7a9c6caf56e5f1c4da; no voters:
I20260811 16:37:41.145299 29388 raft_consensus.cc:2781] T 7d0463e95f5343d0a9488127e38882e4 P c613eb3a1d434d34b84e77215cfba948 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:37:41.145432 29388 raft_consensus.cc:686] T 7d0463e95f5343d0a9488127e38882e4 P c613eb3a1d434d34b84e77215cfba948 [term 1 LEADER]: Becoming Leader. State: Replica: c613eb3a1d434d34b84e77215cfba948, State: Running, Role: LEADER
I20260811 16:37:41.145498 29388 consensus_queue.cc:237] T 7d0463e95f5343d0a9488127e38882e4 P c613eb3a1d434d34b84e77215cfba948 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40147 } } peers { permanent_uuid: "c613eb3a1d434d34b84e77215cfba948" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38489 } } peers { permanent_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 37023 } }
I20260811 16:37:41.146226 28365 catalog_manager.cc:5495] T 7d0463e95f5343d0a9488127e38882e4 P c613eb3a1d434d34b84e77215cfba948 reported cstate change: term changed from 0 to 1, leader changed from <none> to c613eb3a1d434d34b84e77215cfba948 (127.24.175.194). New cstate: current_term: 1 leader_uuid: "c613eb3a1d434d34b84e77215cfba948" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c613eb3a1d434d34b84e77215cfba948" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 37023 } health_report { overall_health: UNKNOWN } } }
I20260811 16:37:41.186892 29404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:41.184271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37096 (local address 127.24.175.194:38489)
0811 16:37:41.184420 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:41.184422 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:41.184428 (+ 6us) server_negotiation.cc:407] Connection header received
0811 16:37:41.184463 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:41.184463 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:41.184482 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:41.184553 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:37:41.184717 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:41.185298 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:41.186046 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:41.186324 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:41.186382 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:41.186559 (+ 177us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:37:41.186672 (+ 113us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:37:41.186739 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:41.186777 (+ 38us) server_negotiation.cc:299] Negotiation successful
0811 16:37:41.186801 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":81,"threads_started":1}
I20260811 16:37:41.191390 29396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:41.189206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:60789 (local address 127.24.175.195:37023)
0811 16:37:41.189250 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:41.189252 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:41.189298 (+ 46us) server_negotiation.cc:407] Connection header received
0811 16:37:41.189362 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:41.189362 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:41.189372 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:41.189413 (+ 41us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:37:41.189536 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:41.189998 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:41.190774 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:41.190962 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:41.191015 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:41.191180 (+ 165us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:37:41.191206 (+ 26us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:37:41.191246 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:41.191298 (+ 52us) server_negotiation.cc:299] Negotiation successful
0811 16:37:41.191318 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 16:37:41.191419 29408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:41.189100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.195:37023 (local address 127.24.175.194:60789)
0811 16:37:41.189244 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:41.189255 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:41.189311 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:41.189419 (+ 108us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:41.189420 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:41.189422 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 16:37:41.189479 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:41.189480 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:41.190069 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:41.190070 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:41.190696 (+ 626us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:41.190699 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:41.191021 (+ 322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:41.191022 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:41.191095 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:41.191109 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 16:37:41.191253 (+ 144us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 16:37:41.191254 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 16:37:41.191295 (+ 41us) client_negotiation.cc:240] Negotiation successful
0811 16:37:41.191337 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":60,"threads_started":1}
I20260811 16:37:41.193202 29113 raft_consensus.cc:1261] T 7d0463e95f5343d0a9488127e38882e4 P e37cc4ca1b0d44579f8dd7fa986123d8 [term 1 FOLLOWER]: Refusing update from remote peer c613eb3a1d434d34b84e77215cfba948: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:37:41.193205 28648 raft_consensus.cc:1261] T 7d0463e95f5343d0a9488127e38882e4 P e4cb0de34ebf4e7a9c6caf56e5f1c4da [term 1 FOLLOWER]: Refusing update from remote peer c613eb3a1d434d34b84e77215cfba948: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:37:41.193435 29388 consensus_queue.cc:1035] T 7d0463e95f5343d0a9488127e38882e4 P c613eb3a1d434d34b84e77215cfba948 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 37023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:37:41.193586 29388 consensus_queue.cc:1035] T 7d0463e95f5343d0a9488127e38882e4 P c613eb3a1d434d34b84e77215cfba948 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:37:41.199770 29404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:41.197602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.195:52103 (local address 127.24.175.194:38489)
0811 16:37:41.197635 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:41.197636 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:41.197754 (+ 118us) server_negotiation.cc:407] Connection header received
0811 16:37:41.197805 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:41.197806 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:41.197816 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:41.197858 (+ 42us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:37:41.197945 (+ 87us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:41.198475 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:41.199155 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:41.199355 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:41.199404 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:41.199545 (+ 141us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:37:41.199589 (+ 44us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:37:41.199644 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:41.199691 (+ 47us) server_negotiation.cc:299] Negotiation successful
0811 16:37:41.199712 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260811 16:37:41.199788 29414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:41.197557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.194:38489 (local address 127.24.175.195:52103)
0811 16:37:41.197686 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:41.197696 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:41.197755 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:41.197859 (+ 104us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:41.197860 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:41.197862 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 16:37:41.197903 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:41.197904 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:41.198543 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:41.198544 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:41.199086 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:41.199088 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:41.199427 (+ 339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:41.199429 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:41.199481 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:41.199485 (+ 4us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 16:37:41.199645 (+ 160us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 16:37:41.199647 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 16:37:41.199689 (+ 42us) client_negotiation.cc:240] Negotiation successful
0811 16:37:41.199731 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":73,"threads_started":1}
I20260811 16:37:41.206915 28367 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55448:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:37:41.207017 28367 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55448:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:37:41.207635 28367 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 09d25b60ed7241c8bcb7d373cfb7d769: Sending DeleteTablet for 3 replicas of tablet 7d0463e95f5343d0a9488127e38882e4
I20260811 16:37:41.207849 28608 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d0463e95f5343d0a9488127e38882e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:37:41 UTC) from {username='kudu', principal='kudu/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:60166
I20260811 16:37:41.207921 28854 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d0463e95f5343d0a9488127e38882e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:37:41 UTC) from {username='kudu', principal='kudu/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:37094
I20260811 16:37:41.207917 29083 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d0463e95f5343d0a9488127e38882e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:37:41 UTC) from {username='kudu', principal='kudu/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:58278
I20260811 16:37:41.207947 29361 tablet_replica.cc:330] T 7d0463e95f5343d0a9488127e38882e4 P e4cb0de34ebf4e7a9c6caf56e5f1c4da: stopping tablet replica
I20260811 16:37:41.207988 29361 raft_consensus.cc:2229] T 7d0463e95f5343d0a9488127e38882e4 P e4cb0de34ebf4e7a9c6caf56e5f1c4da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:37:41.207998 29368 tablet_replica.cc:330] T 7d0463e95f5343d0a9488127e38882e4 P c613eb3a1d434d34b84e77215cfba948: stopping tablet replica
I20260811 16:37:41.208019 29361 raft_consensus.cc:2258] T 7d0463e95f5343d0a9488127e38882e4 P e4cb0de34ebf4e7a9c6caf56e5f1c4da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:37:41.208035 29368 raft_consensus.cc:2229] T 7d0463e95f5343d0a9488127e38882e4 P c613eb3a1d434d34b84e77215cfba948 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:37:41.208112 29368 raft_consensus.cc:2258] T 7d0463e95f5343d0a9488127e38882e4 P c613eb3a1d434d34b84e77215cfba948 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:37:41.208178 29366 tablet_replica.cc:330] T 7d0463e95f5343d0a9488127e38882e4 P e37cc4ca1b0d44579f8dd7fa986123d8: stopping tablet replica
I20260811 16:37:41.208233 29366 raft_consensus.cc:2229] T 7d0463e95f5343d0a9488127e38882e4 P e37cc4ca1b0d44579f8dd7fa986123d8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:37:41.208276 29366 raft_consensus.cc:2258] T 7d0463e95f5343d0a9488127e38882e4 P e37cc4ca1b0d44579f8dd7fa986123d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:37:41.208396 29361 ts_tablet_manager.cc:1905] T 7d0463e95f5343d0a9488127e38882e4 P e4cb0de34ebf4e7a9c6caf56e5f1c4da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:37:41.208595 29368 ts_tablet_manager.cc:1905] T 7d0463e95f5343d0a9488127e38882e4 P c613eb3a1d434d34b84e77215cfba948: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:37:41.208611 29366 ts_tablet_manager.cc:1905] T 7d0463e95f5343d0a9488127e38882e4 P e37cc4ca1b0d44579f8dd7fa986123d8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:37:41.210094 29361 ts_tablet_manager.cc:1918] T 7d0463e95f5343d0a9488127e38882e4 P e4cb0de34ebf4e7a9c6caf56e5f1c4da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 16:37:41.210175 29361 log.cc:1196] T 7d0463e95f5343d0a9488127e38882e4 P e4cb0de34ebf4e7a9c6caf56e5f1c4da: Deleting WAL directory at /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/ts-0/wal/wals/7d0463e95f5343d0a9488127e38882e4
I20260811 16:37:41.210213 29366 ts_tablet_manager.cc:1918] T 7d0463e95f5343d0a9488127e38882e4 P e37cc4ca1b0d44579f8dd7fa986123d8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 16:37:41.210265 29366 log.cc:1196] T 7d0463e95f5343d0a9488127e38882e4 P e37cc4ca1b0d44579f8dd7fa986123d8: Deleting WAL directory at /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/ts-2/wal/wals/7d0463e95f5343d0a9488127e38882e4
I20260811 16:37:41.210379 29368 ts_tablet_manager.cc:1918] T 7d0463e95f5343d0a9488127e38882e4 P c613eb3a1d434d34b84e77215cfba948: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 16:37:41.210390 29361 ts_tablet_manager.cc:1939] T 7d0463e95f5343d0a9488127e38882e4 P e4cb0de34ebf4e7a9c6caf56e5f1c4da: Deleting consensus metadata
I20260811 16:37:41.210425 29368 log.cc:1196] T 7d0463e95f5343d0a9488127e38882e4 P c613eb3a1d434d34b84e77215cfba948: Deleting WAL directory at /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/ts-1/wal/wals/7d0463e95f5343d0a9488127e38882e4
I20260811 16:37:41.210487 29366 ts_tablet_manager.cc:1939] T 7d0463e95f5343d0a9488127e38882e4 P e37cc4ca1b0d44579f8dd7fa986123d8: Deleting consensus metadata
I20260811 16:37:41.210659 29368 ts_tablet_manager.cc:1939] T 7d0463e95f5343d0a9488127e38882e4 P c613eb3a1d434d34b84e77215cfba948: Deleting consensus metadata
I20260811 16:37:41.210651 28367 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55448:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:37:41.210803 28367 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:37:41.210820 28341 catalog_manager.cc:4841] TS e4cb0de34ebf4e7a9c6caf56e5f1c4da (127.24.175.193:40147): tablet 7d0463e95f5343d0a9488127e38882e4 (table test-table [id=bb8a5cd9cd0b41aaa772599cb06216a3]) successfully deleted
I20260811 16:37:41.211053 28345 catalog_manager.cc:4841] TS c613eb3a1d434d34b84e77215cfba948 (127.24.175.194:38489): tablet 7d0463e95f5343d0a9488127e38882e4 (table test-table [id=bb8a5cd9cd0b41aaa772599cb06216a3]) successfully deleted
I20260811 16:37:41.211355 28340 catalog_manager.cc:4841] TS e37cc4ca1b0d44579f8dd7fa986123d8 (127.24.175.195:37023): tablet 7d0463e95f5343d0a9488127e38882e4 (table test-table [id=bb8a5cd9cd0b41aaa772599cb06216a3]) successfully deleted
I20260811 16:37:41.211947 29083 tablet_service.cc:1467] Processing CreateTablet for tablet c3800fd09cb746ddb29e04f3295bb692 (DEFAULT_TABLE table=test-table [id=a0373380c10341dcbedc2a96277dd9ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:37:41.211974 28854 tablet_service.cc:1467] Processing CreateTablet for tablet c3800fd09cb746ddb29e04f3295bb692 (DEFAULT_TABLE table=test-table [id=a0373380c10341dcbedc2a96277dd9ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:37:41.211999 28608 tablet_service.cc:1467] Processing CreateTablet for tablet c3800fd09cb746ddb29e04f3295bb692 (DEFAULT_TABLE table=test-table [id=a0373380c10341dcbedc2a96277dd9ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:37:41.212051 29083 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3800fd09cb746ddb29e04f3295bb692. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:37:41.212080 28608 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3800fd09cb746ddb29e04f3295bb692. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:37:41.212091 28854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3800fd09cb746ddb29e04f3295bb692. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:37:41.213181 29389 tablet_bootstrap.cc:492] T c3800fd09cb746ddb29e04f3295bb692 P e37cc4ca1b0d44579f8dd7fa986123d8: Bootstrap starting.
I20260811 16:37:41.213222 29382 tablet_bootstrap.cc:492] T c3800fd09cb746ddb29e04f3295bb692 P c613eb3a1d434d34b84e77215cfba948: Bootstrap starting.
I20260811 16:37:41.213462 29389 tablet_bootstrap.cc:654] T c3800fd09cb746ddb29e04f3295bb692 P e37cc4ca1b0d44579f8dd7fa986123d8: Neither blocks nor log segments found. Creating new log.
I20260811 16:37:41.213599 29382 tablet_bootstrap.cc:654] T c3800fd09cb746ddb29e04f3295bb692 P c613eb3a1d434d34b84e77215cfba948: Neither blocks nor log segments found. Creating new log.
I20260811 16:37:41.213688 29384 tablet_bootstrap.cc:492] T c3800fd09cb746ddb29e04f3295bb692 P e4cb0de34ebf4e7a9c6caf56e5f1c4da: Bootstrap starting.
I20260811 16:37:41.213966 29384 tablet_bootstrap.cc:654] T c3800fd09cb746ddb29e04f3295bb692 P e4cb0de34ebf4e7a9c6caf56e5f1c4da: Neither blocks nor log segments found. Creating new log.
I20260811 16:37:41.214251 29382 tablet_bootstrap.cc:492] T c3800fd09cb746ddb29e04f3295bb692 P c613eb3a1d434d34b84e77215cfba948: No bootstrap required, opened a new log
I20260811 16:37:41.214300 29382 ts_tablet_manager.cc:1397] T c3800fd09cb746ddb29e04f3295bb692 P c613eb3a1d434d34b84e77215cfba948: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 16:37:41.214462 29382 raft_consensus.cc:348] T c3800fd09cb746ddb29e04f3295bb692 P c613eb3a1d434d34b84e77215cfba948 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40147 } } peers { permanent_uuid: "c613eb3a1d434d34b84e77215cfba948" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38489 } } peers { permanent_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 37023 } }
I20260811 16:37:41.214511 29384 tablet_bootstrap.cc:492] T c3800fd09cb746ddb29e04f3295bb692 P e4cb0de34ebf4e7a9c6caf56e5f1c4da: No bootstrap required, opened a new log
I20260811 16:37:41.214524 29382 raft_consensus.cc:374] T c3800fd09cb746ddb29e04f3295bb692 P c613eb3a1d434d34b84e77215cfba948 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:37:41.214545 29382 raft_consensus.cc:729] T c3800fd09cb746ddb29e04f3295bb692 P c613eb3a1d434d34b84e77215cfba948 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c613eb3a1d434d34b84e77215cfba948, State: Initialized, Role: FOLLOWER
I20260811 16:37:41.214555 29384 ts_tablet_manager.cc:1397] T c3800fd09cb746ddb29e04f3295bb692 P e4cb0de34ebf4e7a9c6caf56e5f1c4da: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 16:37:41.214583 29382 consensus_queue.cc:260] T c3800fd09cb746ddb29e04f3295bb692 P c613eb3a1d434d34b84e77215cfba948 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40147 } } peers { permanent_uuid: "c613eb3a1d434d34b84e77215cfba948" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38489 } } peers { permanent_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 37023 } }
I20260811 16:37:41.214651 29384 raft_consensus.cc:348] T c3800fd09cb746ddb29e04f3295bb692 P e4cb0de34ebf4e7a9c6caf56e5f1c4da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40147 } } peers { permanent_uuid: "c613eb3a1d434d34b84e77215cfba948" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38489 } } peers { permanent_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 37023 } }
I20260811 16:37:41.214689 29382 ts_tablet_manager.cc:1428] T c3800fd09cb746ddb29e04f3295bb692 P c613eb3a1d434d34b84e77215cfba948: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:41.214711 29384 raft_consensus.cc:374] T c3800fd09cb746ddb29e04f3295bb692 P e4cb0de34ebf4e7a9c6caf56e5f1c4da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:37:41.214741 29384 raft_consensus.cc:729] T c3800fd09cb746ddb29e04f3295bb692 P e4cb0de34ebf4e7a9c6caf56e5f1c4da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4cb0de34ebf4e7a9c6caf56e5f1c4da, State: Initialized, Role: FOLLOWER
I20260811 16:37:41.214783 29384 consensus_queue.cc:260] T c3800fd09cb746ddb29e04f3295bb692 P e4cb0de34ebf4e7a9c6caf56e5f1c4da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40147 } } peers { permanent_uuid: "c613eb3a1d434d34b84e77215cfba948" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38489 } } peers { permanent_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 37023 } }
I20260811 16:37:41.214870 29384 ts_tablet_manager.cc:1428] T c3800fd09cb746ddb29e04f3295bb692 P e4cb0de34ebf4e7a9c6caf56e5f1c4da: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:41.214905 29389 tablet_bootstrap.cc:492] T c3800fd09cb746ddb29e04f3295bb692 P e37cc4ca1b0d44579f8dd7fa986123d8: No bootstrap required, opened a new log
I20260811 16:37:41.214943 29389 ts_tablet_manager.cc:1397] T c3800fd09cb746ddb29e04f3295bb692 P e37cc4ca1b0d44579f8dd7fa986123d8: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.000s
I20260811 16:37:41.215031 29389 raft_consensus.cc:348] T c3800fd09cb746ddb29e04f3295bb692 P e37cc4ca1b0d44579f8dd7fa986123d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40147 } } peers { permanent_uuid: "c613eb3a1d434d34b84e77215cfba948" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38489 } } peers { permanent_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 37023 } }
I20260811 16:37:41.215087 29389 raft_consensus.cc:374] T c3800fd09cb746ddb29e04f3295bb692 P e37cc4ca1b0d44579f8dd7fa986123d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:37:41.215101 29389 raft_consensus.cc:729] T c3800fd09cb746ddb29e04f3295bb692 P e37cc4ca1b0d44579f8dd7fa986123d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e37cc4ca1b0d44579f8dd7fa986123d8, State: Initialized, Role: FOLLOWER
I20260811 16:37:41.215133 29389 consensus_queue.cc:260] T c3800fd09cb746ddb29e04f3295bb692 P e37cc4ca1b0d44579f8dd7fa986123d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40147 } } peers { permanent_uuid: "c613eb3a1d434d34b84e77215cfba948" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38489 } } peers { permanent_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 37023 } }
I20260811 16:37:41.215212 29389 ts_tablet_manager.cc:1428] T c3800fd09cb746ddb29e04f3295bb692 P e37cc4ca1b0d44579f8dd7fa986123d8: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:41.412636 29348 raft_consensus.cc:482] T c3800fd09cb746ddb29e04f3295bb692 P e4cb0de34ebf4e7a9c6caf56e5f1c4da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:37:41.412737 29348 raft_consensus.cc:504] T c3800fd09cb746ddb29e04f3295bb692 P e4cb0de34ebf4e7a9c6caf56e5f1c4da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40147 } } peers { permanent_uuid: "c613eb3a1d434d34b84e77215cfba948" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38489 } } peers { permanent_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 37023 } }
I20260811 16:37:41.412912 29348 leader_election.cc:288] T c3800fd09cb746ddb29e04f3295bb692 P e4cb0de34ebf4e7a9c6caf56e5f1c4da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c613eb3a1d434d34b84e77215cfba948 (127.24.175.194:38489), e37cc4ca1b0d44579f8dd7fa986123d8 (127.24.175.195:37023)
I20260811 16:37:41.413113 28886 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3800fd09cb746ddb29e04f3295bb692" candidate_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c613eb3a1d434d34b84e77215cfba948" is_pre_election: true
I20260811 16:37:41.413216 28886 raft_consensus.cc:2454] T c3800fd09cb746ddb29e04f3295bb692 P c613eb3a1d434d34b84e77215cfba948 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4cb0de34ebf4e7a9c6caf56e5f1c4da in term 0.
I20260811 16:37:41.413170 29113 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3800fd09cb746ddb29e04f3295bb692" candidate_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" is_pre_election: true
I20260811 16:37:41.413265 29113 raft_consensus.cc:2454] T c3800fd09cb746ddb29e04f3295bb692 P e37cc4ca1b0d44579f8dd7fa986123d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4cb0de34ebf4e7a9c6caf56e5f1c4da in term 0.
I20260811 16:37:41.413372 28531 leader_election.cc:302] T c3800fd09cb746ddb29e04f3295bb692 P e4cb0de34ebf4e7a9c6caf56e5f1c4da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c613eb3a1d434d34b84e77215cfba948, e4cb0de34ebf4e7a9c6caf56e5f1c4da; no voters:
I20260811 16:37:41.413481 29348 raft_consensus.cc:2781] T c3800fd09cb746ddb29e04f3295bb692 P e4cb0de34ebf4e7a9c6caf56e5f1c4da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:37:41.413532 29348 raft_consensus.cc:482] T c3800fd09cb746ddb29e04f3295bb692 P e4cb0de34ebf4e7a9c6caf56e5f1c4da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:37:41.413546 29348 raft_consensus.cc:3037] T c3800fd09cb746ddb29e04f3295bb692 P e4cb0de34ebf4e7a9c6caf56e5f1c4da [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:37:41.414333 29348 raft_consensus.cc:504] T c3800fd09cb746ddb29e04f3295bb692 P e4cb0de34ebf4e7a9c6caf56e5f1c4da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40147 } } peers { permanent_uuid: "c613eb3a1d434d34b84e77215cfba948" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38489 } } peers { permanent_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 37023 } }
I20260811 16:37:41.414460 29348 leader_election.cc:288] T c3800fd09cb746ddb29e04f3295bb692 P e4cb0de34ebf4e7a9c6caf56e5f1c4da [CANDIDATE]: Term 1 election: Requested vote from peers c613eb3a1d434d34b84e77215cfba948 (127.24.175.194:38489), e37cc4ca1b0d44579f8dd7fa986123d8 (127.24.175.195:37023)
I20260811 16:37:41.414626 28886 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3800fd09cb746ddb29e04f3295bb692" candidate_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c613eb3a1d434d34b84e77215cfba948"
I20260811 16:37:41.414628 29113 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3800fd09cb746ddb29e04f3295bb692" candidate_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8"
I20260811 16:37:41.414710 29113 raft_consensus.cc:3037] T c3800fd09cb746ddb29e04f3295bb692 P e37cc4ca1b0d44579f8dd7fa986123d8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:37:41.414711 28886 raft_consensus.cc:3037] T c3800fd09cb746ddb29e04f3295bb692 P c613eb3a1d434d34b84e77215cfba948 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:37:41.415481 28886 raft_consensus.cc:2454] T c3800fd09cb746ddb29e04f3295bb692 P c613eb3a1d434d34b84e77215cfba948 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4cb0de34ebf4e7a9c6caf56e5f1c4da in term 1.
I20260811 16:37:41.415480 29113 raft_consensus.cc:2454] T c3800fd09cb746ddb29e04f3295bb692 P e37cc4ca1b0d44579f8dd7fa986123d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4cb0de34ebf4e7a9c6caf56e5f1c4da in term 1.
I20260811 16:37:41.415640 28531 leader_election.cc:302] T c3800fd09cb746ddb29e04f3295bb692 P e4cb0de34ebf4e7a9c6caf56e5f1c4da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c613eb3a1d434d34b84e77215cfba948, e4cb0de34ebf4e7a9c6caf56e5f1c4da; no voters:
I20260811 16:37:41.415761 29348 raft_consensus.cc:2781] T c3800fd09cb746ddb29e04f3295bb692 P e4cb0de34ebf4e7a9c6caf56e5f1c4da [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:37:41.415819 29348 raft_consensus.cc:686] T c3800fd09cb746ddb29e04f3295bb692 P e4cb0de34ebf4e7a9c6caf56e5f1c4da [term 1 LEADER]: Becoming Leader. State: Replica: e4cb0de34ebf4e7a9c6caf56e5f1c4da, State: Running, Role: LEADER
I20260811 16:37:41.415868 29348 consensus_queue.cc:237] T c3800fd09cb746ddb29e04f3295bb692 P e4cb0de34ebf4e7a9c6caf56e5f1c4da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40147 } } peers { permanent_uuid: "c613eb3a1d434d34b84e77215cfba948" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38489 } } peers { permanent_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 37023 } }
I20260811 16:37:41.416426 28365 catalog_manager.cc:5495] T c3800fd09cb746ddb29e04f3295bb692 P e4cb0de34ebf4e7a9c6caf56e5f1c4da reported cstate change: term changed from 0 to 1, leader changed from <none> to e4cb0de34ebf4e7a9c6caf56e5f1c4da (127.24.175.193). New cstate: current_term: 1 leader_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cb0de34ebf4e7a9c6caf56e5f1c4da" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c613eb3a1d434d34b84e77215cfba948" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 37023 } health_report { overall_health: UNKNOWN } } }
I20260811 16:37:41.442970 29397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:41.440831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60184 (local address 127.24.175.193:40147)
0811 16:37:41.440874 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:41.440876 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:41.440885 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:37:41.440949 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:41.440950 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:41.440959 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:41.441013 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:37:41.441121 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:41.441601 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:41.442340 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:41.442547 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:41.442600 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:41.442737 (+ 137us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:37:41.442770 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:37:41.442809 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:41.442860 (+ 51us) server_negotiation.cc:299] Negotiation successful
0811 16:37:41.442883 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 16:37:41.444900 28886 raft_consensus.cc:1261] T c3800fd09cb746ddb29e04f3295bb692 P c613eb3a1d434d34b84e77215cfba948 [term 1 FOLLOWER]: Refusing update from remote peer e4cb0de34ebf4e7a9c6caf56e5f1c4da: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:37:41.444900 29113 raft_consensus.cc:1261] T c3800fd09cb746ddb29e04f3295bb692 P e37cc4ca1b0d44579f8dd7fa986123d8 [term 1 FOLLOWER]: Refusing update from remote peer e4cb0de34ebf4e7a9c6caf56e5f1c4da: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:37:41.445096 29344 consensus_queue.cc:1035] T c3800fd09cb746ddb29e04f3295bb692 P e4cb0de34ebf4e7a9c6caf56e5f1c4da [LEADER]: Connected to new peer: Peer: permanent_uuid: "c613eb3a1d434d34b84e77215cfba948" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:37:41.445192 29348 consensus_queue.cc:1035] T c3800fd09cb746ddb29e04f3295bb692 P e4cb0de34ebf4e7a9c6caf56e5f1c4da [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37cc4ca1b0d44579f8dd7fa986123d8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 37023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 16:37:41.449195 29330 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260811 16:37:42.965090 28367 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55448:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:37:42.965190 28367 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55448:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:37:42.965976 28367 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 09d25b60ed7241c8bcb7d373cfb7d769: Sending DeleteTablet for 3 replicas of tablet c3800fd09cb746ddb29e04f3295bb692
I20260811 16:37:42.966276 28608 tablet_service.cc:1514] Processing DeleteTablet for tablet c3800fd09cb746ddb29e04f3295bb692 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:37:42 UTC) from {username='kudu', principal='kudu/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:60166
I20260811 16:37:42.966264 29082 tablet_service.cc:1514] Processing DeleteTablet for tablet c3800fd09cb746ddb29e04f3295bb692 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:37:42 UTC) from {username='kudu', principal='kudu/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:58278
I20260811 16:37:42.966383 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 28497
I20260811 16:37:42.966447 28854 tablet_service.cc:1514] Processing DeleteTablet for tablet c3800fd09cb746ddb29e04f3295bb692 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:37:42 UTC) from {username='kudu', principal='kudu/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:37094
I20260811 16:37:42.977408 29462 tablet_replica.cc:330] T c3800fd09cb746ddb29e04f3295bb692 P c613eb3a1d434d34b84e77215cfba948: stopping tablet replica
I20260811 16:37:42.977479 29462 raft_consensus.cc:2229] T c3800fd09cb746ddb29e04f3295bb692 P c613eb3a1d434d34b84e77215cfba948 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:37:42.977515 29462 raft_consensus.cc:2258] T c3800fd09cb746ddb29e04f3295bb692 P c613eb3a1d434d34b84e77215cfba948 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:37:42.977771 29462 ts_tablet_manager.cc:1905] T c3800fd09cb746ddb29e04f3295bb692 P c613eb3a1d434d34b84e77215cfba948: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:37:42.978147 29460 tablet_replica.cc:330] T c3800fd09cb746ddb29e04f3295bb692 P e37cc4ca1b0d44579f8dd7fa986123d8: stopping tablet replica
I20260811 16:37:42.978287 29460 raft_consensus.cc:2229] T c3800fd09cb746ddb29e04f3295bb692 P e37cc4ca1b0d44579f8dd7fa986123d8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:37:42.978368 29460 raft_consensus.cc:2258] T c3800fd09cb746ddb29e04f3295bb692 P e37cc4ca1b0d44579f8dd7fa986123d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:37:42.978662 29460 ts_tablet_manager.cc:1905] T c3800fd09cb746ddb29e04f3295bb692 P e37cc4ca1b0d44579f8dd7fa986123d8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:37:42.979548 29462 ts_tablet_manager.cc:1918] T c3800fd09cb746ddb29e04f3295bb692 P c613eb3a1d434d34b84e77215cfba948: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 16:37:42.979625 29462 log.cc:1196] T c3800fd09cb746ddb29e04f3295bb692 P c613eb3a1d434d34b84e77215cfba948: Deleting WAL directory at /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/ts-1/wal/wals/c3800fd09cb746ddb29e04f3295bb692
I20260811 16:37:42.979882 29462 ts_tablet_manager.cc:1939] T c3800fd09cb746ddb29e04f3295bb692 P c613eb3a1d434d34b84e77215cfba948: Deleting consensus metadata
I20260811 16:37:42.980228 28345 catalog_manager.cc:4841] TS c613eb3a1d434d34b84e77215cfba948 (127.24.175.194:38489): tablet c3800fd09cb746ddb29e04f3295bb692 (table test-table [id=a0373380c10341dcbedc2a96277dd9ec]) successfully deleted
I20260811 16:37:42.980336 29460 ts_tablet_manager.cc:1918] T c3800fd09cb746ddb29e04f3295bb692 P e37cc4ca1b0d44579f8dd7fa986123d8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 16:37:42.980388 29460 log.cc:1196] T c3800fd09cb746ddb29e04f3295bb692 P e37cc4ca1b0d44579f8dd7fa986123d8: Deleting WAL directory at /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466249441839-25279-0/minicluster-data/ts-2/wal/wals/c3800fd09cb746ddb29e04f3295bb692
I20260811 16:37:42.980568 29460 ts_tablet_manager.cc:1939] T c3800fd09cb746ddb29e04f3295bb692 P e37cc4ca1b0d44579f8dd7fa986123d8: Deleting consensus metadata
I20260811 16:37:42.980881 28340 catalog_manager.cc:4841] TS e37cc4ca1b0d44579f8dd7fa986123d8 (127.24.175.195:37023): tablet c3800fd09cb746ddb29e04f3295bb692 (table test-table [id=a0373380c10341dcbedc2a96277dd9ec]) successfully deleted
W20260811 16:37:42.984275 28341 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.24.175.193:40147 (error 108)
I20260811 16:37:42.984493 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 28739
I20260811 16:37:42.988246 29466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:42.988008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.193:40147 (local address 127.0.0.1:50172)
0811 16:37:42.988157 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:42.988211 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.193:40147: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":62,"threads_started":1}
W20260811 16:37:42.988394 28341 catalog_manager.cc:4584] TS e4cb0de34ebf4e7a9c6caf56e5f1c4da (127.24.175.193:40147): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c3800fd09cb746ddb29e04f3295bb692: Network error: Client connection negotiation failed: client connection to 127.24.175.193:40147: connect: Connection refused (error 111)
I20260811 16:37:42.993795 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 28970
I20260811 16:37:43.001124 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 28312
2026-08-11T16:37:43Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6194 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:37:43 dist-test-slave-zj8q krb5kdc[29471](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:37:43 dist-test-slave-zj8q krb5kdc[29471](info): set up 2 sockets
Aug 11 16:37:43 dist-test-slave-zj8q krb5kdc[29471](info): commencing operation
krb5kdc: starting...
W20260811 16:37:44.178803 25279 mini_kdc.cc:121] Time spent starting KDC: real 1.148s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Aug 11 16:37:44 dist-test-slave-zj8q krb5kdc[29471](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466264, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:37:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:37:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab.
Entry for principal kudu/127.24.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab.
I20260811 16:37:44.289502 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:36445
--webserver_interface=127.24.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:35697
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.175.254:36445
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:37:44.370409 29491 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:37:44.370621 29491 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:37:44.370653 29491 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:37:44.371775 29491 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:37:44.371816 29491 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:37:44.371837 29491 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:37:44.371853 29491 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:37:44.371868 29491 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:37:44.373430 29491 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:35697
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.175.254:36445
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:36445
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29491
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:37:44.373692 29491 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:37:44.373893 29491 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:37:44.379091 29498 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:44.379066 29502 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:44.379073 29497 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:37:44.379107 29491 server_base.cc:1034] running on GCE node
I20260811 16:37:44.379487 29491 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:37:44.379756 29491 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:37:44.380898 29491 hybrid_clock.cc:648] HybridClock initialized: now 1786466264380885 us; error 32 us; skew 500 ppm
Aug 11 16:37:44 dist-test-slave-zj8q krb5kdc[29471](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466264, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:37:44.383304 29491 init.cc:377] Logged in from keytab as kudu/127.24.175.254@KRBTEST.COM (short username kudu)
I20260811 16:37:44.383694 29491 webserver.cc:460] Webserver started at http://127.24.175.254:44481/ using document root <none> and password file <none>
I20260811 16:37:44.383912 29491 fs_manager.cc:359] Metadata directory not provided
I20260811 16:37:44.383960 29491 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:37:44.384080 29491 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:37:44.385079 29491 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/minicluster-data/master-0/data/instance:
uuid: "71d552adfeaf413084110b0aaac0ea19"
format_stamp: "Formatted at 2026-08-11 16:37:44 on dist-test-slave-zj8q"
server_key: "0a8192cb7c10fe5fc1ad649a29fadd7f"
server_key_iv: "b4393cb0e9d5f67c122088eb0bdb1a81"
server_key_version: "encryptionkey@0"
I20260811 16:37:44.385406 29491 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/minicluster-data/master-0/wal/instance:
uuid: "71d552adfeaf413084110b0aaac0ea19"
format_stamp: "Formatted at 2026-08-11 16:37:44 on dist-test-slave-zj8q"
server_key: "0a8192cb7c10fe5fc1ad649a29fadd7f"
server_key_iv: "b4393cb0e9d5f67c122088eb0bdb1a81"
server_key_version: "encryptionkey@0"
I20260811 16:37:44.386694 29491 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 16:37:44.387336 29516 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:44.387485 29491 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 16:37:44.387568 29491 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/minicluster-data/master-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/minicluster-data/master-0/wal
uuid: "71d552adfeaf413084110b0aaac0ea19"
format_stamp: "Formatted at 2026-08-11 16:37:44 on dist-test-slave-zj8q"
server_key: "0a8192cb7c10fe5fc1ad649a29fadd7f"
server_key_iv: "b4393cb0e9d5f67c122088eb0bdb1a81"
server_key_version: "encryptionkey@0"
I20260811 16:37:44.387626 29491 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:37:44.395462 29491 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:37:44.396983 29491 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:37:44.397102 29491 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:37:44.400900 29491 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.254:36445
I20260811 16:37:44.400931 29600 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.254:36445 every 8 connection(s)
I20260811 16:37:44.401221 29491 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
I20260811 16:37:44.402043 29603 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:37:44.403522 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 29491
I20260811 16:37:44.403602 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/minicluster-data/master-0/wal/instance
I20260811 16:37:44.403753 25279 external_mini_cluster.cc:1428] Setting key 20abb8e1563ad475eb874eb003d0f755
I20260811 16:37:44.404510 29603 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 71d552adfeaf413084110b0aaac0ea19: Bootstrap starting.
I20260811 16:37:44.405215 29603 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 71d552adfeaf413084110b0aaac0ea19: Neither blocks nor log segments found. Creating new log.
I20260811 16:37:44.405499 29603 log.cc:824] T 00000000000000000000000000000000 P 71d552adfeaf413084110b0aaac0ea19: Log is configured to *not* fsync() on all Append() calls
I20260811 16:37:44.406178 29603 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 71d552adfeaf413084110b0aaac0ea19: No bootstrap required, opened a new log
I20260811 16:37:44.407923 29603 raft_consensus.cc:348] T 00000000000000000000000000000000 P 71d552adfeaf413084110b0aaac0ea19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71d552adfeaf413084110b0aaac0ea19" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 36445 } }
I20260811 16:37:44.408058 29603 raft_consensus.cc:374] T 00000000000000000000000000000000 P 71d552adfeaf413084110b0aaac0ea19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:37:44.408093 29603 raft_consensus.cc:729] T 00000000000000000000000000000000 P 71d552adfeaf413084110b0aaac0ea19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71d552adfeaf413084110b0aaac0ea19, State: Initialized, Role: FOLLOWER
I20260811 16:37:44.408209 29603 consensus_queue.cc:260] T 00000000000000000000000000000000 P 71d552adfeaf413084110b0aaac0ea19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71d552adfeaf413084110b0aaac0ea19" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 36445 } }
I20260811 16:37:44.408284 29603 raft_consensus.cc:388] T 00000000000000000000000000000000 P 71d552adfeaf413084110b0aaac0ea19 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:37:44.408314 29603 raft_consensus.cc:482] T 00000000000000000000000000000000 P 71d552adfeaf413084110b0aaac0ea19 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:37:44.408352 29603 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 71d552adfeaf413084110b0aaac0ea19 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:37:44.408869 29603 raft_consensus.cc:504] T 00000000000000000000000000000000 P 71d552adfeaf413084110b0aaac0ea19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71d552adfeaf413084110b0aaac0ea19" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 36445 } }
I20260811 16:37:44.408967 29603 leader_election.cc:302] T 00000000000000000000000000000000 P 71d552adfeaf413084110b0aaac0ea19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 71d552adfeaf413084110b0aaac0ea19; no voters:
I20260811 16:37:44.409121 29603 leader_election.cc:288] T 00000000000000000000000000000000 P 71d552adfeaf413084110b0aaac0ea19 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:37:44.409160 29610 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 71d552adfeaf413084110b0aaac0ea19 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:37:44.409269 29610 raft_consensus.cc:686] T 00000000000000000000000000000000 P 71d552adfeaf413084110b0aaac0ea19 [term 1 LEADER]: Becoming Leader. State: Replica: 71d552adfeaf413084110b0aaac0ea19, State: Running, Role: LEADER
I20260811 16:37:44.409384 29603 sys_catalog.cc:564] T 00000000000000000000000000000000 P 71d552adfeaf413084110b0aaac0ea19 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:37:44.409409 29610 consensus_queue.cc:237] T 00000000000000000000000000000000 P 71d552adfeaf413084110b0aaac0ea19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71d552adfeaf413084110b0aaac0ea19" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 36445 } }
Aug 11 16:37:44 dist-test-slave-zj8q krb5kdc[29471](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466264, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:37:44.409730 29610 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71d552adfeaf413084110b0aaac0ea19 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 71d552adfeaf413084110b0aaac0ea19. Latest consensus state: current_term: 1 leader_uuid: "71d552adfeaf413084110b0aaac0ea19" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71d552adfeaf413084110b0aaac0ea19" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 36445 } } }
I20260811 16:37:44.409801 29610 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71d552adfeaf413084110b0aaac0ea19 [sys.catalog]: This master's current role is: LEADER
I20260811 16:37:44.409886 29617 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71d552adfeaf413084110b0aaac0ea19 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "71d552adfeaf413084110b0aaac0ea19" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71d552adfeaf413084110b0aaac0ea19" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 36445 } } }
I20260811 16:37:44.410107 29617 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71d552adfeaf413084110b0aaac0ea19 [sys.catalog]: This master's current role is: LEADER
I20260811 16:37:44.410553 29631 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:37:44.411007 29631 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:37:44.412536 29631 catalog_manager.cc:1347] Generated new cluster ID: d0ce367ee61d49ee985d0f5fc79019b0
I20260811 16:37:44.412582 29631 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:37:44.413700 29608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:44.404194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35426 (local address 127.24.175.254:36445)
0811 16:37:44.404361 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:44.404370 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:44.404403 (+ 33us) server_negotiation.cc:407] Connection header received
0811 16:37:44.404940 (+ 537us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:44.404949 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:44.405008 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:44.405190 (+ 182us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:44.405765 (+ 575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:44.406743 (+ 978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:44.407455 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:44.407852 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:44.407954 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:44.410347 (+ 2393us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:44.410350 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:44.410351 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:37:44.410362 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:44.412139 (+ 1777us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:44.412519 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:44.412522 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:44.412523 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:44.412619 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:44.412852 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:44.412853 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:44.412853 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:44.413120 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:44.413247 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:44.413384 (+ 137us) server_negotiation.cc:299] Negotiation successful
0811 16:37:44.413506 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":80,"threads_started":1}
I20260811 16:37:44.422664 29631 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:37:44.423331 29631 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:37:44.429656 29631 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 71d552adfeaf413084110b0aaac0ea19: Generated new TSK 0
I20260811 16:37:44.429809 29631 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.175.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab.
Entry for principal kudu/127.24.175.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab.
I20260811 16:37:44.457873 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.193:0
--local_ip_for_outbound_sockets=127.24.175.193
--webserver_interface=127.24.175.193
--webserver_port=0
--tserver_master_addrs=127.24.175.254:36445
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab
--principal=kudu/127.24.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:35697
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:37:44.537716 29660 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:37:44.537904 29660 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:37:44.537925 29660 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:37:44.539059 29660 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:37:44.539101 29660 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:37:44.539126 29660 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.193
I20260811 16:37:44.540591 29660 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:35697
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab
--principal=kudu/127.24.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.175.193
--webserver_port=0
--tserver_master_addrs=127.24.175.254:36445
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29660
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.193
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:37:44.540808 29660 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:37:44.541008 29660 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:37:44.545794 29669 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:44.545800 29668 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:37:44.545859 29660 server_base.cc:1034] running on GCE node
W20260811 16:37:44.545800 29671 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:37:44.546181 29660 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:37:44.546406 29660 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:37:44.547536 29660 hybrid_clock.cc:648] HybridClock initialized: now 1786466264547527 us; error 28 us; skew 500 ppm
Aug 11 16:37:44 dist-test-slave-zj8q krb5kdc[29471](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466264, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:37:44.549871 29660 init.cc:377] Logged in from keytab as kudu/127.24.175.193@KRBTEST.COM (short username kudu)
I20260811 16:37:44.550314 29660 webserver.cc:460] Webserver started at http://127.24.175.193:44797/ using document root <none> and password file <none>
I20260811 16:37:44.550536 29660 fs_manager.cc:359] Metadata directory not provided
I20260811 16:37:44.550593 29660 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:37:44.550724 29660 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:37:44.551700 29660 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-0/data/instance:
uuid: "8c6975f58f8d44aa83928ba0bbb049d8"
format_stamp: "Formatted at 2026-08-11 16:37:44 on dist-test-slave-zj8q"
server_key: "ad43720fc4c4b678010c1d5f4d9102e3"
server_key_iv: "69b0cbcde6aab03a9594a6131135421e"
server_key_version: "encryptionkey@0"
I20260811 16:37:44.552028 29660 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-0/wal/instance:
uuid: "8c6975f58f8d44aa83928ba0bbb049d8"
format_stamp: "Formatted at 2026-08-11 16:37:44 on dist-test-slave-zj8q"
server_key: "ad43720fc4c4b678010c1d5f4d9102e3"
server_key_iv: "69b0cbcde6aab03a9594a6131135421e"
server_key_version: "encryptionkey@0"
I20260811 16:37:44.553210 29660 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:37:44.553857 29681 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:44.554031 29660 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:37:44.554124 29660 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-0/wal
uuid: "8c6975f58f8d44aa83928ba0bbb049d8"
format_stamp: "Formatted at 2026-08-11 16:37:44 on dist-test-slave-zj8q"
server_key: "ad43720fc4c4b678010c1d5f4d9102e3"
server_key_iv: "69b0cbcde6aab03a9594a6131135421e"
server_key_version: "encryptionkey@0"
I20260811 16:37:44.554215 29660 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:37:44.568097 29660 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:37:44.569774 29660 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:37:44.569908 29660 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:37:44.570176 29660 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:37:44.570521 29660 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:37:44.570557 29660 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:44.570586 29660 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:37:44.570603 29660 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:44.576263 29660 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.193:38001
I20260811 16:37:44.576323 29873 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.193:38001 every 8 connection(s)
I20260811 16:37:44.576612 29660 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
Aug 11 16:37:44 dist-test-slave-zj8q krb5kdc[29471](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466264, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.193@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:37:44.582429 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 29660
I20260811 16:37:44.582516 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-0/wal/instance
I20260811 16:37:44.582686 25279 external_mini_cluster.cc:1428] Setting key 87695825eeee9c522b26377567bb28c9
I20260811 16:37:44.585543 29608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:44.577279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:35111 (local address 127.24.175.254:36445)
0811 16:37:44.577329 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:44.577330 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:44.577518 (+ 188us) server_negotiation.cc:407] Connection header received
0811 16:37:44.578012 (+ 494us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:44.578014 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:44.578026 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:44.578078 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:44.579026 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:44.579538 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:44.580482 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:44.580692 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:44.580755 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:44.582922 (+ 2167us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:44.582924 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:44.582924 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:37:44.582932 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:44.584236 (+ 1304us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:44.584620 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:44.584621 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:44.584622 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:44.584676 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:44.584909 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:44.584910 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:44.584910 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:44.585026 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:44.585089 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:44.585347 (+ 258us) server_negotiation.cc:299] Negotiation successful
0811 16:37:44.585438 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 16:37:44.585752 29878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:44.577246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:36445 (local address 127.24.175.193:35111)
0811 16:37:44.577408 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:44.577446 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:44.577923 (+ 477us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:44.578145 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:44.578187 (+ 42us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:44.578747 (+ 560us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:37:44.578935 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:44.578941 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:44.579617 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:44.579619 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:44.580405 (+ 786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:44.580407 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:44.580761 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:44.580762 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:44.580890 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:44.581356 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:37:44.581364 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:37:44.582833 (+ 1469us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:37:44.584315 (+ 1482us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:44.584323 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:44.584325 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:44.584540 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:44.584728 (+ 188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:44.584728 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:44.584729 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:44.584850 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:44.585082 (+ 232us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:37:44.585089 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:37:44.585228 (+ 139us) client_negotiation.cc:769] Sending connection context
0811 16:37:44.585316 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 16:37:44.585471 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":83,"threads_started":1}
I20260811 16:37:44.586246 29875 heartbeater.cc:347] Connected to a master server at 127.24.175.254:36445
I20260811 16:37:44.586337 29875 heartbeater.cc:464] Registering TS with master...
I20260811 16:37:44.586508 29875 heartbeater.cc:511] Master 127.24.175.254:36445 requested a full tablet report, sending...
I20260811 16:37:44.587047 29548 ts_manager.cc:194] Registered new tserver with Master: 8c6975f58f8d44aa83928ba0bbb049d8 (127.24.175.193:38001)
I20260811 16:37:44.587956 29548 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.175.193@KRBTEST.COM'} at 127.24.175.193:35111
WARNING: no policy specified for kudu/127.24.175.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab.
Entry for principal kudu/127.24.175.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab.
I20260811 16:37:44.606828 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.194:0
--local_ip_for_outbound_sockets=127.24.175.194
--webserver_interface=127.24.175.194
--webserver_port=0
--tserver_master_addrs=127.24.175.254:36445
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab
--principal=kudu/127.24.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:35697
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:37:44.686530 29882 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:37:44.686708 29882 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:37:44.686735 29882 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:37:44.687804 29882 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:37:44.687835 29882 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:37:44.687860 29882 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.194
I20260811 16:37:44.689216 29882 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:35697
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab
--principal=kudu/127.24.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.175.194
--webserver_port=0
--tserver_master_addrs=127.24.175.254:36445
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29882
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.194
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:37:44.689392 29882 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:37:44.689579 29882 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:37:44.694589 29893 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:44.694599 29894 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:44.694597 29900 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:37:44.694736 29882 server_base.cc:1034] running on GCE node
I20260811 16:37:44.695001 29882 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:37:44.695214 29882 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:37:44.696358 29882 hybrid_clock.cc:648] HybridClock initialized: now 1786466264696338 us; error 34 us; skew 500 ppm
Aug 11 16:37:44 dist-test-slave-zj8q krb5kdc[29471](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466264, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:37:44.699276 29882 init.cc:377] Logged in from keytab as kudu/127.24.175.194@KRBTEST.COM (short username kudu)
I20260811 16:37:44.699755 29882 webserver.cc:460] Webserver started at http://127.24.175.194:41181/ using document root <none> and password file <none>
I20260811 16:37:44.700012 29882 fs_manager.cc:359] Metadata directory not provided
I20260811 16:37:44.700064 29882 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:37:44.700189 29882 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:37:44.701292 29882 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-1/data/instance:
uuid: "099beb1ec81a4164b002dbd1b3649ce9"
format_stamp: "Formatted at 2026-08-11 16:37:44 on dist-test-slave-zj8q"
server_key: "371aa6abadb4216adc70f48c52594489"
server_key_iv: "a419911bed68f4230230de414c670990"
server_key_version: "encryptionkey@0"
I20260811 16:37:44.701608 29882 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-1/wal/instance:
uuid: "099beb1ec81a4164b002dbd1b3649ce9"
format_stamp: "Formatted at 2026-08-11 16:37:44 on dist-test-slave-zj8q"
server_key: "371aa6abadb4216adc70f48c52594489"
server_key_iv: "a419911bed68f4230230de414c670990"
server_key_version: "encryptionkey@0"
I20260811 16:37:44.702865 29882 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 16:37:44.703552 29911 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:44.703691 29882 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 16:37:44.703778 29882 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-1/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-1/wal
uuid: "099beb1ec81a4164b002dbd1b3649ce9"
format_stamp: "Formatted at 2026-08-11 16:37:44 on dist-test-slave-zj8q"
server_key: "371aa6abadb4216adc70f48c52594489"
server_key_iv: "a419911bed68f4230230de414c670990"
server_key_version: "encryptionkey@0"
I20260811 16:37:44.703837 29882 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:37:44.719229 29882 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:37:44.720813 29882 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:37:44.720935 29882 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:37:44.721117 29882 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:37:44.721402 29882 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:37:44.721436 29882 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:44.721462 29882 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:37:44.721480 29882 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:44.726752 29882 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.194:35331
I20260811 16:37:44.726790 30100 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.194:35331 every 8 connection(s)
I20260811 16:37:44.727065 29882 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
I20260811 16:37:44.731490 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 29882
I20260811 16:37:44.731588 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-1/wal/instance
I20260811 16:37:44.731773 25279 external_mini_cluster.cc:1428] Setting key 1d308c81879e0b40f65adea678736ea3
Aug 11 16:37:44 dist-test-slave-zj8q krb5kdc[29471](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466264, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.194@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:37:44.735841 29608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:44.727679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:40737 (local address 127.24.175.254:36445)
0811 16:37:44.727742 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:44.727743 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:44.727938 (+ 195us) server_negotiation.cc:407] Connection header received
0811 16:37:44.728387 (+ 449us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:44.728389 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:44.728398 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:44.728447 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:44.729342 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:44.729848 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:44.730866 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:44.731058 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:44.731109 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:44.733339 (+ 2230us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:44.733340 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:44.733340 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:37:44.733348 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:44.734593 (+ 1245us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:44.735020 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:44.735021 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:44.735022 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:44.735068 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:44.735301 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:44.735301 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:44.735302 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:44.735392 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:44.735436 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:44.735722 (+ 286us) server_negotiation.cc:299] Negotiation successful
0811 16:37:44.735779 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 16:37:44.736065 30104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:44.727659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:36445 (local address 127.24.175.194:40737)
0811 16:37:44.727819 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:44.727859 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:44.728313 (+ 454us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:44.728499 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:44.728503 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:44.729058 (+ 555us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:37:44.729257 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:44.729262 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:44.729941 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:44.729942 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:44.730802 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:44.730806 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:44.731117 (+ 311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:44.731118 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:44.731216 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:44.731719 (+ 503us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:37:44.731728 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:37:44.733251 (+ 1523us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:37:44.734664 (+ 1413us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:44.734670 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:44.734673 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:44.734953 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:44.735118 (+ 165us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:44.735118 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:44.735119 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:44.735243 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:44.735445 (+ 202us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:37:44.735450 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:37:44.735599 (+ 149us) client_negotiation.cc:769] Sending connection context
0811 16:37:44.735703 (+ 104us) client_negotiation.cc:240] Negotiation successful
0811 16:37:44.735858 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":82,"threads_started":1}
I20260811 16:37:44.736501 30101 heartbeater.cc:347] Connected to a master server at 127.24.175.254:36445
I20260811 16:37:44.736591 30101 heartbeater.cc:464] Registering TS with master...
I20260811 16:37:44.736760 30101 heartbeater.cc:511] Master 127.24.175.254:36445 requested a full tablet report, sending...
I20260811 16:37:44.737134 29548 ts_manager.cc:194] Registered new tserver with Master: 099beb1ec81a4164b002dbd1b3649ce9 (127.24.175.194:35331)
I20260811 16:37:44.737480 29548 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.175.194@KRBTEST.COM'} at 127.24.175.194:40737
WARNING: no policy specified for kudu/127.24.175.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab.
Entry for principal kudu/127.24.175.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab.
I20260811 16:37:44.755155 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.195:0
--local_ip_for_outbound_sockets=127.24.175.195
--webserver_interface=127.24.175.195
--webserver_port=0
--tserver_master_addrs=127.24.175.254:36445
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab
--principal=kudu/127.24.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:35697
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:37:44.835924 30111 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:37:44.836122 30111 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:37:44.836143 30111 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:37:44.837271 30111 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:37:44.837311 30111 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:37:44.837340 30111 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.195
I20260811 16:37:44.838805 30111 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:35697
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab
--principal=kudu/127.24.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.175.195
--webserver_port=0
--tserver_master_addrs=127.24.175.254:36445
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30111
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.195
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:37:44.839033 30111 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:37:44.839228 30111 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:37:44.844066 30128 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:44.844074 30124 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:37:44.844120 30111 server_base.cc:1034] running on GCE node
W20260811 16:37:44.844087 30126 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:37:44.844470 30111 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:37:44.844705 30111 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:37:44.845850 30111 hybrid_clock.cc:648] HybridClock initialized: now 1786466264845832 us; error 29 us; skew 500 ppm
Aug 11 16:37:44 dist-test-slave-zj8q krb5kdc[29471](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466264, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:37:44.848282 30111 init.cc:377] Logged in from keytab as kudu/127.24.175.195@KRBTEST.COM (short username kudu)
I20260811 16:37:44.848690 30111 webserver.cc:460] Webserver started at http://127.24.175.195:44245/ using document root <none> and password file <none>
I20260811 16:37:44.848879 30111 fs_manager.cc:359] Metadata directory not provided
I20260811 16:37:44.848924 30111 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:37:44.849053 30111 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:37:44.850018 30111 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-2/data/instance:
uuid: "9b2b3c822e454c42b2e579e5307c5147"
format_stamp: "Formatted at 2026-08-11 16:37:44 on dist-test-slave-zj8q"
server_key: "9f3620db2e68415f3317da5f84b91499"
server_key_iv: "55443f54509bd8c825d2c2f490ab0004"
server_key_version: "encryptionkey@0"
I20260811 16:37:44.850382 30111 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-2/wal/instance:
uuid: "9b2b3c822e454c42b2e579e5307c5147"
format_stamp: "Formatted at 2026-08-11 16:37:44 on dist-test-slave-zj8q"
server_key: "9f3620db2e68415f3317da5f84b91499"
server_key_iv: "55443f54509bd8c825d2c2f490ab0004"
server_key_version: "encryptionkey@0"
I20260811 16:37:44.851567 30111 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:37:44.852248 30140 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:44.852413 30111 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:44.852500 30111 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-2/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-2/wal
uuid: "9b2b3c822e454c42b2e579e5307c5147"
format_stamp: "Formatted at 2026-08-11 16:37:44 on dist-test-slave-zj8q"
server_key: "9f3620db2e68415f3317da5f84b91499"
server_key_iv: "55443f54509bd8c825d2c2f490ab0004"
server_key_version: "encryptionkey@0"
I20260811 16:37:44.852560 30111 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:37:44.862219 30111 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:37:44.864202 30111 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:37:44.864326 30111 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:37:44.864528 30111 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:37:44.864804 30111 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:37:44.864837 30111 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:44.864864 30111 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:37:44.864887 30111 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:44.870494 30111 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.195:45155
I20260811 16:37:44.870529 30328 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.195:45155 every 8 connection(s)
I20260811 16:37:44.870815 30111 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
Aug 11 16:37:44 dist-test-slave-zj8q krb5kdc[29471](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466264, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.195@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:37:44.878763 29608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:44.871441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.195:55925 (local address 127.24.175.254:36445)
0811 16:37:44.871511 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:44.871514 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:44.871647 (+ 133us) server_negotiation.cc:407] Connection header received
0811 16:37:44.872074 (+ 427us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:44.872075 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:44.872085 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:44.872130 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:44.872958 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:44.873447 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:44.874379 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:44.874563 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:44.874610 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:44.876510 (+ 1900us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:44.876511 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:44.876512 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:37:44.876519 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:44.877570 (+ 1051us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:44.877917 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:44.877918 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:44.877919 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:44.877977 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:44.878274 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:44.878275 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:44.878275 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:44.878379 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:44.878425 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:44.878632 (+ 207us) server_negotiation.cc:299] Negotiation successful
0811 16:37:44.878690 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 16:37:44.878940 30331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:44.871403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:36445 (local address 127.24.175.195:55925)
0811 16:37:44.871537 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:44.871576 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:44.872000 (+ 424us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:44.872182 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:44.872185 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:44.872710 (+ 525us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:37:44.872888 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:44.872893 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:44.873503 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:44.873503 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:44.874316 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:44.874318 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:44.874625 (+ 307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:44.874626 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:44.874735 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:44.875169 (+ 434us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:37:44.875177 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:37:44.876426 (+ 1249us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:37:44.877637 (+ 1211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:44.877643 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:44.877644 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:44.877859 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:44.878064 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:44.878065 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:44.878066 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:44.878213 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:44.878424 (+ 211us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:37:44.878427 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:37:44.878534 (+ 107us) client_negotiation.cc:769] Sending connection context
0811 16:37:44.878618 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 16:37:44.878739 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":74,"threads_started":1}
I20260811 16:37:44.879405 30329 heartbeater.cc:347] Connected to a master server at 127.24.175.254:36445
I20260811 16:37:44.879489 30329 heartbeater.cc:464] Registering TS with master...
I20260811 16:37:44.879665 30329 heartbeater.cc:511] Master 127.24.175.254:36445 requested a full tablet report, sending...
I20260811 16:37:44.879659 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 30111
I20260811 16:37:44.879755 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-2/wal/instance
I20260811 16:37:44.879957 25279 external_mini_cluster.cc:1428] Setting key b51c0af104426b75193df075ae933eb3
I20260811 16:37:44.880074 29548 ts_manager.cc:194] Registered new tserver with Master: 9b2b3c822e454c42b2e579e5307c5147 (127.24.175.195:45155)
I20260811 16:37:44.880524 29548 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.175.195@KRBTEST.COM'} at 127.24.175.195:55925
I20260811 16:37:44.880816 25279 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 16:37:44.892201 29608 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:37:44.891408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35438 (local address 127.24.175.254:36445)
0811 16:37:44.891457 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:44.891460 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:44.891570 (+ 110us) server_negotiation.cc:407] Connection header received
0811 16:37:44.891628 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:44.891629 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:44.891639 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:44.891683 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:44.892159 (+ 476us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35438: BlockingRecv error: recv got EOF from 127.0.0.1:35438 (error 108)
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 16:37:44.893121 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 29660
I20260811 16:37:44.915750 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 29882
I20260811 16:37:44.926755 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 30111
I20260811 16:37:44.937279 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 29491
2026-08-11T16:37:44Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (1931 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466249441839-25279-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:37:44 dist-test-slave-zj8q krb5kdc[30347](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:37:44 dist-test-slave-zj8q krb5kdc[30347](info): set up 2 sockets
Aug 11 16:37:44 dist-test-slave-zj8q krb5kdc[30347](info): commencing operation
krb5kdc: starting...
W20260811 16:37:46.100340 25279 mini_kdc.cc:121] Time spent starting KDC: real 1.138s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Aug 11 16:37:46 dist-test-slave-zj8q krb5kdc[30347](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466266, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:37:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:37:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab.
Entry for principal kudu/127.24.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab.
I20260811 16:37:46.213629 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466249441839-25279-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466249441839-25279-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466249441839-25279-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:45359
--webserver_interface=127.24.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:46781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.175.254:45359
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:37:46.294348 30367 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:37:46.294538 30367 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:37:46.294567 30367 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:37:46.295799 30367 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:37:46.295842 30367 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:37:46.295855 30367 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:37:46.295878 30367 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:37:46.295900 30367 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:37:46.297422 30367 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:46781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466249441839-25279-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466249441839-25279-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.175.254:45359
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:45359
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30367
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466249441839-25279-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:37:46.297644 30367 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:37:46.297838 30367 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:37:46.302537 30375 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:46.302558 30378 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:37:46.302609 30367 server_base.cc:1034] running on GCE node
W20260811 16:37:46.302558 30374 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:37:46.302978 30367 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:37:46.303269 30367 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:37:46.304426 30367 hybrid_clock.cc:648] HybridClock initialized: now 1786466266304407 us; error 33 us; skew 500 ppm
Aug 11 16:37:46 dist-test-slave-zj8q krb5kdc[30347](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466266, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:37:46.313062 30367 init.cc:377] Logged in from keytab as kudu/127.24.175.254@KRBTEST.COM (short username kudu)
I20260811 16:37:46.313519 30367 webserver.cc:460] Webserver started at http://127.24.175.254:34611/ using document root <none> and password file <none>
I20260811 16:37:46.313759 30367 fs_manager.cc:359] Metadata directory not provided
I20260811 16:37:46.313810 30367 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:37:46.313937 30367 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:37:46.315053 30367 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466249441839-25279-0/minicluster-data/master-0/data/instance:
uuid: "d159c72a4acf4af69e102c47ffae0b95"
format_stamp: "Formatted at 2026-08-11 16:37:46 on dist-test-slave-zj8q"
server_key: "67f8c83b5a3db6e5de7c341b0ea30339"
server_key_iv: "445187893e905f528e136899eeea5a69"
server_key_version: "encryptionkey@0"
I20260811 16:37:46.315394 30367 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466249441839-25279-0/minicluster-data/master-0/wal/instance:
uuid: "d159c72a4acf4af69e102c47ffae0b95"
format_stamp: "Formatted at 2026-08-11 16:37:46 on dist-test-slave-zj8q"
server_key: "67f8c83b5a3db6e5de7c341b0ea30339"
server_key_iv: "445187893e905f528e136899eeea5a69"
server_key_version: "encryptionkey@0"
I20260811 16:37:46.316627 30367 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 16:37:46.317313 30388 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:46.317462 30367 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 16:37:46.317552 30367 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466249441839-25279-0/minicluster-data/master-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466249441839-25279-0/minicluster-data/master-0/wal
uuid: "d159c72a4acf4af69e102c47ffae0b95"
format_stamp: "Formatted at 2026-08-11 16:37:46 on dist-test-slave-zj8q"
server_key: "67f8c83b5a3db6e5de7c341b0ea30339"
server_key_iv: "445187893e905f528e136899eeea5a69"
server_key_version: "encryptionkey@0"
I20260811 16:37:46.317627 30367 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466249441839-25279-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466249441839-25279-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466249441839-25279-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:37:46.339110 30367 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:37:46.340888 30367 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:37:46.341032 30367 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:37:46.344928 30367 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.254:45359
I20260811 16:37:46.344970 30466 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.254:45359 every 8 connection(s)
I20260811 16:37:46.345485 30367 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
I20260811 16:37:46.346167 30467 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:37:46.348289 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 30367
I20260811 16:37:46.348387 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466249441839-25279-0/minicluster-data/master-0/wal/instance
I20260811 16:37:46.348522 30467 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d159c72a4acf4af69e102c47ffae0b95: Bootstrap starting.
I20260811 16:37:46.348560 25279 external_mini_cluster.cc:1428] Setting key 4dd2e21170179ccff4561e3124892913
I20260811 16:37:46.349211 30467 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d159c72a4acf4af69e102c47ffae0b95: Neither blocks nor log segments found. Creating new log.
I20260811 16:37:46.349503 30467 log.cc:824] T 00000000000000000000000000000000 P d159c72a4acf4af69e102c47ffae0b95: Log is configured to *not* fsync() on all Append() calls
I20260811 16:37:46.350304 30467 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d159c72a4acf4af69e102c47ffae0b95: No bootstrap required, opened a new log
I20260811 16:37:46.352380 30467 raft_consensus.cc:348] T 00000000000000000000000000000000 P d159c72a4acf4af69e102c47ffae0b95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d159c72a4acf4af69e102c47ffae0b95" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 45359 } }
I20260811 16:37:46.352542 30467 raft_consensus.cc:374] T 00000000000000000000000000000000 P d159c72a4acf4af69e102c47ffae0b95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:37:46.352576 30467 raft_consensus.cc:729] T 00000000000000000000000000000000 P d159c72a4acf4af69e102c47ffae0b95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d159c72a4acf4af69e102c47ffae0b95, State: Initialized, Role: FOLLOWER
I20260811 16:37:46.352730 30467 consensus_queue.cc:260] T 00000000000000000000000000000000 P d159c72a4acf4af69e102c47ffae0b95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d159c72a4acf4af69e102c47ffae0b95" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 45359 } }
I20260811 16:37:46.352813 30467 raft_consensus.cc:388] T 00000000000000000000000000000000 P d159c72a4acf4af69e102c47ffae0b95 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:37:46.352845 30467 raft_consensus.cc:482] T 00000000000000000000000000000000 P d159c72a4acf4af69e102c47ffae0b95 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:37:46.352891 30467 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d159c72a4acf4af69e102c47ffae0b95 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:37:46.353480 30467 raft_consensus.cc:504] T 00000000000000000000000000000000 P d159c72a4acf4af69e102c47ffae0b95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d159c72a4acf4af69e102c47ffae0b95" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 45359 } }
I20260811 16:37:46.353575 30467 leader_election.cc:302] T 00000000000000000000000000000000 P d159c72a4acf4af69e102c47ffae0b95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d159c72a4acf4af69e102c47ffae0b95; no voters:
I20260811 16:37:46.353730 30467 leader_election.cc:288] T 00000000000000000000000000000000 P d159c72a4acf4af69e102c47ffae0b95 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:37:46.353777 30482 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d159c72a4acf4af69e102c47ffae0b95 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:37:46.353931 30482 raft_consensus.cc:686] T 00000000000000000000000000000000 P d159c72a4acf4af69e102c47ffae0b95 [term 1 LEADER]: Becoming Leader. State: Replica: d159c72a4acf4af69e102c47ffae0b95, State: Running, Role: LEADER
I20260811 16:37:46.353979 30467 sys_catalog.cc:564] T 00000000000000000000000000000000 P d159c72a4acf4af69e102c47ffae0b95 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:37:46.354101 30482 consensus_queue.cc:237] T 00000000000000000000000000000000 P d159c72a4acf4af69e102c47ffae0b95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d159c72a4acf4af69e102c47ffae0b95" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 45359 } }
I20260811 16:37:46.354477 30483 sys_catalog.cc:455] T 00000000000000000000000000000000 P d159c72a4acf4af69e102c47ffae0b95 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d159c72a4acf4af69e102c47ffae0b95. Latest consensus state: current_term: 1 leader_uuid: "d159c72a4acf4af69e102c47ffae0b95" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d159c72a4acf4af69e102c47ffae0b95" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 45359 } } }
I20260811 16:37:46.354485 30484 sys_catalog.cc:455] T 00000000000000000000000000000000 P d159c72a4acf4af69e102c47ffae0b95 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d159c72a4acf4af69e102c47ffae0b95" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d159c72a4acf4af69e102c47ffae0b95" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 45359 } } }
I20260811 16:37:46.354566 30483 sys_catalog.cc:458] T 00000000000000000000000000000000 P d159c72a4acf4af69e102c47ffae0b95 [sys.catalog]: This master's current role is: LEADER
I20260811 16:37:46.354614 30484 sys_catalog.cc:458] T 00000000000000000000000000000000 P d159c72a4acf4af69e102c47ffae0b95 [sys.catalog]: This master's current role is: LEADER
Aug 11 16:37:46 dist-test-slave-zj8q krb5kdc[30347](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466266, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:37:46.355361 30491 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:37:46.355811 30491 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:37:46.357260 30491 catalog_manager.cc:1347] Generated new cluster ID: 02335e74f7ce46bbb40554f6e43bf00c
I20260811 16:37:46.357309 30491 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:37:46.360023 30480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:46.349032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35700 (local address 127.24.175.254:45359)
0811 16:37:46.349197 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:46.349206 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:46.349236 (+ 30us) server_negotiation.cc:407] Connection header received
0811 16:37:46.349759 (+ 523us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:46.349769 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:46.349832 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:46.349974 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:46.350719 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:46.351598 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:46.352635 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:46.353134 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:46.353220 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:46.356648 (+ 3428us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:46.356653 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:46.356654 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:37:46.356666 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:46.358506 (+ 1840us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:46.358897 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:46.358900 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:46.358900 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:46.358990 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:46.359178 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:46.359178 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:46.359178 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:46.359433 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:46.359569 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:46.359700 (+ 131us) server_negotiation.cc:299] Negotiation successful
0811 16:37:46.359832 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":61,"threads_started":1}
I20260811 16:37:46.361294 25279 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:37:46.376830 30491 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:37:46.377535 30491 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:37:46.385236 30480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:46.381033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35704 (local address 127.24.175.254:45359)
0811 16:37:46.381087 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:46.381089 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:46.381275 (+ 186us) server_negotiation.cc:407] Connection header received
0811 16:37:46.381340 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:46.381341 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:46.381352 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:46.381406 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:46.381905 (+ 499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:46.382684 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:46.383745 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:46.384050 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:46.384098 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:46.384790 (+ 692us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:46.384791 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:46.384791 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:37:46.384994 (+ 203us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:46.385013 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:37:46.385019 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:46.385069 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:46.385131 (+ 62us) server_negotiation.cc:299] Negotiation successful
0811 16:37:46.385154 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 16:37:46.394246 30491 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d159c72a4acf4af69e102c47ffae0b95: Generated new TSK 0
I20260811 16:37:46.394414 30491 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:37:46.402135 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 30367
2026-08-11T16:37:46Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1463 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:37:46 dist-test-slave-zj8q krb5kdc[30525](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:37:46 dist-test-slave-zj8q krb5kdc[30525](info): set up 2 sockets
Aug 11 16:37:46 dist-test-slave-zj8q krb5kdc[30525](info): commencing operation
krb5kdc: starting...
W20260811 16:37:47.562928 25279 mini_kdc.cc:121] Time spent starting KDC: real 1.137s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Aug 11 16:37:47 dist-test-slave-zj8q krb5kdc[30525](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466267, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:37:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:37:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab.
Entry for principal kudu/127.24.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab.
I20260811 16:37:47.674393 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:34917
--webserver_interface=127.24.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:40925
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.175.254:34917
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:37:47.755955 30541 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:37:47.756160 30541 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:37:47.756191 30541 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:37:47.757301 30541 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:37:47.757340 30541 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:37:47.757359 30541 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:37:47.757375 30541 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:37:47.757390 30541 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:37:47.758818 30541 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:40925
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.175.254:34917
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:34917
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30541
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:37:47.759044 30541 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:37:47.759248 30541 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:37:47.763836 30548 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:47.763871 30550 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:47.763839 30552 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:37:47.764024 30541 server_base.cc:1034] running on GCE node
I20260811 16:37:47.764302 30541 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:37:47.764585 30541 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:37:47.765743 30541 hybrid_clock.cc:648] HybridClock initialized: now 1786466267765723 us; error 32 us; skew 500 ppm
Aug 11 16:37:47 dist-test-slave-zj8q krb5kdc[30525](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466267, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:37:47.768081 30541 init.cc:377] Logged in from keytab as kudu/127.24.175.254@KRBTEST.COM (short username kudu)
I20260811 16:37:47.768474 30541 webserver.cc:460] Webserver started at http://127.24.175.254:38371/ using document root <none> and password file <none>
I20260811 16:37:47.768664 30541 fs_manager.cc:359] Metadata directory not provided
I20260811 16:37:47.768713 30541 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:37:47.768833 30541 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:37:47.769816 30541 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/minicluster-data/master-0/data/instance:
uuid: "cf19d133666846cc8664e71771ebbfb6"
format_stamp: "Formatted at 2026-08-11 16:37:47 on dist-test-slave-zj8q"
server_key: "051e2f0627c1651b43960f78abaf1d83"
server_key_iv: "07c06fdb068a7d23d6e1916ac2d1f1c4"
server_key_version: "encryptionkey@0"
I20260811 16:37:47.770179 30541 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/minicluster-data/master-0/wal/instance:
uuid: "cf19d133666846cc8664e71771ebbfb6"
format_stamp: "Formatted at 2026-08-11 16:37:47 on dist-test-slave-zj8q"
server_key: "051e2f0627c1651b43960f78abaf1d83"
server_key_iv: "07c06fdb068a7d23d6e1916ac2d1f1c4"
server_key_version: "encryptionkey@0"
I20260811 16:37:47.771431 30541 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:37:47.772233 30563 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:47.772394 30541 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:37:47.772480 30541 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/minicluster-data/master-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/minicluster-data/master-0/wal
uuid: "cf19d133666846cc8664e71771ebbfb6"
format_stamp: "Formatted at 2026-08-11 16:37:47 on dist-test-slave-zj8q"
server_key: "051e2f0627c1651b43960f78abaf1d83"
server_key_iv: "07c06fdb068a7d23d6e1916ac2d1f1c4"
server_key_version: "encryptionkey@0"
I20260811 16:37:47.772540 30541 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:37:47.785966 30541 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:37:47.787533 30541 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:37:47.787663 30541 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:37:47.791659 30541 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.254:34917
I20260811 16:37:47.791710 30647 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.254:34917 every 8 connection(s)
I20260811 16:37:47.792001 30541 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
I20260811 16:37:47.793059 30648 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:37:47.795282 30648 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cf19d133666846cc8664e71771ebbfb6: Bootstrap starting.
I20260811 16:37:47.795822 30648 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cf19d133666846cc8664e71771ebbfb6: Neither blocks nor log segments found. Creating new log.
I20260811 16:37:47.796080 30648 log.cc:824] T 00000000000000000000000000000000 P cf19d133666846cc8664e71771ebbfb6: Log is configured to *not* fsync() on all Append() calls
I20260811 16:37:47.796684 30648 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cf19d133666846cc8664e71771ebbfb6: No bootstrap required, opened a new log
I20260811 16:37:47.798251 30648 raft_consensus.cc:348] T 00000000000000000000000000000000 P cf19d133666846cc8664e71771ebbfb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf19d133666846cc8664e71771ebbfb6" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 34917 } }
I20260811 16:37:47.798430 30648 raft_consensus.cc:374] T 00000000000000000000000000000000 P cf19d133666846cc8664e71771ebbfb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:37:47.798432 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 30541
I20260811 16:37:47.798475 30648 raft_consensus.cc:729] T 00000000000000000000000000000000 P cf19d133666846cc8664e71771ebbfb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf19d133666846cc8664e71771ebbfb6, State: Initialized, Role: FOLLOWER
I20260811 16:37:47.798529 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/minicluster-data/master-0/wal/instance
I20260811 16:37:47.798624 30648 consensus_queue.cc:260] T 00000000000000000000000000000000 P cf19d133666846cc8664e71771ebbfb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf19d133666846cc8664e71771ebbfb6" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 34917 } }
I20260811 16:37:47.798702 25279 external_mini_cluster.cc:1428] Setting key 2f34052c0deb4f3169bc2552818537a9
I20260811 16:37:47.798702 30648 raft_consensus.cc:388] T 00000000000000000000000000000000 P cf19d133666846cc8664e71771ebbfb6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:37:47.798745 30648 raft_consensus.cc:482] T 00000000000000000000000000000000 P cf19d133666846cc8664e71771ebbfb6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:37:47.798796 30648 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cf19d133666846cc8664e71771ebbfb6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:37:47.799737 30648 raft_consensus.cc:504] T 00000000000000000000000000000000 P cf19d133666846cc8664e71771ebbfb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf19d133666846cc8664e71771ebbfb6" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 34917 } }
I20260811 16:37:47.799856 30648 leader_election.cc:302] T 00000000000000000000000000000000 P cf19d133666846cc8664e71771ebbfb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cf19d133666846cc8664e71771ebbfb6; no voters:
I20260811 16:37:47.800027 30648 leader_election.cc:288] T 00000000000000000000000000000000 P cf19d133666846cc8664e71771ebbfb6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:37:47.800060 30656 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cf19d133666846cc8664e71771ebbfb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:37:47.800220 30656 raft_consensus.cc:686] T 00000000000000000000000000000000 P cf19d133666846cc8664e71771ebbfb6 [term 1 LEADER]: Becoming Leader. State: Replica: cf19d133666846cc8664e71771ebbfb6, State: Running, Role: LEADER
I20260811 16:37:47.800287 30648 sys_catalog.cc:564] T 00000000000000000000000000000000 P cf19d133666846cc8664e71771ebbfb6 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:37:47.800354 30656 consensus_queue.cc:237] T 00000000000000000000000000000000 P cf19d133666846cc8664e71771ebbfb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf19d133666846cc8664e71771ebbfb6" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 34917 } }
I20260811 16:37:47.801502 30657 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf19d133666846cc8664e71771ebbfb6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cf19d133666846cc8664e71771ebbfb6. Latest consensus state: current_term: 1 leader_uuid: "cf19d133666846cc8664e71771ebbfb6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf19d133666846cc8664e71771ebbfb6" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 34917 } } }
I20260811 16:37:47.801594 30657 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf19d133666846cc8664e71771ebbfb6 [sys.catalog]: This master's current role is: LEADER
I20260811 16:37:47.801776 30658 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf19d133666846cc8664e71771ebbfb6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cf19d133666846cc8664e71771ebbfb6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf19d133666846cc8664e71771ebbfb6" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 34917 } } }
I20260811 16:37:47.801864 30658 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf19d133666846cc8664e71771ebbfb6 [sys.catalog]: This master's current role is: LEADER
I20260811 16:37:47.801775 30675 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:37:47.802559 30675 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:37:47.804239 30675 catalog_manager.cc:1347] Generated new cluster ID: a348d4db815843908be8c186bb001e73
I20260811 16:37:47.804333 30675 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 16:37:47 dist-test-slave-zj8q krb5kdc[30525](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466267, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:37:47.808581 30654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:47.799156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42476 (local address 127.24.175.254:34917)
0811 16:37:47.799344 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:47.799352 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:47.799377 (+ 25us) server_negotiation.cc:407] Connection header received
0811 16:37:47.799468 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:47.799474 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:47.799515 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:47.799620 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:47.800384 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:47.801815 (+ 1431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:47.802623 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:47.803051 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:47.803157 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:47.805568 (+ 2411us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:47.805572 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:47.805573 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:37:47.805585 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:47.807161 (+ 1576us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:47.807481 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:47.807484 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:47.807484 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:47.807584 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:47.807769 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:47.807770 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:47.807771 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:47.808007 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:47.808159 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:47.808249 (+ 90us) server_negotiation.cc:299] Negotiation successful
0811 16:37:47.808381 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":101,"threads_started":1}
I20260811 16:37:47.831846 30675 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:37:47.832358 30675 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:37:47.837387 30675 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cf19d133666846cc8664e71771ebbfb6: Generated new TSK 0
I20260811 16:37:47.837568 30675 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.175.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab.
Entry for principal kudu/127.24.175.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab.
I20260811 16:37:47.872423 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.193:0
--local_ip_for_outbound_sockets=127.24.175.193
--webserver_interface=127.24.175.193
--webserver_port=0
--tserver_master_addrs=127.24.175.254:34917
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab
--principal=kudu/127.24.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:40925
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:37:47.977152 30686 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:37:47.977484 30686 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:37:47.977527 30686 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:37:47.978896 30686 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:37:47.978946 30686 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:37:47.978976 30686 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.193
I20260811 16:37:47.980429 30686 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:40925
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab
--principal=kudu/127.24.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.175.193
--webserver_port=0
--tserver_master_addrs=127.24.175.254:34917
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30686
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.193
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:37:47.980657 30686 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:37:47.980886 30686 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:37:47.985744 30694 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:47.985718 30699 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:47.985729 30696 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:37:47.985947 30686 server_base.cc:1034] running on GCE node
I20260811 16:37:47.986123 30686 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:37:47.986385 30686 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:37:47.987524 30686 hybrid_clock.cc:648] HybridClock initialized: now 1786466267987508 us; error 30 us; skew 500 ppm
Aug 11 16:37:47 dist-test-slave-zj8q krb5kdc[30525](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466267, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:37:47.989818 30686 init.cc:377] Logged in from keytab as kudu/127.24.175.193@KRBTEST.COM (short username kudu)
I20260811 16:37:47.990270 30686 webserver.cc:460] Webserver started at http://127.24.175.193:38577/ using document root <none> and password file <none>
I20260811 16:37:47.990473 30686 fs_manager.cc:359] Metadata directory not provided
I20260811 16:37:47.990520 30686 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:37:47.990643 30686 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:37:47.991618 30686 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-0/data/instance:
uuid: "9253837b2ad442e4bbf815428c680158"
format_stamp: "Formatted at 2026-08-11 16:37:47 on dist-test-slave-zj8q"
server_key: "e5dcd3b86f6a16120a01898b4ae3d34f"
server_key_iv: "f1c091d88642a0151432d2b5deace5a6"
server_key_version: "encryptionkey@0"
I20260811 16:37:47.991951 30686 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-0/wal/instance:
uuid: "9253837b2ad442e4bbf815428c680158"
format_stamp: "Formatted at 2026-08-11 16:37:47 on dist-test-slave-zj8q"
server_key: "e5dcd3b86f6a16120a01898b4ae3d34f"
server_key_iv: "f1c091d88642a0151432d2b5deace5a6"
server_key_version: "encryptionkey@0"
I20260811 16:37:47.993155 30686 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:37:47.993798 30711 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:47.993952 30686 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:37:47.994035 30686 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-0/wal
uuid: "9253837b2ad442e4bbf815428c680158"
format_stamp: "Formatted at 2026-08-11 16:37:47 on dist-test-slave-zj8q"
server_key: "e5dcd3b86f6a16120a01898b4ae3d34f"
server_key_iv: "f1c091d88642a0151432d2b5deace5a6"
server_key_version: "encryptionkey@0"
I20260811 16:37:47.994102 30686 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:37:48.000042 30686 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:37:48.001734 30686 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:37:48.001842 30686 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:37:48.002051 30686 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:37:48.002339 30686 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:37:48.002372 30686 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:48.002391 30686 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:37:48.002406 30686 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:48.007860 30686 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.193:37419
I20260811 16:37:48.007916 30897 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.193:37419 every 8 connection(s)
I20260811 16:37:48.008188 30686 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
Aug 11 16:37:48 dist-test-slave-zj8q krb5kdc[30525](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466267, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.193@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:37:48.016921 30654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:48.008888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:52213 (local address 127.24.175.254:34917)
0811 16:37:48.008957 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:48.008960 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:48.009147 (+ 187us) server_negotiation.cc:407] Connection header received
0811 16:37:48.009616 (+ 469us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:48.009617 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:48.009630 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:48.009669 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:48.010626 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:48.011141 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:48.012082 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:48.012267 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:48.012308 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:48.014331 (+ 2023us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:48.014334 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:48.014334 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:37:48.014341 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:48.015574 (+ 1233us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:48.015934 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:48.015935 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:48.015936 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:48.015988 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:48.016202 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:48.016203 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:48.016203 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:48.016319 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:48.016375 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:48.016711 (+ 336us) server_negotiation.cc:299] Negotiation successful
0811 16:37:48.016832 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 16:37:48.017020 30903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:48.008853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:34917 (local address 127.24.175.193:52213)
0811 16:37:48.009028 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:48.009069 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:48.009526 (+ 457us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:48.009744 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:48.009747 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:48.010359 (+ 612us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:37:48.010548 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:48.010553 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:48.011223 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:48.011224 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:48.012022 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:48.012024 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:48.012320 (+ 296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:48.012320 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:48.012413 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:48.012886 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:37:48.012895 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:37:48.014235 (+ 1340us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:37:48.015647 (+ 1412us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:48.015655 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:48.015657 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:48.015868 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:48.016041 (+ 173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:48.016042 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:48.016042 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:48.016146 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:48.016374 (+ 228us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:37:48.016381 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:37:48.016528 (+ 147us) client_negotiation.cc:769] Sending connection context
0811 16:37:48.016633 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 16:37:48.016800 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":86,"threads_started":1}
I20260811 16:37:48.017544 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 30686
I20260811 16:37:48.017671 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-0/wal/instance
I20260811 16:37:48.017859 25279 external_mini_cluster.cc:1428] Setting key cff6f99245403c38202ba3a160c9f965
I20260811 16:37:48.018476 30898 heartbeater.cc:347] Connected to a master server at 127.24.175.254:34917
I20260811 16:37:48.018572 30898 heartbeater.cc:464] Registering TS with master...
I20260811 16:37:48.018752 30898 heartbeater.cc:511] Master 127.24.175.254:34917 requested a full tablet report, sending...
I20260811 16:37:48.019623 30588 ts_manager.cc:194] Registered new tserver with Master: 9253837b2ad442e4bbf815428c680158 (127.24.175.193:37419)
I20260811 16:37:48.020380 30588 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.175.193@KRBTEST.COM'} at 127.24.175.193:52213
WARNING: no policy specified for kudu/127.24.175.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab.
Entry for principal kudu/127.24.175.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab.
I20260811 16:37:48.042995 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.194:0
--local_ip_for_outbound_sockets=127.24.175.194
--webserver_interface=127.24.175.194
--webserver_port=0
--tserver_master_addrs=127.24.175.254:34917
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab
--principal=kudu/127.24.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:40925
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:37:48.122722 30907 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:37:48.122906 30907 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:37:48.122927 30907 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:37:48.123973 30907 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:37:48.124004 30907 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:37:48.124029 30907 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.194
I20260811 16:37:48.125394 30907 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:40925
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab
--principal=kudu/127.24.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.175.194
--webserver_port=0
--tserver_master_addrs=127.24.175.254:34917
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30907
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.194
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:37:48.125576 30907 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:37:48.125742 30907 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:37:48.130437 30916 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:37:48.130630 30907 server_base.cc:1034] running on GCE node
W20260811 16:37:48.130475 30921 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:48.130439 30915 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:37:48.130875 30907 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:37:48.131083 30907 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:37:48.132221 30907 hybrid_clock.cc:648] HybridClock initialized: now 1786466268132203 us; error 31 us; skew 500 ppm
Aug 11 16:37:48 dist-test-slave-zj8q krb5kdc[30525](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466268, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:37:48.134580 30907 init.cc:377] Logged in from keytab as kudu/127.24.175.194@KRBTEST.COM (short username kudu)
I20260811 16:37:48.134994 30907 webserver.cc:460] Webserver started at http://127.24.175.194:41659/ using document root <none> and password file <none>
I20260811 16:37:48.135183 30907 fs_manager.cc:359] Metadata directory not provided
I20260811 16:37:48.135229 30907 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:37:48.135353 30907 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:37:48.136310 30907 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-1/data/instance:
uuid: "c069a685ea7a405ba11b37127d8f8373"
format_stamp: "Formatted at 2026-08-11 16:37:48 on dist-test-slave-zj8q"
server_key: "6c574fa142bf665d43a92397ee420258"
server_key_iv: "e30e3b8f4a1bda645f25d56a6b2fd4dc"
server_key_version: "encryptionkey@0"
I20260811 16:37:48.136629 30907 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-1/wal/instance:
uuid: "c069a685ea7a405ba11b37127d8f8373"
format_stamp: "Formatted at 2026-08-11 16:37:48 on dist-test-slave-zj8q"
server_key: "6c574fa142bf665d43a92397ee420258"
server_key_iv: "e30e3b8f4a1bda645f25d56a6b2fd4dc"
server_key_version: "encryptionkey@0"
I20260811 16:37:48.137832 30907 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:37:48.138479 30930 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:48.138633 30907 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:48.138713 30907 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-1/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-1/wal
uuid: "c069a685ea7a405ba11b37127d8f8373"
format_stamp: "Formatted at 2026-08-11 16:37:48 on dist-test-slave-zj8q"
server_key: "6c574fa142bf665d43a92397ee420258"
server_key_iv: "e30e3b8f4a1bda645f25d56a6b2fd4dc"
server_key_version: "encryptionkey@0"
I20260811 16:37:48.138780 30907 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:37:48.159997 30907 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:37:48.161651 30907 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:37:48.161785 30907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:37:48.161993 30907 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:37:48.162290 30907 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:37:48.162324 30907 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:48.162351 30907 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:37:48.162369 30907 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:48.167833 30907 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.194:45495
I20260811 16:37:48.167905 31116 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.194:45495 every 8 connection(s)
I20260811 16:37:48.168164 30907 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
Aug 11 16:37:48 dist-test-slave-zj8q krb5kdc[30525](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466268, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.194@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:37:48.176349 30654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:48.168806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:41775 (local address 127.24.175.254:34917)
0811 16:37:48.168876 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:48.168878 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:48.169023 (+ 145us) server_negotiation.cc:407] Connection header received
0811 16:37:48.169466 (+ 443us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:48.169467 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:48.169476 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:48.169520 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:48.170390 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:48.170896 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:48.171836 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:48.172071 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:48.172129 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:48.173995 (+ 1866us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:48.173997 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:48.173997 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:37:48.174005 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:48.175109 (+ 1104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:48.175452 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:48.175453 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:48.175453 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:48.175511 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:48.175718 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:48.175719 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:48.175720 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:48.175833 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:48.175889 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:48.176154 (+ 265us) server_negotiation.cc:299] Negotiation successful
0811 16:37:48.176257 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 16:37:48.176463 31119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:48.168764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:34917 (local address 127.24.175.194:41775)
0811 16:37:48.168919 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:48.168952 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:48.169394 (+ 442us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:48.169577 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:48.169580 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:48.170119 (+ 539us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:37:48.170329 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:48.170334 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:48.170957 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:48.170958 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:48.171734 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:48.171736 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:48.172144 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:48.172144 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:48.172277 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:48.172638 (+ 361us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:37:48.172646 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:37:48.173904 (+ 1258us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:37:48.175177 (+ 1273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:48.175183 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:48.175185 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:48.175384 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:48.175563 (+ 179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:48.175563 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:48.175564 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:48.175662 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:48.175886 (+ 224us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:37:48.175892 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:37:48.176030 (+ 138us) client_negotiation.cc:769] Sending connection context
0811 16:37:48.176114 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 16:37:48.176260 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":83,"threads_started":1}
I20260811 16:37:48.176879 31117 heartbeater.cc:347] Connected to a master server at 127.24.175.254:34917
I20260811 16:37:48.176970 31117 heartbeater.cc:464] Registering TS with master...
I20260811 16:37:48.177130 31117 heartbeater.cc:511] Master 127.24.175.254:34917 requested a full tablet report, sending...
I20260811 16:37:48.177471 30588 ts_manager.cc:194] Registered new tserver with Master: c069a685ea7a405ba11b37127d8f8373 (127.24.175.194:45495)
I20260811 16:37:48.177704 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 30907
I20260811 16:37:48.177788 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-1/wal/instance
I20260811 16:37:48.177874 30588 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.175.194@KRBTEST.COM'} at 127.24.175.194:41775
I20260811 16:37:48.177956 25279 external_mini_cluster.cc:1428] Setting key 467d658b68954c77698309bdc4682872
WARNING: no policy specified for kudu/127.24.175.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab.
Entry for principal kudu/127.24.175.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab.
I20260811 16:37:48.201810 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.195:0
--local_ip_for_outbound_sockets=127.24.175.195
--webserver_interface=127.24.175.195
--webserver_port=0
--tserver_master_addrs=127.24.175.254:34917
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab
--principal=kudu/127.24.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:40925
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:37:48.284075 31122 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:37:48.284276 31122 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:37:48.284300 31122 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:37:48.285422 31122 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:37:48.285463 31122 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:37:48.285491 31122 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.195
I20260811 16:37:48.287101 31122 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:40925
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab
--principal=kudu/127.24.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.175.195
--webserver_port=0
--tserver_master_addrs=127.24.175.254:34917
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31122
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.195
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:37:48.287341 31122 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:37:48.287559 31122 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:37:48.292451 31131 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:48.292416 31133 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:48.292423 31136 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:37:48.292626 31122 server_base.cc:1034] running on GCE node
I20260811 16:37:48.292814 31122 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:37:48.293001 31122 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:37:48.294134 31122 hybrid_clock.cc:648] HybridClock initialized: now 1786466268294126 us; error 26 us; skew 500 ppm
Aug 11 16:37:48 dist-test-slave-zj8q krb5kdc[30525](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466268, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:37:48.296610 31122 init.cc:377] Logged in from keytab as kudu/127.24.175.195@KRBTEST.COM (short username kudu)
I20260811 16:37:48.297010 31122 webserver.cc:460] Webserver started at http://127.24.175.195:46163/ using document root <none> and password file <none>
I20260811 16:37:48.297426 31122 fs_manager.cc:359] Metadata directory not provided
I20260811 16:37:48.297478 31122 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:37:48.297586 31122 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:37:48.298602 31122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-2/data/instance:
uuid: "358dc983561b4988b3fb5fd05e0f13b7"
format_stamp: "Formatted at 2026-08-11 16:37:48 on dist-test-slave-zj8q"
server_key: "56820d52a3da4f578d34e44d284bb117"
server_key_iv: "bf1271006d2058207d3911daca781bb2"
server_key_version: "encryptionkey@0"
I20260811 16:37:48.298924 31122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-2/wal/instance:
uuid: "358dc983561b4988b3fb5fd05e0f13b7"
format_stamp: "Formatted at 2026-08-11 16:37:48 on dist-test-slave-zj8q"
server_key: "56820d52a3da4f578d34e44d284bb117"
server_key_iv: "bf1271006d2058207d3911daca781bb2"
server_key_version: "encryptionkey@0"
I20260811 16:37:48.300285 31122 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:37:48.300938 31145 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:48.301095 31122 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:37:48.301177 31122 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-2/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-2/wal
uuid: "358dc983561b4988b3fb5fd05e0f13b7"
format_stamp: "Formatted at 2026-08-11 16:37:48 on dist-test-slave-zj8q"
server_key: "56820d52a3da4f578d34e44d284bb117"
server_key_iv: "bf1271006d2058207d3911daca781bb2"
server_key_version: "encryptionkey@0"
I20260811 16:37:48.301257 31122 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:37:48.313670 31122 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:37:48.315804 31122 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:37:48.315920 31122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:37:48.316114 31122 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:37:48.316413 31122 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:37:48.316458 31122 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:48.316490 31122 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:37:48.316512 31122 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:48.321895 31122 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.195:38123
I20260811 16:37:48.322098 31321 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.195:38123 every 8 connection(s)
I20260811 16:37:48.322306 31122 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
I20260811 16:37:48.326815 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 31122
I20260811 16:37:48.326915 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466249441839-25279-0/minicluster-data/ts-2/wal/instance
I20260811 16:37:48.327093 25279 external_mini_cluster.cc:1428] Setting key 7ca8277889f0657da71ece6702619b3d
Aug 11 16:37:48 dist-test-slave-zj8q krb5kdc[30525](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466268, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.195@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:37:48.332505 30654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:48.323467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.195:34645 (local address 127.24.175.254:34917)
0811 16:37:48.323531 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:48.323533 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:48.323722 (+ 189us) server_negotiation.cc:407] Connection header received
0811 16:37:48.324330 (+ 608us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:48.324331 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:48.324341 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:48.324383 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:48.325857 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:48.326449 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:48.327718 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:48.327909 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:48.327971 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:48.330200 (+ 2229us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:48.330201 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:48.330201 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:37:48.330208 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:48.331348 (+ 1140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:48.331746 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:48.331747 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:48.331747 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:48.331791 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:48.331980 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:48.331980 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:48.331981 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:48.332073 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:48.332132 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:48.332380 (+ 248us) server_negotiation.cc:299] Negotiation successful
0811 16:37:48.332440 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 16:37:48.332715 31324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:48.323428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:34917 (local address 127.24.175.195:34645)
0811 16:37:48.323590 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:48.323637 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:48.324240 (+ 603us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:48.324450 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:48.324455 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:48.325195 (+ 740us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:37:48.325425 (+ 230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:48.325431 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:48.326526 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:48.326527 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:48.327624 (+ 1097us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:48.327627 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:48.327988 (+ 361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:48.327990 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:48.328123 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:48.328744 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:37:48.328752 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:37:48.330096 (+ 1344us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:37:48.331417 (+ 1321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:48.331423 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:48.331425 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:48.331687 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:48.331847 (+ 160us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:48.331847 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:48.331847 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:48.331939 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:48.332146 (+ 207us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:37:48.332151 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:37:48.332273 (+ 122us) client_negotiation.cc:769] Sending connection context
0811 16:37:48.332363 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 16:37:48.332485 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":83,"threads_started":1}
I20260811 16:37:48.333173 31322 heartbeater.cc:347] Connected to a master server at 127.24.175.254:34917
I20260811 16:37:48.333256 31322 heartbeater.cc:464] Registering TS with master...
I20260811 16:37:48.333398 31322 heartbeater.cc:511] Master 127.24.175.254:34917 requested a full tablet report, sending...
I20260811 16:37:48.333747 30588 ts_manager.cc:194] Registered new tserver with Master: 358dc983561b4988b3fb5fd05e0f13b7 (127.24.175.195:38123)
I20260811 16:37:48.334079 30588 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.175.195@KRBTEST.COM'} at 127.24.175.195:34645
I20260811 16:37:48.338879 25279 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 16:37:48 dist-test-slave-zj8q krb5kdc[30525](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466268, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 11 16:37:48 dist-test-slave-zj8q krb5kdc[30525](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466268, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:37:48.428730 30654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:48.421716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42478 (local address 127.24.175.254:34917)
0811 16:37:48.421775 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:48.421777 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:48.421923 (+ 146us) server_negotiation.cc:407] Connection header received
0811 16:37:48.421963 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:48.421964 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:48.421978 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:48.422036 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:48.422651 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:48.423400 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:48.424138 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:48.424404 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:48.424472 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:48.426672 (+ 2200us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:48.426674 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:48.426674 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:37:48.426681 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:48.427800 (+ 1119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:48.428086 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:48.428086 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:48.428086 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:48.428142 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:48.428292 (+ 150us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:48.428293 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:48.428293 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:48.428436 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:48.428512 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:48.428585 (+ 73us) server_negotiation.cc:299] Negotiation successful
0811 16:37:48.428653 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
W20260811 16:37:48.428958 30588 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:42478
I20260811 16:37:48.429334 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 30686
I20260811 16:37:48.440682 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 30907
I20260811 16:37:48.451050 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 31122
I20260811 16:37:48.464180 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 30541
2026-08-11T16:37:48Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2063 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:37:50 dist-test-slave-zj8q krb5kdc[31345](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:37:50 dist-test-slave-zj8q krb5kdc[31345](info): set up 2 sockets
Aug 11 16:37:50 dist-test-slave-zj8q krb5kdc[31345](info): commencing operation
krb5kdc: starting...
W20260811 16:37:51.171970 25279 mini_kdc.cc:121] Time spent starting KDC: real 2.682s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Aug 11 16:37:51 dist-test-slave-zj8q krb5kdc[31345](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466271, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:37:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:37:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab.
Entry for principal kudu/127.24.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab.
I20260811 16:37:51.284968 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:38829
--webserver_interface=127.24.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:34925
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.175.254:38829
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:37:51.365352 31368 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:37:51.365557 31368 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:37:51.365590 31368 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:37:51.366717 31368 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:37:51.366761 31368 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:37:51.366779 31368 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:37:51.366796 31368 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:37:51.366811 31368 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:37:51.368275 31368 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:34925
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.175.254:38829
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:38829
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31368
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:37:51.368494 31368 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:37:51.368695 31368 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:37:51.373343 31385 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:51.373355 31378 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:51.373355 31377 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:37:51.373449 31368 server_base.cc:1034] running on GCE node
I20260811 16:37:51.373802 31368 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:37:51.374073 31368 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:37:51.375203 31368 hybrid_clock.cc:648] HybridClock initialized: now 1786466271375204 us; error 37 us; skew 500 ppm
Aug 11 16:37:51 dist-test-slave-zj8q krb5kdc[31345](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466271, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:37:51.382602 31368 init.cc:377] Logged in from keytab as kudu/127.24.175.254@KRBTEST.COM (short username kudu)
I20260811 16:37:51.383020 31368 webserver.cc:460] Webserver started at http://127.24.175.254:43537/ using document root <none> and password file <none>
I20260811 16:37:51.383244 31368 fs_manager.cc:359] Metadata directory not provided
I20260811 16:37:51.383291 31368 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:37:51.383397 31368 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:37:51.384441 31368 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/minicluster-data/master-0/data/instance:
uuid: "68ce4829bb154d2eb000ee6d8fc31be9"
format_stamp: "Formatted at 2026-08-11 16:37:51 on dist-test-slave-zj8q"
server_key: "2c76cdda3bfd39ccd2a4a415ddeda4a0"
server_key_iv: "794d807d082e5baab15a4e9aa99bf7d3"
server_key_version: "encryptionkey@0"
I20260811 16:37:51.384770 31368 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/minicluster-data/master-0/wal/instance:
uuid: "68ce4829bb154d2eb000ee6d8fc31be9"
format_stamp: "Formatted at 2026-08-11 16:37:51 on dist-test-slave-zj8q"
server_key: "2c76cdda3bfd39ccd2a4a415ddeda4a0"
server_key_iv: "794d807d082e5baab15a4e9aa99bf7d3"
server_key_version: "encryptionkey@0"
I20260811 16:37:51.386030 31368 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 16:37:51.386767 31394 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:51.386921 31368 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:51.387005 31368 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/minicluster-data/master-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/minicluster-data/master-0/wal
uuid: "68ce4829bb154d2eb000ee6d8fc31be9"
format_stamp: "Formatted at 2026-08-11 16:37:51 on dist-test-slave-zj8q"
server_key: "2c76cdda3bfd39ccd2a4a415ddeda4a0"
server_key_iv: "794d807d082e5baab15a4e9aa99bf7d3"
server_key_version: "encryptionkey@0"
I20260811 16:37:51.387070 31368 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:37:51.396301 31368 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:37:51.398356 31368 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:37:51.398486 31368 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:37:51.402350 31368 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.254:38829
I20260811 16:37:51.402380 31482 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.254:38829 every 8 connection(s)
I20260811 16:37:51.402848 31368 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
I20260811 16:37:51.403473 31484 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:37:51.405649 31484 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 68ce4829bb154d2eb000ee6d8fc31be9: Bootstrap starting.
I20260811 16:37:51.406253 31484 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 68ce4829bb154d2eb000ee6d8fc31be9: Neither blocks nor log segments found. Creating new log.
I20260811 16:37:51.406527 31484 log.cc:824] T 00000000000000000000000000000000 P 68ce4829bb154d2eb000ee6d8fc31be9: Log is configured to *not* fsync() on all Append() calls
I20260811 16:37:51.407256 31484 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 68ce4829bb154d2eb000ee6d8fc31be9: No bootstrap required, opened a new log
I20260811 16:37:51.408803 31484 raft_consensus.cc:348] T 00000000000000000000000000000000 P 68ce4829bb154d2eb000ee6d8fc31be9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68ce4829bb154d2eb000ee6d8fc31be9" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 38829 } }
I20260811 16:37:51.408932 31484 raft_consensus.cc:374] T 00000000000000000000000000000000 P 68ce4829bb154d2eb000ee6d8fc31be9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:37:51.408964 31484 raft_consensus.cc:729] T 00000000000000000000000000000000 P 68ce4829bb154d2eb000ee6d8fc31be9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68ce4829bb154d2eb000ee6d8fc31be9, State: Initialized, Role: FOLLOWER
I20260811 16:37:51.409099 31484 consensus_queue.cc:260] T 00000000000000000000000000000000 P 68ce4829bb154d2eb000ee6d8fc31be9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68ce4829bb154d2eb000ee6d8fc31be9" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 38829 } }
I20260811 16:37:51.409160 31484 raft_consensus.cc:388] T 00000000000000000000000000000000 P 68ce4829bb154d2eb000ee6d8fc31be9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:37:51.409193 31484 raft_consensus.cc:482] T 00000000000000000000000000000000 P 68ce4829bb154d2eb000ee6d8fc31be9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:37:51.409236 31484 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 68ce4829bb154d2eb000ee6d8fc31be9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:37:51.409667 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 31368
I20260811 16:37:51.409760 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/minicluster-data/master-0/wal/instance
I20260811 16:37:51.409927 25279 external_mini_cluster.cc:1428] Setting key 065ce7f011d713e6f88e8e3ff7c78e8a
I20260811 16:37:51.410126 31484 raft_consensus.cc:504] T 00000000000000000000000000000000 P 68ce4829bb154d2eb000ee6d8fc31be9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68ce4829bb154d2eb000ee6d8fc31be9" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 38829 } }
I20260811 16:37:51.410255 31484 leader_election.cc:302] T 00000000000000000000000000000000 P 68ce4829bb154d2eb000ee6d8fc31be9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 68ce4829bb154d2eb000ee6d8fc31be9; no voters:
I20260811 16:37:51.410461 31484 leader_election.cc:288] T 00000000000000000000000000000000 P 68ce4829bb154d2eb000ee6d8fc31be9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:37:51.410501 31493 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 68ce4829bb154d2eb000ee6d8fc31be9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:37:51.410684 31493 raft_consensus.cc:686] T 00000000000000000000000000000000 P 68ce4829bb154d2eb000ee6d8fc31be9 [term 1 LEADER]: Becoming Leader. State: Replica: 68ce4829bb154d2eb000ee6d8fc31be9, State: Running, Role: LEADER
I20260811 16:37:51.410753 31484 sys_catalog.cc:564] T 00000000000000000000000000000000 P 68ce4829bb154d2eb000ee6d8fc31be9 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:37:51.410815 31493 consensus_queue.cc:237] T 00000000000000000000000000000000 P 68ce4829bb154d2eb000ee6d8fc31be9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68ce4829bb154d2eb000ee6d8fc31be9" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 38829 } }
I20260811 16:37:51.411182 31498 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68ce4829bb154d2eb000ee6d8fc31be9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "68ce4829bb154d2eb000ee6d8fc31be9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68ce4829bb154d2eb000ee6d8fc31be9" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 38829 } } }
I20260811 16:37:51.411257 31498 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68ce4829bb154d2eb000ee6d8fc31be9 [sys.catalog]: This master's current role is: LEADER
I20260811 16:37:51.411293 31500 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68ce4829bb154d2eb000ee6d8fc31be9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 68ce4829bb154d2eb000ee6d8fc31be9. Latest consensus state: current_term: 1 leader_uuid: "68ce4829bb154d2eb000ee6d8fc31be9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68ce4829bb154d2eb000ee6d8fc31be9" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 38829 } } }
I20260811 16:37:51.411339 31500 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68ce4829bb154d2eb000ee6d8fc31be9 [sys.catalog]: This master's current role is: LEADER
I20260811 16:37:51.411463 31515 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:37:51.413503 31515 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:37:51.415508 31515 catalog_manager.cc:1347] Generated new cluster ID: 911ccac5b41c4cb99a812ef894cc3ed5
I20260811 16:37:51.415558 31515 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 16:37:51 dist-test-slave-zj8q krb5kdc[31345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466271, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:37:51.421116 31497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:51.410377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54804 (local address 127.24.175.254:38829)
0811 16:37:51.410816 (+ 439us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:51.410825 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:51.410859 (+ 34us) server_negotiation.cc:407] Connection header received
0811 16:37:51.410971 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:51.410978 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:51.411032 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:51.411169 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:51.411941 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:51.413332 (+ 1391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:51.414355 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:51.414960 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:51.415072 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:51.417664 (+ 2592us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:51.417669 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:51.417669 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:37:51.417681 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:51.419568 (+ 1887us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:51.419935 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:51.419938 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:51.419939 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:51.420049 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:51.420225 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:51.420226 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:51.420226 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:51.420522 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:51.420689 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:51.420757 (+ 68us) server_negotiation.cc:299] Negotiation successful
0811 16:37:51.420894 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":351,"thread_start_us":76,"threads_started":1}
I20260811 16:37:51.432761 31515 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:37:51.433219 31515 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:37:51.435868 31515 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 68ce4829bb154d2eb000ee6d8fc31be9: Generated new TSK 0
I20260811 16:37:51.436002 31515 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.175.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab.
Entry for principal kudu/127.24.175.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab.
I20260811 16:37:51.464465 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.193:0
--local_ip_for_outbound_sockets=127.24.175.193
--webserver_interface=127.24.175.193
--webserver_port=0
--tserver_master_addrs=127.24.175.254:38829
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab
--principal=kudu/127.24.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:34925
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:37:51.568259 31538 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:37:51.568460 31538 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:37:51.568482 31538 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:37:51.569572 31538 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:37:51.569609 31538 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:37:51.569633 31538 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.193
I20260811 16:37:51.571131 31538 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:34925
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab
--principal=kudu/127.24.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.175.193
--webserver_port=0
--tserver_master_addrs=127.24.175.254:38829
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31538
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.193
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:37:51.571312 31538 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:37:51.571483 31538 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:37:51.576254 31551 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:51.576254 31556 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:37:51.576407 31538 server_base.cc:1034] running on GCE node
W20260811 16:37:51.576498 31549 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:37:51.576723 31538 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:37:51.576948 31538 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:37:51.578090 31538 hybrid_clock.cc:648] HybridClock initialized: now 1786466271578074 us; error 29 us; skew 500 ppm
Aug 11 16:37:51 dist-test-slave-zj8q krb5kdc[31345](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466271, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:37:51.580549 31538 init.cc:377] Logged in from keytab as kudu/127.24.175.193@KRBTEST.COM (short username kudu)
I20260811 16:37:51.580936 31538 webserver.cc:460] Webserver started at http://127.24.175.193:41029/ using document root <none> and password file <none>
I20260811 16:37:51.581126 31538 fs_manager.cc:359] Metadata directory not provided
I20260811 16:37:51.581174 31538 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:37:51.581306 31538 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:37:51.582373 31538 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/minicluster-data/ts-0/data/instance:
uuid: "bf927dd320904e51b1ab9bf80c787b85"
format_stamp: "Formatted at 2026-08-11 16:37:51 on dist-test-slave-zj8q"
server_key: "1f072ce0b5e13bc7ee8067c65475299b"
server_key_iv: "c342bf76ec4bb3e914329719cfd3f245"
server_key_version: "encryptionkey@0"
I20260811 16:37:51.582702 31538 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/minicluster-data/ts-0/wal/instance:
uuid: "bf927dd320904e51b1ab9bf80c787b85"
format_stamp: "Formatted at 2026-08-11 16:37:51 on dist-test-slave-zj8q"
server_key: "1f072ce0b5e13bc7ee8067c65475299b"
server_key_iv: "c342bf76ec4bb3e914329719cfd3f245"
server_key_version: "encryptionkey@0"
I20260811 16:37:51.583989 31538 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:37:51.584745 31564 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:51.584899 31538 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:37:51.584985 31538 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/minicluster-data/ts-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/minicluster-data/ts-0/wal
uuid: "bf927dd320904e51b1ab9bf80c787b85"
format_stamp: "Formatted at 2026-08-11 16:37:51 on dist-test-slave-zj8q"
server_key: "1f072ce0b5e13bc7ee8067c65475299b"
server_key_iv: "c342bf76ec4bb3e914329719cfd3f245"
server_key_version: "encryptionkey@0"
I20260811 16:37:51.585044 31538 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:37:51.607551 31538 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:37:51.609629 31538 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:37:51.609766 31538 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:37:51.609984 31538 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:37:51.610333 31538 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:37:51.610370 31538 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:51.610399 31538 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:37:51.610422 31538 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:51.615988 31538 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.193:34463
I20260811 16:37:51.616031 31753 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.193:34463 every 8 connection(s)
I20260811 16:37:51.616333 31538 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
I20260811 16:37:51.619585 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 31538
I20260811 16:37:51.619688 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/minicluster-data/ts-0/wal/instance
I20260811 16:37:51.619884 25279 external_mini_cluster.cc:1428] Setting key 352d06ca9fcb11edc4aa4dec7e5f03b1
Aug 11 16:37:51 dist-test-slave-zj8q krb5kdc[31345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466271, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.193@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:37:51.625376 31497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:51.617017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:39703 (local address 127.24.175.254:38829)
0811 16:37:51.617070 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:51.617071 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:51.617240 (+ 169us) server_negotiation.cc:407] Connection header received
0811 16:37:51.618121 (+ 881us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:51.618122 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:51.618137 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:51.618212 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:51.618759 (+ 547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:51.619248 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:51.620490 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:51.620776 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:51.620842 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:51.622970 (+ 2128us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:51.622971 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:51.622971 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:37:51.622979 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:51.624165 (+ 1186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:51.624519 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:51.624521 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:51.624521 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:51.624577 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:51.624783 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:51.624784 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:51.624785 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:51.624896 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:51.624951 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:51.625200 (+ 249us) server_negotiation.cc:299] Negotiation successful
0811 16:37:51.625288 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 16:37:51.625571 31758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:51.616981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:38829 (local address 127.24.175.193:39703)
0811 16:37:51.617123 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:51.617164 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:51.618029 (+ 865us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:51.618277 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:51.618281 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:51.618508 (+ 227us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:37:51.618690 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:51.618694 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:51.619304 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:51.619305 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:51.620420 (+ 1115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:51.620423 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:51.620875 (+ 452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:51.620876 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:51.620990 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:51.621406 (+ 416us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:37:51.621415 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:37:51.622883 (+ 1468us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:37:51.624243 (+ 1360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:51.624250 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:51.624252 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:51.624454 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:51.624630 (+ 176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:51.624631 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:51.624631 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:51.624728 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:51.624948 (+ 220us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:37:51.624954 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:37:51.625082 (+ 128us) client_negotiation.cc:769] Sending connection context
0811 16:37:51.625178 (+ 96us) client_negotiation.cc:240] Negotiation successful
0811 16:37:51.625343 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":64,"threads_started":1}
I20260811 16:37:51.626060 31754 heartbeater.cc:347] Connected to a master server at 127.24.175.254:38829
I20260811 16:37:51.626186 31754 heartbeater.cc:464] Registering TS with master...
I20260811 16:37:51.626366 31754 heartbeater.cc:511] Master 127.24.175.254:38829 requested a full tablet report, sending...
I20260811 16:37:51.626868 31426 ts_manager.cc:194] Registered new tserver with Master: bf927dd320904e51b1ab9bf80c787b85 (127.24.175.193:34463)
I20260811 16:37:51.627444 31426 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.175.193@KRBTEST.COM'} at 127.24.175.193:39703
WARNING: no policy specified for kudu/127.24.175.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab.
Entry for principal kudu/127.24.175.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab.
I20260811 16:37:51.643093 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.194:0
--local_ip_for_outbound_sockets=127.24.175.194
--webserver_interface=127.24.175.194
--webserver_port=0
--tserver_master_addrs=127.24.175.254:38829
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab
--principal=kudu/127.24.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:34925
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:37:51.724107 31764 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:37:51.724299 31764 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:37:51.724320 31764 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:37:51.725392 31764 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:37:51.725426 31764 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:37:51.725450 31764 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.194
I20260811 16:37:51.726996 31764 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:34925
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab
--principal=kudu/127.24.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.175.194
--webserver_port=0
--tserver_master_addrs=127.24.175.254:38829
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31764
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.194
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:37:51.727191 31764 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:37:51.727370 31764 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 16:37:51.732156 31764 server_base.cc:1034] running on GCE node
W20260811 16:37:51.732120 31771 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:51.732120 31773 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:51.732110 31776 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:37:51.732573 31764 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:37:51.732842 31764 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:37:51.733979 31764 hybrid_clock.cc:648] HybridClock initialized: now 1786466271733961 us; error 32 us; skew 500 ppm
Aug 11 16:37:51 dist-test-slave-zj8q krb5kdc[31345](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466271, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:37:51.736346 31764 init.cc:377] Logged in from keytab as kudu/127.24.175.194@KRBTEST.COM (short username kudu)
I20260811 16:37:51.736789 31764 webserver.cc:460] Webserver started at http://127.24.175.194:46367/ using document root <none> and password file <none>
I20260811 16:37:51.737015 31764 fs_manager.cc:359] Metadata directory not provided
I20260811 16:37:51.737083 31764 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:37:51.737208 31764 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:37:51.738238 31764 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/minicluster-data/ts-1/data/instance:
uuid: "4b4a1134decd4b23947a6737ac71cb9f"
format_stamp: "Formatted at 2026-08-11 16:37:51 on dist-test-slave-zj8q"
server_key: "a32f50ee2509ba5ca18e9c7ad46cc2b7"
server_key_iv: "4371f9605c9d4abeaf00f34648153a94"
server_key_version: "encryptionkey@0"
I20260811 16:37:51.738580 31764 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/minicluster-data/ts-1/wal/instance:
uuid: "4b4a1134decd4b23947a6737ac71cb9f"
format_stamp: "Formatted at 2026-08-11 16:37:51 on dist-test-slave-zj8q"
server_key: "a32f50ee2509ba5ca18e9c7ad46cc2b7"
server_key_iv: "4371f9605c9d4abeaf00f34648153a94"
server_key_version: "encryptionkey@0"
I20260811 16:37:51.739791 31764 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:37:51.740402 31785 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:51.740550 31764 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:37:51.740634 31764 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/minicluster-data/ts-1/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/minicluster-data/ts-1/wal
uuid: "4b4a1134decd4b23947a6737ac71cb9f"
format_stamp: "Formatted at 2026-08-11 16:37:51 on dist-test-slave-zj8q"
server_key: "a32f50ee2509ba5ca18e9c7ad46cc2b7"
server_key_iv: "4371f9605c9d4abeaf00f34648153a94"
server_key_version: "encryptionkey@0"
I20260811 16:37:51.740701 31764 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:37:51.749668 31764 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:37:51.751458 31764 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:37:51.751588 31764 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:37:51.751792 31764 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:37:51.752068 31764 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:37:51.752100 31764 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:51.752126 31764 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:37:51.752151 31764 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:51.757469 31764 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.194:35543
I20260811 16:37:51.757525 31986 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.194:35543 every 8 connection(s)
I20260811 16:37:51.757803 31764 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
Aug 11 16:37:51 dist-test-slave-zj8q krb5kdc[31345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466271, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.194@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:37:51.765718 31497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:51.758431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:46511 (local address 127.24.175.254:38829)
0811 16:37:51.758512 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:51.758514 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:51.758662 (+ 148us) server_negotiation.cc:407] Connection header received
0811 16:37:51.759531 (+ 869us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:51.759533 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:51.759543 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:51.759591 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:51.760121 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:51.760614 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:51.761509 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:51.761683 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:51.761731 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:51.763558 (+ 1827us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:51.763560 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:51.763560 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:37:51.763567 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:51.764753 (+ 1186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:51.765040 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:51.765041 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:51.765041 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:51.765083 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:51.765264 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:51.765264 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:51.765265 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:51.765355 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:51.765398 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:51.765597 (+ 199us) server_negotiation.cc:299] Negotiation successful
0811 16:37:51.765655 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 16:37:51.765869 31990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:51.758402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:38829 (local address 127.24.175.194:46511)
0811 16:37:51.758554 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:51.758588 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:51.759448 (+ 860us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:51.759647 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:51.759651 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:51.759884 (+ 233us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:37:51.760061 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:51.760065 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:51.760670 (+ 605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:51.760671 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:51.761450 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:51.761452 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:51.761734 (+ 282us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:51.761734 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:51.761822 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:51.762236 (+ 414us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:37:51.762246 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:37:51.763478 (+ 1232us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:37:51.764810 (+ 1332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:51.764813 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:51.764814 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:51.764992 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:51.765124 (+ 132us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:51.765125 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:51.765125 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:51.765222 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:51.765395 (+ 173us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:37:51.765398 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:37:51.765498 (+ 100us) client_negotiation.cc:769] Sending connection context
0811 16:37:51.765580 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 16:37:51.765690 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":79,"threads_started":1}
I20260811 16:37:51.766324 31987 heartbeater.cc:347] Connected to a master server at 127.24.175.254:38829
I20260811 16:37:51.766408 31987 heartbeater.cc:464] Registering TS with master...
I20260811 16:37:51.766574 31987 heartbeater.cc:511] Master 127.24.175.254:38829 requested a full tablet report, sending...
I20260811 16:37:51.766907 31426 ts_manager.cc:194] Registered new tserver with Master: 4b4a1134decd4b23947a6737ac71cb9f (127.24.175.194:35543)
I20260811 16:37:51.767272 31426 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.175.194@KRBTEST.COM'} at 127.24.175.194:46511
I20260811 16:37:51.767568 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 31764
I20260811 16:37:51.767692 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/minicluster-data/ts-1/wal/instance
I20260811 16:37:51.767889 25279 external_mini_cluster.cc:1428] Setting key 89057ac40f2390768ba4b650fe46e89d
WARNING: no policy specified for kudu/127.24.175.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab.
Entry for principal kudu/127.24.175.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab.
I20260811 16:37:51.790652 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.195:0
--local_ip_for_outbound_sockets=127.24.175.195
--webserver_interface=127.24.175.195
--webserver_port=0
--tserver_master_addrs=127.24.175.254:38829
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab
--principal=kudu/127.24.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:34925
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:37:51.869676 31993 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:37:51.869860 31993 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:37:51.869880 31993 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:37:51.870995 31993 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:37:51.871037 31993 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:37:51.871063 31993 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.195
I20260811 16:37:51.872555 31993 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:34925
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab
--principal=kudu/127.24.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.175.195
--webserver_port=0
--tserver_master_addrs=127.24.175.254:38829
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31993
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.195
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:37:51.872767 31993 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:37:51.872969 31993 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:37:51.877665 32005 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:51.877693 32008 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:37:51.877703 31993 server_base.cc:1034] running on GCE node
W20260811 16:37:51.877693 32006 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:37:51.878038 31993 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:37:51.878306 31993 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:37:51.879442 31993 hybrid_clock.cc:648] HybridClock initialized: now 1786466271879423 us; error 33 us; skew 500 ppm
Aug 11 16:37:51 dist-test-slave-zj8q krb5kdc[31345](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466271, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:37:51.882129 31993 init.cc:377] Logged in from keytab as kudu/127.24.175.195@KRBTEST.COM (short username kudu)
I20260811 16:37:51.882571 31993 webserver.cc:460] Webserver started at http://127.24.175.195:45053/ using document root <none> and password file <none>
I20260811 16:37:51.882792 31993 fs_manager.cc:359] Metadata directory not provided
I20260811 16:37:51.882839 31993 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:37:51.882963 31993 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:37:51.883942 31993 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/minicluster-data/ts-2/data/instance:
uuid: "1626663d17c243f394d33116d2109748"
format_stamp: "Formatted at 2026-08-11 16:37:51 on dist-test-slave-zj8q"
server_key: "0b32a5528993c8e829f88744e64e7bff"
server_key_iv: "d078c6054e73a98a325372523a1c4b89"
server_key_version: "encryptionkey@0"
I20260811 16:37:51.884265 31993 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/minicluster-data/ts-2/wal/instance:
uuid: "1626663d17c243f394d33116d2109748"
format_stamp: "Formatted at 2026-08-11 16:37:51 on dist-test-slave-zj8q"
server_key: "0b32a5528993c8e829f88744e64e7bff"
server_key_iv: "d078c6054e73a98a325372523a1c4b89"
server_key_version: "encryptionkey@0"
I20260811 16:37:51.885577 31993 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:37:51.886258 32027 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:51.886428 31993 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:37:51.886516 31993 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/minicluster-data/ts-2/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/minicluster-data/ts-2/wal
uuid: "1626663d17c243f394d33116d2109748"
format_stamp: "Formatted at 2026-08-11 16:37:51 on dist-test-slave-zj8q"
server_key: "0b32a5528993c8e829f88744e64e7bff"
server_key_iv: "d078c6054e73a98a325372523a1c4b89"
server_key_version: "encryptionkey@0"
I20260811 16:37:51.886582 31993 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:37:51.899070 31993 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:37:51.901068 31993 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:37:51.901201 31993 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:37:51.901392 31993 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:37:51.901677 31993 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:37:51.901710 31993 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:51.901737 31993 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:37:51.901762 31993 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:51.907306 31993 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.195:37709
I20260811 16:37:51.907363 32212 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.195:37709 every 8 connection(s)
I20260811 16:37:51.907637 31993 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
Aug 11 16:37:51 dist-test-slave-zj8q krb5kdc[31345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466271, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.195@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:37:51.914863 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 31993
I20260811 16:37:51.914969 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466249441839-25279-0/minicluster-data/ts-2/wal/instance
I20260811 16:37:51.915151 25279 external_mini_cluster.cc:1428] Setting key 21188f78a3b9e2c203d2ad6ecc6451d5
I20260811 16:37:51.916778 31497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:51.908251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.195:52631 (local address 127.24.175.254:38829)
0811 16:37:51.908306 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:51.908308 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:51.908492 (+ 184us) server_negotiation.cc:407] Connection header received
0811 16:37:51.909392 (+ 900us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:51.909394 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:51.909408 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:51.909459 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:51.910099 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:51.910690 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:51.911841 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:51.912063 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:51.912118 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:51.914201 (+ 2083us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:51.914203 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:51.914204 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:37:51.914211 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:51.915453 (+ 1242us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:51.915957 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:51.915958 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:51.915958 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:51.916022 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:51.916269 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:51.916270 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:51.916271 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:51.916382 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:51.916434 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:51.916651 (+ 217us) server_negotiation.cc:299] Negotiation successful
0811 16:37:51.916715 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 16:37:51.916939 32216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:51.908219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:38829 (local address 127.24.175.195:52631)
0811 16:37:51.908385 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:51.908419 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:51.909286 (+ 867us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:51.909526 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:51.909530 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:51.909777 (+ 247us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:37:51.909955 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:51.909959 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:51.910780 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:51.910781 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:51.911763 (+ 982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:51.911766 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:51.912132 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:51.912133 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:51.912249 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:51.912674 (+ 425us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:37:51.912685 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:37:51.914082 (+ 1397us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:37:51.915575 (+ 1493us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:51.915582 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:51.915585 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:51.915885 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:51.916087 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:51.916087 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:51.916088 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:51.916213 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:51.916426 (+ 213us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:37:51.916428 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:37:51.916554 (+ 126us) client_negotiation.cc:769] Sending connection context
0811 16:37:51.916631 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 16:37:51.916749 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":84,"threads_started":1}
I20260811 16:37:51.917343 32213 heartbeater.cc:347] Connected to a master server at 127.24.175.254:38829
I20260811 16:37:51.917430 32213 heartbeater.cc:464] Registering TS with master...
I20260811 16:37:51.917591 32213 heartbeater.cc:511] Master 127.24.175.254:38829 requested a full tablet report, sending...
I20260811 16:37:51.917940 31426 ts_manager.cc:194] Registered new tserver with Master: 1626663d17c243f394d33116d2109748 (127.24.175.195:37709)
I20260811 16:37:51.918351 31426 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.175.195@KRBTEST.COM'} at 127.24.175.195:52631
I20260811 16:37:51.926748 25279 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 16:37:51 dist-test-slave-zj8q krb5kdc[31345](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466271, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 16:37:51 dist-test-slave-zj8q krb5kdc[31345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466271, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.175.193@KRBTEST.COM
I20260811 16:37:51.949048 32224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:51.942127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41530 (local address 127.24.175.193:34463)
0811 16:37:51.942300 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:51.942305 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:51.942315 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:37:51.942341 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:51.942343 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:51.942357 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:51.942419 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:51.942937 (+ 518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:51.943682 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:51.944415 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:51.944737 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:51.944791 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:51.946736 (+ 1945us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:51.946744 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:51.946744 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:37:51.946750 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:51.948109 (+ 1359us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:51.948439 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:51.948442 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:51.948442 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:51.948493 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:51.948631 (+ 138us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:51.948632 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:51.948632 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:51.948749 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:51.948841 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:51.948899 (+ 58us) server_negotiation.cc:299] Negotiation successful
0811 16:37:51.948960 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":107,"threads_started":1}
Aug 11 16:37:51 dist-test-slave-zj8q krb5kdc[31345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466271, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:37:51.955868 31497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:51.950338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54812 (local address 127.24.175.254:38829)
0811 16:37:51.950383 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:51.950385 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:51.950394 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:37:51.950444 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:51.950445 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:51.950453 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:51.950493 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:51.950895 (+ 402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:51.951355 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:51.951928 (+ 573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:51.952092 (+ 164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:51.952131 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:51.953900 (+ 1769us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:51.953902 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:51.953903 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:37:51.953909 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:51.955084 (+ 1175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:51.955329 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:51.955329 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:51.955330 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:51.955372 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:51.955485 (+ 113us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:51.955485 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:51.955485 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:51.955606 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:51.955674 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:51.955736 (+ 62us) server_negotiation.cc:299] Negotiation successful
0811 16:37:51.955793 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
W20260811 16:37:51.956091 31426 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54812
I20260811 16:37:51.956393 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 31538
I20260811 16:37:51.969475 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 31764
I20260811 16:37:51.976069 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 31993
I20260811 16:37:51.993065 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 31368
2026-08-11T16:37:51Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (3529 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:37:52 dist-test-slave-zj8q krb5kdc[32231](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:37:52 dist-test-slave-zj8q krb5kdc[32231](info): set up 2 sockets
Aug 11 16:37:52 dist-test-slave-zj8q krb5kdc[32231](info): commencing operation
krb5kdc: starting...
W20260811 16:37:53.159705 25279 mini_kdc.cc:121] Time spent starting KDC: real 1.140s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Aug 11 16:37:53 dist-test-slave-zj8q krb5kdc[32231](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466273, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:37:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:37:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab.
Entry for principal kudu/127.24.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab.
I20260811 16:37:53.284538 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:39891
--webserver_interface=127.24.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:36531
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.175.254:39891
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:37:53.372825 32257 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:37:53.373020 32257 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:37:53.373050 32257 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:37:53.374202 32257 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:37:53.374248 32257 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:37:53.374266 32257 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:37:53.374282 32257 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:37:53.374305 32257 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:37:53.375836 32257 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:36531
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.175.254:39891
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:39891
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32257
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:37:53.376081 32257 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:37:53.376284 32257 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:37:53.380863 32270 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:53.380895 32265 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:53.380947 32268 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:37:53.381050 32257 server_base.cc:1034] running on GCE node
I20260811 16:37:53.381278 32257 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:37:53.381562 32257 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:37:53.382691 32257 hybrid_clock.cc:648] HybridClock initialized: now 1786466273382686 us; error 39 us; skew 500 ppm
Aug 11 16:37:53 dist-test-slave-zj8q krb5kdc[32231](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466273, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:37:53.385018 32257 init.cc:377] Logged in from keytab as kudu/127.24.175.254@KRBTEST.COM (short username kudu)
I20260811 16:37:53.385332 32257 fs_manager.cc:359] Metadata directory not provided
I20260811 16:37:53.385383 32257 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:37:53.385510 32257 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:37:53.386607 32257 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/master-0/data/instance:
uuid: "20af926b48424768bc7240fd951432a3"
format_stamp: "Formatted at 2026-08-11 16:37:53 on dist-test-slave-zj8q"
server_key: "9aaa0164dcc001e67a2ac016c7b597d1"
server_key_iv: "9a97bdd27b62062da85f8a77d736cdf4"
server_key_version: "encryptionkey@0"
I20260811 16:37:53.386938 32257 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/master-0/wal/instance:
uuid: "20af926b48424768bc7240fd951432a3"
format_stamp: "Formatted at 2026-08-11 16:37:53 on dist-test-slave-zj8q"
server_key: "9aaa0164dcc001e67a2ac016c7b597d1"
server_key_iv: "9a97bdd27b62062da85f8a77d736cdf4"
server_key_version: "encryptionkey@0"
I20260811 16:37:53.388089 32257 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:37:53.388752 32279 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:53.388899 32257 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:37:53.388990 32257 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/master-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/master-0/wal
uuid: "20af926b48424768bc7240fd951432a3"
format_stamp: "Formatted at 2026-08-11 16:37:53 on dist-test-slave-zj8q"
server_key: "9aaa0164dcc001e67a2ac016c7b597d1"
server_key_iv: "9a97bdd27b62062da85f8a77d736cdf4"
server_key_version: "encryptionkey@0"
I20260811 16:37:53.389048 32257 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:37:53.401582 32257 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:37:53.403179 32257 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:37:53.403309 32257 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:37:53.407111 32257 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.254:39891
I20260811 16:37:53.407135 32378 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.254:39891 every 8 connection(s)
I20260811 16:37:53.407390 32257 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
I20260811 16:37:53.408432 32380 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:37:53.409685 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 32257
I20260811 16:37:53.409781 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/master-0/wal/instance
I20260811 16:37:53.409937 25279 external_mini_cluster.cc:1428] Setting key b0802b4ef6ea2bcc5000ea3ced9fbdfb
I20260811 16:37:53.410965 32380 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 20af926b48424768bc7240fd951432a3: Bootstrap starting.
I20260811 16:37:53.411549 32380 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 20af926b48424768bc7240fd951432a3: Neither blocks nor log segments found. Creating new log.
I20260811 16:37:53.411836 32380 log.cc:824] T 00000000000000000000000000000000 P 20af926b48424768bc7240fd951432a3: Log is configured to *not* fsync() on all Append() calls
I20260811 16:37:53.412464 32380 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 20af926b48424768bc7240fd951432a3: No bootstrap required, opened a new log
I20260811 16:37:53.414115 32380 raft_consensus.cc:348] T 00000000000000000000000000000000 P 20af926b48424768bc7240fd951432a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20af926b48424768bc7240fd951432a3" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 39891 } }
I20260811 16:37:53.414295 32380 raft_consensus.cc:374] T 00000000000000000000000000000000 P 20af926b48424768bc7240fd951432a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:37:53.414343 32380 raft_consensus.cc:729] T 00000000000000000000000000000000 P 20af926b48424768bc7240fd951432a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20af926b48424768bc7240fd951432a3, State: Initialized, Role: FOLLOWER
I20260811 16:37:53.414466 32380 consensus_queue.cc:260] T 00000000000000000000000000000000 P 20af926b48424768bc7240fd951432a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20af926b48424768bc7240fd951432a3" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 39891 } }
I20260811 16:37:53.414551 32380 raft_consensus.cc:388] T 00000000000000000000000000000000 P 20af926b48424768bc7240fd951432a3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:37:53.414582 32380 raft_consensus.cc:482] T 00000000000000000000000000000000 P 20af926b48424768bc7240fd951432a3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:37:53.414629 32380 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 20af926b48424768bc7240fd951432a3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:37:53.415350 32380 raft_consensus.cc:504] T 00000000000000000000000000000000 P 20af926b48424768bc7240fd951432a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20af926b48424768bc7240fd951432a3" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 39891 } }
I20260811 16:37:53.415477 32380 leader_election.cc:302] T 00000000000000000000000000000000 P 20af926b48424768bc7240fd951432a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 20af926b48424768bc7240fd951432a3; no voters:
I20260811 16:37:53.415637 32380 leader_election.cc:288] T 00000000000000000000000000000000 P 20af926b48424768bc7240fd951432a3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:37:53.415678 32389 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 20af926b48424768bc7240fd951432a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:37:53.415815 32389 raft_consensus.cc:686] T 00000000000000000000000000000000 P 20af926b48424768bc7240fd951432a3 [term 1 LEADER]: Becoming Leader. State: Replica: 20af926b48424768bc7240fd951432a3, State: Running, Role: LEADER
I20260811 16:37:53.415891 32380 sys_catalog.cc:564] T 00000000000000000000000000000000 P 20af926b48424768bc7240fd951432a3 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:37:53.415918 32389 consensus_queue.cc:237] T 00000000000000000000000000000000 P 20af926b48424768bc7240fd951432a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20af926b48424768bc7240fd951432a3" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 39891 } }
Aug 11 16:37:53 dist-test-slave-zj8q krb5kdc[32231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466273, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:37:53.416245 32389 sys_catalog.cc:455] T 00000000000000000000000000000000 P 20af926b48424768bc7240fd951432a3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 20af926b48424768bc7240fd951432a3. Latest consensus state: current_term: 1 leader_uuid: "20af926b48424768bc7240fd951432a3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20af926b48424768bc7240fd951432a3" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 39891 } } }
I20260811 16:37:53.416260 32392 sys_catalog.cc:455] T 00000000000000000000000000000000 P 20af926b48424768bc7240fd951432a3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "20af926b48424768bc7240fd951432a3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20af926b48424768bc7240fd951432a3" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 39891 } } }
I20260811 16:37:53.416323 32389 sys_catalog.cc:458] T 00000000000000000000000000000000 P 20af926b48424768bc7240fd951432a3 [sys.catalog]: This master's current role is: LEADER
I20260811 16:37:53.416325 32392 sys_catalog.cc:458] T 00000000000000000000000000000000 P 20af926b48424768bc7240fd951432a3 [sys.catalog]: This master's current role is: LEADER
I20260811 16:37:53.416801 32397 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:37:53.417299 32397 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:37:53.418921 32397 catalog_manager.cc:1347] Generated new cluster ID: 6961b3927c814a8db0755b5e4748096e
I20260811 16:37:53.418969 32397 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:37:53.420739 32387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:53.410428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59110 (local address 127.24.175.254:39891)
0811 16:37:53.410606 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:53.410615 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:53.410638 (+ 23us) server_negotiation.cc:407] Connection header received
0811 16:37:53.411018 (+ 380us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:53.411023 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:53.411105 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:53.411237 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:53.411873 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:53.412842 (+ 969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:53.413571 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:53.413970 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:53.414081 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:53.416723 (+ 2642us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:53.416728 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:53.416728 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:37:53.416740 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:53.418806 (+ 2066us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:53.419193 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:53.419196 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:53.419197 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:53.419300 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:53.419499 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:53.419499 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:53.419500 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:53.419802 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:53.419947 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:53.420385 (+ 438us) server_negotiation.cc:299] Negotiation successful
0811 16:37:53.420521 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":85,"threads_started":1}
I20260811 16:37:53.430891 32397 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:37:53.431361 32397 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:37:53.435977 32397 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 20af926b48424768bc7240fd951432a3: Generated new TSK 0
I20260811 16:37:53.436134 32397 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.175.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab.
Entry for principal kudu/127.24.175.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab.
I20260811 16:37:53.462929 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.193:0
--local_ip_for_outbound_sockets=127.24.175.193
--webserver_interface=127.24.175.193
--webserver_port=0
--tserver_master_addrs=127.24.175.254:39891
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab
--principal=kudu/127.24.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:36531
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:37:53.543254 32424 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:37:53.543443 32424 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:37:53.543465 32424 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:37:53.544593 32424 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:37:53.544636 32424 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:37:53.544661 32424 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.193
I20260811 16:37:53.546202 32424 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:36531
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab
--principal=kudu/127.24.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.175.193
--webserver_port=0
--tserver_master_addrs=127.24.175.254:39891
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32424
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.193
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:37:53.546432 32424 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:37:53.546636 32424 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:37:53.551369 32432 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:53.551366 32439 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:53.551379 32431 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:37:53.551504 32424 server_base.cc:1034] running on GCE node
I20260811 16:37:53.551715 32424 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:37:53.551949 32424 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:37:53.553115 32424 hybrid_clock.cc:648] HybridClock initialized: now 1786466273553102 us; error 34 us; skew 500 ppm
Aug 11 16:37:53 dist-test-slave-zj8q krb5kdc[32231](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466273, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:37:53.555591 32424 init.cc:377] Logged in from keytab as kudu/127.24.175.193@KRBTEST.COM (short username kudu)
I20260811 16:37:53.555917 32424 fs_manager.cc:359] Metadata directory not provided
I20260811 16:37:53.555969 32424 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:37:53.556100 32424 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:37:53.557126 32424 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/ts-0/data/instance:
uuid: "3503744f5fb749348c5937fae3dc3f2a"
format_stamp: "Formatted at 2026-08-11 16:37:53 on dist-test-slave-zj8q"
server_key: "5a398434ec01544442f99d392016eea5"
server_key_iv: "7f593e86466fe0ce7106346ffaad1d97"
server_key_version: "encryptionkey@0"
I20260811 16:37:53.557453 32424 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/ts-0/wal/instance:
uuid: "3503744f5fb749348c5937fae3dc3f2a"
format_stamp: "Formatted at 2026-08-11 16:37:53 on dist-test-slave-zj8q"
server_key: "5a398434ec01544442f99d392016eea5"
server_key_iv: "7f593e86466fe0ce7106346ffaad1d97"
server_key_version: "encryptionkey@0"
I20260811 16:37:53.558703 32424 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:37:53.559387 32451 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:53.559533 32424 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:37:53.559618 32424 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/ts-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/ts-0/wal
uuid: "3503744f5fb749348c5937fae3dc3f2a"
format_stamp: "Formatted at 2026-08-11 16:37:53 on dist-test-slave-zj8q"
server_key: "5a398434ec01544442f99d392016eea5"
server_key_iv: "7f593e86466fe0ce7106346ffaad1d97"
server_key_version: "encryptionkey@0"
I20260811 16:37:53.559679 32424 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:37:53.566248 32424 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:37:53.568296 32424 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:37:53.568424 32424 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:37:53.568622 32424 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:37:53.568894 32424 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:37:53.568928 32424 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:53.568953 32424 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:37:53.568979 32424 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:53.574522 32424 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.193:33513
I20260811 16:37:53.574555 32662 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.193:33513 every 8 connection(s)
I20260811 16:37:53.574795 32424 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
I20260811 16:37:53.577198 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 32424
I20260811 16:37:53.577297 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/ts-0/wal/instance
I20260811 16:37:53.577472 25279 external_mini_cluster.cc:1428] Setting key 7013ae1ec62b7e6e68d3b7130a3cc48f
Aug 11 16:37:53 dist-test-slave-zj8q krb5kdc[32231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466273, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.193@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:37:53.584501 32387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:53.575471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:37807 (local address 127.24.175.254:39891)
0811 16:37:53.575515 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:53.575518 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:53.575713 (+ 195us) server_negotiation.cc:407] Connection header received
0811 16:37:53.576167 (+ 454us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:53.576168 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:53.576177 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:53.576229 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:53.577091 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:53.577702 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:53.579039 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:53.579247 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:53.579300 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:53.581792 (+ 2492us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:53.581795 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:53.581795 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:37:53.581805 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:53.583132 (+ 1327us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:53.583596 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:53.583597 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:53.583597 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:53.583653 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:53.583904 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:53.583905 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:53.583905 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:53.584001 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:53.584046 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:53.584366 (+ 320us) server_negotiation.cc:299] Negotiation successful
0811 16:37:53.584433 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 16:37:53.584800 32668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:53.575437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:39891 (local address 127.24.175.193:37807)
0811 16:37:53.575597 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:53.575637 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:53.576084 (+ 447us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:53.576281 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:53.576284 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:53.576523 (+ 239us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:37:53.577006 (+ 483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:53.577012 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:53.577798 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:53.577799 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:53.578962 (+ 1163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:53.578965 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:53.579323 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:53.579324 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:53.579457 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:53.579901 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:37:53.579912 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:37:53.581581 (+ 1669us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:37:53.583211 (+ 1630us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:53.583220 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:53.583222 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:53.583512 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:53.583706 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:53.583707 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:53.583707 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:53.583846 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:53.584054 (+ 208us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:37:53.584061 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:37:53.584235 (+ 174us) client_negotiation.cc:769] Sending connection context
0811 16:37:53.584357 (+ 122us) client_negotiation.cc:240] Negotiation successful
0811 16:37:53.584546 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":65,"threads_started":1}
I20260811 16:37:53.585280 32663 heartbeater.cc:347] Connected to a master server at 127.24.175.254:39891
I20260811 16:37:53.585374 32663 heartbeater.cc:464] Registering TS with master...
I20260811 16:37:53.585515 32663 heartbeater.cc:511] Master 127.24.175.254:39891 requested a full tablet report, sending...
I20260811 16:37:53.586053 32309 ts_manager.cc:194] Registered new tserver with Master: 3503744f5fb749348c5937fae3dc3f2a (127.24.175.193:33513)
I20260811 16:37:53.586689 32309 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.175.193@KRBTEST.COM'} at 127.24.175.193:37807
WARNING: no policy specified for kudu/127.24.175.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab.
Entry for principal kudu/127.24.175.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab.
I20260811 16:37:53.602949 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.194:0
--local_ip_for_outbound_sockets=127.24.175.194
--webserver_interface=127.24.175.194
--webserver_port=0
--tserver_master_addrs=127.24.175.254:39891
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab
--principal=kudu/127.24.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:36531
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:37:53.682859 32675 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:37:53.683043 32675 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:37:53.683072 32675 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:37:53.684145 32675 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:37:53.684178 32675 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:37:53.684202 32675 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.194
I20260811 16:37:53.685658 32675 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:36531
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab
--principal=kudu/127.24.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.175.194
--webserver_port=0
--tserver_master_addrs=127.24.175.254:39891
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32675
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.194
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:37:53.685830 32675 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:37:53.686007 32675 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:37:53.690824 32687 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:53.690809 32686 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:37:53.690924 32675 server_base.cc:1034] running on GCE node
W20260811 16:37:53.690809 32689 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:37:53.691205 32675 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:37:53.691409 32675 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:37:53.692551 32675 hybrid_clock.cc:648] HybridClock initialized: now 1786466273692541 us; error 28 us; skew 500 ppm
Aug 11 16:37:53 dist-test-slave-zj8q krb5kdc[32231](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466273, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:37:53.694980 32675 init.cc:377] Logged in from keytab as kudu/127.24.175.194@KRBTEST.COM (short username kudu)
I20260811 16:37:53.695322 32675 fs_manager.cc:359] Metadata directory not provided
I20260811 16:37:53.695371 32675 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:37:53.695492 32675 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:37:53.696483 32675 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/ts-1/data/instance:
uuid: "67ace49b76fd44e6a8c3470c4955df32"
format_stamp: "Formatted at 2026-08-11 16:37:53 on dist-test-slave-zj8q"
server_key: "555e202d90376141e5177a87f8e4464d"
server_key_iv: "1b82b78d8e104ea8e0e1b9add3950135"
server_key_version: "encryptionkey@0"
I20260811 16:37:53.696807 32675 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/ts-1/wal/instance:
uuid: "67ace49b76fd44e6a8c3470c4955df32"
format_stamp: "Formatted at 2026-08-11 16:37:53 on dist-test-slave-zj8q"
server_key: "555e202d90376141e5177a87f8e4464d"
server_key_iv: "1b82b78d8e104ea8e0e1b9add3950135"
server_key_version: "encryptionkey@0"
I20260811 16:37:53.697981 32675 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:37:53.698697 32696 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:53.698837 32675 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:53.698915 32675 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/ts-1/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/ts-1/wal
uuid: "67ace49b76fd44e6a8c3470c4955df32"
format_stamp: "Formatted at 2026-08-11 16:37:53 on dist-test-slave-zj8q"
server_key: "555e202d90376141e5177a87f8e4464d"
server_key_iv: "1b82b78d8e104ea8e0e1b9add3950135"
server_key_version: "encryptionkey@0"
I20260811 16:37:53.698979 32675 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:37:53.727861 32675 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:37:53.730333 32675 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:37:53.730460 32675 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:37:53.730671 32675 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:37:53.730991 32675 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:37:53.731029 32675 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:53.731060 32675 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:37:53.731083 32675 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:53.736557 32675 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.194:36553
I20260811 16:37:53.736608 432 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.194:36553 every 8 connection(s)
I20260811 16:37:53.736852 32675 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
I20260811 16:37:53.737673 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 32675
I20260811 16:37:53.737761 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/ts-1/wal/instance
I20260811 16:37:53.737959 25279 external_mini_cluster.cc:1428] Setting key 7f740a07ba1d4b6bcf3d50add2ce6c67
Aug 11 16:37:53 dist-test-slave-zj8q krb5kdc[32231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466273, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.194@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:37:53.745853 32387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:53.737544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:42395 (local address 127.24.175.254:39891)
0811 16:37:53.737602 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:53.737605 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:53.737879 (+ 274us) server_negotiation.cc:407] Connection header received
0811 16:37:53.738508 (+ 629us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:53.738509 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:53.738518 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:53.738559 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:53.739506 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:53.740170 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:53.741196 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:53.741400 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:53.741457 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:53.743406 (+ 1949us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:53.743408 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:53.743408 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:37:53.743416 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:53.744615 (+ 1199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:53.744969 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:53.744971 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:53.744971 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:53.745031 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:53.745241 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:53.745241 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:53.745242 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:53.745358 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:53.745414 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:53.745677 (+ 263us) server_negotiation.cc:299] Negotiation successful
0811 16:37:53.745766 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 16:37:53.745994 441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:53.737527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:39891 (local address 127.24.175.194:42395)
0811 16:37:53.737762 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:53.737805 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:53.738423 (+ 618us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:53.738645 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:53.738650 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:53.738930 (+ 280us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:37:53.739414 (+ 484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:53.739420 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:53.740295 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:53.740296 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:53.741114 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:53.741116 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:53.741470 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:53.741471 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:53.741585 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:53.742000 (+ 415us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:37:53.742009 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:37:53.743323 (+ 1314us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:37:53.744690 (+ 1367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:53.744696 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:53.744698 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:53.744905 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:53.745083 (+ 178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:53.745084 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:53.745084 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:53.745185 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:53.745411 (+ 226us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:37:53.745417 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:37:53.745559 (+ 142us) client_negotiation.cc:769] Sending connection context
0811 16:37:53.745644 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 16:37:53.745794 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":110,"threads_started":1}
WARNING: no policy specified for kudu/127.24.175.195@KRBTEST.COM; defaulting to no policy
I20260811 16:37:53.746539 436 heartbeater.cc:347] Connected to a master server at 127.24.175.254:39891
I20260811 16:37:53.746634 436 heartbeater.cc:464] Registering TS with master...
I20260811 16:37:53.746780 436 heartbeater.cc:511] Master 127.24.175.254:39891 requested a full tablet report, sending...
I20260811 16:37:53.747117 32309 ts_manager.cc:194] Registered new tserver with Master: 67ace49b76fd44e6a8c3470c4955df32 (127.24.175.194:36553)
I20260811 16:37:53.747467 32309 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.175.194@KRBTEST.COM'} at 127.24.175.194:42395
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab.
Entry for principal kudu/127.24.175.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab.
I20260811 16:37:53.761876 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.195:0
--local_ip_for_outbound_sockets=127.24.175.195
--webserver_interface=127.24.175.195
--webserver_port=0
--tserver_master_addrs=127.24.175.254:39891
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab
--principal=kudu/127.24.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:36531
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:37:53.842730 446 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:37:53.842921 446 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:37:53.842943 446 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:37:53.844028 446 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:37:53.844065 446 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:37:53.844098 446 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.195
I20260811 16:37:53.845558 446 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:36531
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab
--principal=kudu/127.24.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.175.195
--webserver_port=0
--tserver_master_addrs=127.24.175.254:39891
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.446
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.195
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:37:53.845744 446 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:37:53.845976 446 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:37:53.850831 455 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:53.850822 456 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:53.850819 459 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:37:53.850843 446 server_base.cc:1034] running on GCE node
I20260811 16:37:53.851219 446 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:37:53.851459 446 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:37:53.852604 446 hybrid_clock.cc:648] HybridClock initialized: now 1786466273852585 us; error 27 us; skew 500 ppm
Aug 11 16:37:53 dist-test-slave-zj8q krb5kdc[32231](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466273, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:37:53.854967 446 init.cc:377] Logged in from keytab as kudu/127.24.175.195@KRBTEST.COM (short username kudu)
I20260811 16:37:53.855314 446 fs_manager.cc:359] Metadata directory not provided
I20260811 16:37:53.855366 446 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:37:53.855490 446 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:37:53.856509 446 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/ts-2/data/instance:
uuid: "1b02549237b24c658bee164182be5737"
format_stamp: "Formatted at 2026-08-11 16:37:53 on dist-test-slave-zj8q"
server_key: "6b454fecffd5a03b62e6c9f81f53ef67"
server_key_iv: "c79633baca59a160c4557263200127a8"
server_key_version: "encryptionkey@0"
I20260811 16:37:53.856833 446 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/ts-2/wal/instance:
uuid: "1b02549237b24c658bee164182be5737"
format_stamp: "Formatted at 2026-08-11 16:37:53 on dist-test-slave-zj8q"
server_key: "6b454fecffd5a03b62e6c9f81f53ef67"
server_key_iv: "c79633baca59a160c4557263200127a8"
server_key_version: "encryptionkey@0"
I20260811 16:37:53.857987 446 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:37:53.858691 469 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:53.858829 446 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:53.858914 446 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/ts-2/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/ts-2/wal
uuid: "1b02549237b24c658bee164182be5737"
format_stamp: "Formatted at 2026-08-11 16:37:53 on dist-test-slave-zj8q"
server_key: "6b454fecffd5a03b62e6c9f81f53ef67"
server_key_iv: "c79633baca59a160c4557263200127a8"
server_key_version: "encryptionkey@0"
I20260811 16:37:53.858974 446 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:37:53.870713 446 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:37:53.872298 446 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:37:53.872424 446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:37:53.872609 446 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:37:53.872881 446 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:37:53.872913 446 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:53.872941 446 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:37:53.872967 446 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:53.878407 446 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.195:45143
I20260811 16:37:53.878455 671 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.195:45143 every 8 connection(s)
I20260811 16:37:53.878697 446 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
Aug 11 16:37:53 dist-test-slave-zj8q krb5kdc[32231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466273, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.195@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:37:53.886451 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 446
I20260811 16:37:53.886554 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/ts-2/wal/instance
I20260811 16:37:53.886736 25279 external_mini_cluster.cc:1428] Setting key 416f65c6d5ff8a1148cce3d23579c54d
I20260811 16:37:53.887107 32387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:53.879321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.195:57339 (local address 127.24.175.254:39891)
0811 16:37:53.879377 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:53.879380 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:53.879567 (+ 187us) server_negotiation.cc:407] Connection header received
0811 16:37:53.880024 (+ 457us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:53.880025 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:53.880035 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:53.880071 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:53.880885 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:53.881380 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:53.882392 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:53.882613 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:53.882668 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:53.884563 (+ 1895us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:53.884564 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:53.884565 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:37:53.884571 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:53.885777 (+ 1206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:53.886163 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:53.886164 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:53.886165 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:53.886224 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:53.886460 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:53.886461 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:53.886462 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:53.886590 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:53.886651 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:53.886941 (+ 290us) server_negotiation.cc:299] Negotiation successful
0811 16:37:53.887021 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 16:37:53.887246 674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:53.879299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:39891 (local address 127.24.175.195:57339)
0811 16:37:53.879454 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:53.879493 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:53.879936 (+ 443us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:53.880128 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:53.880131 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:53.880371 (+ 240us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:37:53.880821 (+ 450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:53.880826 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:53.881440 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:53.881440 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:53.882315 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:53.882318 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:53.882673 (+ 355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:53.882673 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:53.882770 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:53.883188 (+ 418us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:37:53.883196 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:37:53.884476 (+ 1280us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:37:53.885846 (+ 1370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:53.885852 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:53.885853 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:53.886086 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:53.886285 (+ 199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:53.886286 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:53.886286 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:53.886389 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:53.886679 (+ 290us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:37:53.886684 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:37:53.886806 (+ 122us) client_negotiation.cc:769] Sending connection context
0811 16:37:53.886909 (+ 103us) client_negotiation.cc:240] Negotiation successful
0811 16:37:53.887052 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":71,"threads_started":1}
I20260811 16:37:53.887657 672 heartbeater.cc:347] Connected to a master server at 127.24.175.254:39891
I20260811 16:37:53.887748 672 heartbeater.cc:464] Registering TS with master...
I20260811 16:37:53.887898 672 heartbeater.cc:511] Master 127.24.175.254:39891 requested a full tablet report, sending...
I20260811 16:37:53.888250 32309 ts_manager.cc:194] Registered new tserver with Master: 1b02549237b24c658bee164182be5737 (127.24.175.195:45143)
I20260811 16:37:53.888597 32309 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.175.195@KRBTEST.COM'} at 127.24.175.195:57339
I20260811 16:37:53.898571 25279 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 16:37:53.905042 32387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:53.899795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59118 (local address 127.24.175.254:39891)
0811 16:37:53.899843 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:53.899845 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:53.899934 (+ 89us) server_negotiation.cc:407] Connection header received
0811 16:37:53.899977 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:53.899978 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:53.899985 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:53.900030 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:53.900546 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:53.901057 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:53.901780 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:53.901957 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:53.902008 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:53.903057 (+ 1049us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:53.903058 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:53.903059 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:37:53.903065 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:53.904040 (+ 975us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:53.904343 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:53.904344 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:53.904344 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:53.904395 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:53.904553 (+ 158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:53.904554 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:53.904554 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:53.904692 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:53.904781 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:53.904883 (+ 102us) server_negotiation.cc:299] Negotiation successful
0811 16:37:53.904961 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 16:37:53.906358 32309 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59118:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:37:53.907851 32309 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:37:53.913715 693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:53.910187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46066 (local address 127.24.175.195:45143)
0811 16:37:53.910377 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:53.910380 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:53.910388 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:37:53.910422 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:53.910425 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:53.910439 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:53.910539 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:37:53.910681 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:53.911376 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:53.912749 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:53.913360 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:53.913419 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:53.913483 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:53.913601 (+ 118us) server_negotiation.cc:299] Negotiation successful
0811 16:37:53.913637 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":107,"threads_started":1}
I20260811 16:37:53.913704 690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:53.910082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.195:45143 (local address 127.0.0.1:46066)
0811 16:37:53.910284 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:53.910294 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:53.910342 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:53.910534 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:53.910536 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:53.910538 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:37:53.910584 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:53.910585 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:53.911466 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:53.911467 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:53.912670 (+ 1203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:53.912672 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:53.913430 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:53.913430 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:53.913507 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:53.913520 (+ 13us) client_negotiation.cc:769] Sending connection context
0811 16:37:53.913582 (+ 62us) client_negotiation.cc:240] Negotiation successful
0811 16:37:53.913636 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":89,"threads_started":1}
I20260811 16:37:53.913966 686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:53.909739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.193:33513 (local address 127.0.0.1:34132)
0811 16:37:53.909881 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:53.909920 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:53.909984 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:53.910429 (+ 445us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:53.910433 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:53.910435 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:37:53.910499 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:53.910500 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:53.911789 (+ 1289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:53.911790 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:53.912826 (+ 1036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:53.912828 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:53.913638 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:53.913639 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:53.913703 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:53.913707 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:37:53.913736 (+ 29us) client_negotiation.cc:240] Negotiation successful
0811 16:37:53.913895 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":72,"threads_started":1}
I20260811 16:37:53.914093 692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:53.909936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.194:36553 (local address 127.0.0.1:57750)
0811 16:37:53.910204 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:53.910213 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:53.910261 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:53.910888 (+ 627us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:53.910889 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:53.910891 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:37:53.910933 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:53.910935 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:53.912044 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:53.912045 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:53.913032 (+ 987us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:53.913034 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:53.913879 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:53.913880 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:53.913940 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:53.913944 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:37:53.913995 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 16:37:53.914033 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":60,"threads_started":1}
I20260811 16:37:53.914120 691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:53.910060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57750 (local address 127.24.175.194:36553)
0811 16:37:53.910671 (+ 611us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:53.910675 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:53.910684 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:37:53.910717 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:53.910719 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:53.910733 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:53.910804 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:37:53.911003 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:53.911959 (+ 956us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:53.913113 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:53.913802 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:53.913871 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:53.913917 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:53.914006 (+ 89us) server_negotiation.cc:299] Negotiation successful
0811 16:37:53.914049 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":575,"thread_start_us":77,"threads_started":1}
I20260811 16:37:53.914465 689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:53.909863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34132 (local address 127.24.175.193:33513)
0811 16:37:53.910263 (+ 400us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:53.910268 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:53.910279 (+ 11us) server_negotiation.cc:407] Connection header received
0811 16:37:53.910322 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:53.910324 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:53.910340 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:53.910417 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:37:53.910586 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:53.911683 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:53.912894 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:53.913538 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:53.914258 (+ 720us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:53.914323 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:53.914347 (+ 24us) server_negotiation.cc:299] Negotiation successful
0811 16:37:53.914387 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":360,"thread_start_us":86,"threads_started":1}
I20260811 16:37:53.914603 559 tablet_service.cc:1467] Processing CreateTablet for tablet 0c9d8a5f1a584e139979507bf254718c (DEFAULT_TABLE table=test-table [id=c34e846011504307abe5b2c1f6f42379]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:37:53.914963 559 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0c9d8a5f1a584e139979507bf254718c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:37:53.914945 312 tablet_service.cc:1467] Processing CreateTablet for tablet 0c9d8a5f1a584e139979507bf254718c (DEFAULT_TABLE table=test-table [id=c34e846011504307abe5b2c1f6f42379]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:37:53.915258 312 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0c9d8a5f1a584e139979507bf254718c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:37:53.918246 694 tablet_bootstrap.cc:492] T 0c9d8a5f1a584e139979507bf254718c P 1b02549237b24c658bee164182be5737: Bootstrap starting.
I20260811 16:37:53.918720 695 tablet_bootstrap.cc:492] T 0c9d8a5f1a584e139979507bf254718c P 67ace49b76fd44e6a8c3470c4955df32: Bootstrap starting.
I20260811 16:37:53.918797 32542 tablet_service.cc:1467] Processing CreateTablet for tablet 0c9d8a5f1a584e139979507bf254718c (DEFAULT_TABLE table=test-table [id=c34e846011504307abe5b2c1f6f42379]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:37:53.918946 694 tablet_bootstrap.cc:654] T 0c9d8a5f1a584e139979507bf254718c P 1b02549237b24c658bee164182be5737: Neither blocks nor log segments found. Creating new log.
I20260811 16:37:53.919126 32542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0c9d8a5f1a584e139979507bf254718c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:37:53.919365 695 tablet_bootstrap.cc:654] T 0c9d8a5f1a584e139979507bf254718c P 67ace49b76fd44e6a8c3470c4955df32: Neither blocks nor log segments found. Creating new log.
I20260811 16:37:53.919574 694 log.cc:824] T 0c9d8a5f1a584e139979507bf254718c P 1b02549237b24c658bee164182be5737: Log is configured to *not* fsync() on all Append() calls
I20260811 16:37:53.919939 695 log.cc:824] T 0c9d8a5f1a584e139979507bf254718c P 67ace49b76fd44e6a8c3470c4955df32: Log is configured to *not* fsync() on all Append() calls
I20260811 16:37:53.920362 694 tablet_bootstrap.cc:492] T 0c9d8a5f1a584e139979507bf254718c P 1b02549237b24c658bee164182be5737: No bootstrap required, opened a new log
I20260811 16:37:53.920495 694 ts_tablet_manager.cc:1397] T 0c9d8a5f1a584e139979507bf254718c P 1b02549237b24c658bee164182be5737: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:37:53.920689 695 tablet_bootstrap.cc:492] T 0c9d8a5f1a584e139979507bf254718c P 67ace49b76fd44e6a8c3470c4955df32: No bootstrap required, opened a new log
I20260811 16:37:53.920760 695 ts_tablet_manager.cc:1397] T 0c9d8a5f1a584e139979507bf254718c P 67ace49b76fd44e6a8c3470c4955df32: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:37:53.922210 704 tablet_bootstrap.cc:492] T 0c9d8a5f1a584e139979507bf254718c P 3503744f5fb749348c5937fae3dc3f2a: Bootstrap starting.
I20260811 16:37:53.922114 694 raft_consensus.cc:348] T 0c9d8a5f1a584e139979507bf254718c P 1b02549237b24c658bee164182be5737 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3503744f5fb749348c5937fae3dc3f2a" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 33513 } } peers { permanent_uuid: "67ace49b76fd44e6a8c3470c4955df32" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 36553 } } peers { permanent_uuid: "1b02549237b24c658bee164182be5737" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 45143 } }
I20260811 16:37:53.922304 694 raft_consensus.cc:374] T 0c9d8a5f1a584e139979507bf254718c P 1b02549237b24c658bee164182be5737 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:37:53.922349 694 raft_consensus.cc:729] T 0c9d8a5f1a584e139979507bf254718c P 1b02549237b24c658bee164182be5737 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b02549237b24c658bee164182be5737, State: Initialized, Role: FOLLOWER
I20260811 16:37:53.922469 694 consensus_queue.cc:260] T 0c9d8a5f1a584e139979507bf254718c P 1b02549237b24c658bee164182be5737 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3503744f5fb749348c5937fae3dc3f2a" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 33513 } } peers { permanent_uuid: "67ace49b76fd44e6a8c3470c4955df32" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 36553 } } peers { permanent_uuid: "1b02549237b24c658bee164182be5737" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 45143 } }
I20260811 16:37:53.922664 695 raft_consensus.cc:348] T 0c9d8a5f1a584e139979507bf254718c P 67ace49b76fd44e6a8c3470c4955df32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3503744f5fb749348c5937fae3dc3f2a" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 33513 } } peers { permanent_uuid: "67ace49b76fd44e6a8c3470c4955df32" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 36553 } } peers { permanent_uuid: "1b02549237b24c658bee164182be5737" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 45143 } }
I20260811 16:37:53.922768 694 ts_tablet_manager.cc:1428] T 0c9d8a5f1a584e139979507bf254718c P 1b02549237b24c658bee164182be5737: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:37:53.922792 695 raft_consensus.cc:374] T 0c9d8a5f1a584e139979507bf254718c P 67ace49b76fd44e6a8c3470c4955df32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:37:53.922818 695 raft_consensus.cc:729] T 0c9d8a5f1a584e139979507bf254718c P 67ace49b76fd44e6a8c3470c4955df32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67ace49b76fd44e6a8c3470c4955df32, State: Initialized, Role: FOLLOWER
I20260811 16:37:53.922883 672 heartbeater.cc:503] Master 127.24.175.254:39891 was elected leader, sending a full tablet report...
I20260811 16:37:53.922919 695 consensus_queue.cc:260] T 0c9d8a5f1a584e139979507bf254718c P 67ace49b76fd44e6a8c3470c4955df32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3503744f5fb749348c5937fae3dc3f2a" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 33513 } } peers { permanent_uuid: "67ace49b76fd44e6a8c3470c4955df32" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 36553 } } peers { permanent_uuid: "1b02549237b24c658bee164182be5737" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 45143 } }
I20260811 16:37:53.923144 695 ts_tablet_manager.cc:1428] T 0c9d8a5f1a584e139979507bf254718c P 67ace49b76fd44e6a8c3470c4955df32: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 16:37:53.923209 436 heartbeater.cc:503] Master 127.24.175.254:39891 was elected leader, sending a full tablet report...
I20260811 16:37:53.923362 704 tablet_bootstrap.cc:654] T 0c9d8a5f1a584e139979507bf254718c P 3503744f5fb749348c5937fae3dc3f2a: Neither blocks nor log segments found. Creating new log.
I20260811 16:37:53.923940 704 log.cc:824] T 0c9d8a5f1a584e139979507bf254718c P 3503744f5fb749348c5937fae3dc3f2a: Log is configured to *not* fsync() on all Append() calls
I20260811 16:37:53.924558 704 tablet_bootstrap.cc:492] T 0c9d8a5f1a584e139979507bf254718c P 3503744f5fb749348c5937fae3dc3f2a: No bootstrap required, opened a new log
I20260811 16:37:53.924616 704 ts_tablet_manager.cc:1397] T 0c9d8a5f1a584e139979507bf254718c P 3503744f5fb749348c5937fae3dc3f2a: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260811 16:37:53.926000 704 raft_consensus.cc:348] T 0c9d8a5f1a584e139979507bf254718c P 3503744f5fb749348c5937fae3dc3f2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3503744f5fb749348c5937fae3dc3f2a" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 33513 } } peers { permanent_uuid: "67ace49b76fd44e6a8c3470c4955df32" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 36553 } } peers { permanent_uuid: "1b02549237b24c658bee164182be5737" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 45143 } }
I20260811 16:37:53.926119 704 raft_consensus.cc:374] T 0c9d8a5f1a584e139979507bf254718c P 3503744f5fb749348c5937fae3dc3f2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:37:53.926187 704 raft_consensus.cc:729] T 0c9d8a5f1a584e139979507bf254718c P 3503744f5fb749348c5937fae3dc3f2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3503744f5fb749348c5937fae3dc3f2a, State: Initialized, Role: FOLLOWER
I20260811 16:37:53.926299 704 consensus_queue.cc:260] T 0c9d8a5f1a584e139979507bf254718c P 3503744f5fb749348c5937fae3dc3f2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3503744f5fb749348c5937fae3dc3f2a" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 33513 } } peers { permanent_uuid: "67ace49b76fd44e6a8c3470c4955df32" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 36553 } } peers { permanent_uuid: "1b02549237b24c658bee164182be5737" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 45143 } }
I20260811 16:37:53.926522 704 ts_tablet_manager.cc:1428] T 0c9d8a5f1a584e139979507bf254718c P 3503744f5fb749348c5937fae3dc3f2a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:37:53.926560 32663 heartbeater.cc:503] Master 127.24.175.254:39891 was elected leader, sending a full tablet report...
W20260811 16:37:53.987339 438 tablet.cc:2369] T 0c9d8a5f1a584e139979507bf254718c P 67ace49b76fd44e6a8c3470c4955df32: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:37:54.025492 706 raft_consensus.cc:482] T 0c9d8a5f1a584e139979507bf254718c P 1b02549237b24c658bee164182be5737 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:37:54.025631 706 raft_consensus.cc:504] T 0c9d8a5f1a584e139979507bf254718c P 1b02549237b24c658bee164182be5737 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3503744f5fb749348c5937fae3dc3f2a" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 33513 } } peers { permanent_uuid: "67ace49b76fd44e6a8c3470c4955df32" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 36553 } } peers { permanent_uuid: "1b02549237b24c658bee164182be5737" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 45143 } }
I20260811 16:37:54.025976 706 leader_election.cc:288] T 0c9d8a5f1a584e139979507bf254718c P 1b02549237b24c658bee164182be5737 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3503744f5fb749348c5937fae3dc3f2a (127.24.175.193:33513), 67ace49b76fd44e6a8c3470c4955df32 (127.24.175.194:36553)
I20260811 16:37:54.028820 689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:54.026278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.195:40071 (local address 127.24.175.193:33513)
0811 16:37:54.026335 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:54.026337 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:54.026344 (+ 7us) server_negotiation.cc:407] Connection header received
0811 16:37:54.026369 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:54.026370 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:54.026379 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:54.026426 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:37:54.026615 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:54.027157 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:54.028087 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:54.028485 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:54.028539 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:54.028547 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:54.028706 (+ 159us) server_negotiation.cc:299] Negotiation successful
0811 16:37:54.028748 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 16:37:54.028856 691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:54.026361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.195:51459 (local address 127.24.175.194:36553)
0811 16:37:54.026415 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:54.026417 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:54.026537 (+ 120us) server_negotiation.cc:407] Connection header received
0811 16:37:54.026568 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:54.026569 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:54.026577 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:54.026631 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:37:54.026768 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:54.027246 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:54.028137 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:54.028544 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:54.028614 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:54.028623 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:54.028760 (+ 137us) server_negotiation.cc:299] Negotiation successful
0811 16:37:54.028798 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 16:37:54.028842 674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:54.026141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.193:33513 (local address 127.24.175.195:40071)
0811 16:37:54.026217 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:54.026232 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:54.026299 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:54.026477 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:54.026478 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:54.026480 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:37:54.026548 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:54.026550 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:54.027236 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:54.027237 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:54.028004 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:54.028006 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:54.028556 (+ 550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:54.028556 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:54.028641 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:54.028645 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:37:54.028694 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 16:37:54.028729 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260811 16:37:54.028860 714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:54.026289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.194:36553 (local address 127.24.175.195:51459)
0811 16:37:54.026464 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:54.026474 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:54.026531 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:54.026642 (+ 111us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:54.026643 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:54.026645 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:37:54.026716 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:54.026717 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:54.027321 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:54.027322 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:54.028055 (+ 733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:54.028057 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:54.028619 (+ 562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:54.028620 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:54.028684 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:54.028688 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:37:54.028741 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 16:37:54.028776 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":118,"threads_started":1}
I20260811 16:37:54.029244 349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c9d8a5f1a584e139979507bf254718c" candidate_uuid: "1b02549237b24c658bee164182be5737" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67ace49b76fd44e6a8c3470c4955df32" is_pre_election: true
I20260811 16:37:54.029265 32574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c9d8a5f1a584e139979507bf254718c" candidate_uuid: "1b02549237b24c658bee164182be5737" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3503744f5fb749348c5937fae3dc3f2a" is_pre_election: true
I20260811 16:37:54.029409 32574 raft_consensus.cc:2454] T 0c9d8a5f1a584e139979507bf254718c P 3503744f5fb749348c5937fae3dc3f2a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b02549237b24c658bee164182be5737 in term 0.
I20260811 16:37:54.029410 349 raft_consensus.cc:2454] T 0c9d8a5f1a584e139979507bf254718c P 67ace49b76fd44e6a8c3470c4955df32 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b02549237b24c658bee164182be5737 in term 0.
I20260811 16:37:54.029613 475 leader_election.cc:302] T 0c9d8a5f1a584e139979507bf254718c P 1b02549237b24c658bee164182be5737 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b02549237b24c658bee164182be5737, 67ace49b76fd44e6a8c3470c4955df32; no voters:
I20260811 16:37:54.029753 706 raft_consensus.cc:2781] T 0c9d8a5f1a584e139979507bf254718c P 1b02549237b24c658bee164182be5737 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:37:54.029809 706 raft_consensus.cc:482] T 0c9d8a5f1a584e139979507bf254718c P 1b02549237b24c658bee164182be5737 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:37:54.029832 706 raft_consensus.cc:3037] T 0c9d8a5f1a584e139979507bf254718c P 1b02549237b24c658bee164182be5737 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:37:54.030567 706 raft_consensus.cc:504] T 0c9d8a5f1a584e139979507bf254718c P 1b02549237b24c658bee164182be5737 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3503744f5fb749348c5937fae3dc3f2a" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 33513 } } peers { permanent_uuid: "67ace49b76fd44e6a8c3470c4955df32" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 36553 } } peers { permanent_uuid: "1b02549237b24c658bee164182be5737" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 45143 } }
I20260811 16:37:54.030682 706 leader_election.cc:288] T 0c9d8a5f1a584e139979507bf254718c P 1b02549237b24c658bee164182be5737 [CANDIDATE]: Term 1 election: Requested vote from peers 3503744f5fb749348c5937fae3dc3f2a (127.24.175.193:33513), 67ace49b76fd44e6a8c3470c4955df32 (127.24.175.194:36553)
I20260811 16:37:54.030831 32574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c9d8a5f1a584e139979507bf254718c" candidate_uuid: "1b02549237b24c658bee164182be5737" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3503744f5fb749348c5937fae3dc3f2a"
I20260811 16:37:54.030862 349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c9d8a5f1a584e139979507bf254718c" candidate_uuid: "1b02549237b24c658bee164182be5737" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67ace49b76fd44e6a8c3470c4955df32"
I20260811 16:37:54.030905 32574 raft_consensus.cc:3037] T 0c9d8a5f1a584e139979507bf254718c P 3503744f5fb749348c5937fae3dc3f2a [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:37:54.030931 349 raft_consensus.cc:3037] T 0c9d8a5f1a584e139979507bf254718c P 67ace49b76fd44e6a8c3470c4955df32 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:37:54.031594 32574 raft_consensus.cc:2454] T 0c9d8a5f1a584e139979507bf254718c P 3503744f5fb749348c5937fae3dc3f2a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b02549237b24c658bee164182be5737 in term 1.
I20260811 16:37:54.031635 349 raft_consensus.cc:2454] T 0c9d8a5f1a584e139979507bf254718c P 67ace49b76fd44e6a8c3470c4955df32 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b02549237b24c658bee164182be5737 in term 1.
I20260811 16:37:54.031747 475 leader_election.cc:302] T 0c9d8a5f1a584e139979507bf254718c P 1b02549237b24c658bee164182be5737 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b02549237b24c658bee164182be5737, 3503744f5fb749348c5937fae3dc3f2a; no voters:
I20260811 16:37:54.031841 706 raft_consensus.cc:2781] T 0c9d8a5f1a584e139979507bf254718c P 1b02549237b24c658bee164182be5737 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:37:54.031988 706 raft_consensus.cc:686] T 0c9d8a5f1a584e139979507bf254718c P 1b02549237b24c658bee164182be5737 [term 1 LEADER]: Becoming Leader. State: Replica: 1b02549237b24c658bee164182be5737, State: Running, Role: LEADER
I20260811 16:37:54.032069 706 consensus_queue.cc:237] T 0c9d8a5f1a584e139979507bf254718c P 1b02549237b24c658bee164182be5737 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3503744f5fb749348c5937fae3dc3f2a" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 33513 } } peers { permanent_uuid: "67ace49b76fd44e6a8c3470c4955df32" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 36553 } } peers { permanent_uuid: "1b02549237b24c658bee164182be5737" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 45143 } }
I20260811 16:37:54.032905 32309 catalog_manager.cc:5495] T 0c9d8a5f1a584e139979507bf254718c P 1b02549237b24c658bee164182be5737 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1b02549237b24c658bee164182be5737 (127.24.175.195). New cstate: current_term: 1 leader_uuid: "1b02549237b24c658bee164182be5737" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3503744f5fb749348c5937fae3dc3f2a" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 33513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67ace49b76fd44e6a8c3470c4955df32" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 36553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b02549237b24c658bee164182be5737" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 45143 } health_report { overall_health: HEALTHY } } }
I20260811 16:37:54.055886 693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:54.053601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46078 (local address 127.24.175.195:45143)
0811 16:37:54.053664 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:54.053666 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:54.053674 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:37:54.053709 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:54.053710 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:54.053728 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:54.053787 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:37:54.053913 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:54.054423 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:54.055184 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:54.055368 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:54.055419 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:54.055564 (+ 145us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:37:54.055666 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:37:54.055735 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:54.055773 (+ 38us) server_negotiation.cc:299] Negotiation successful
0811 16:37:54.055794 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 16:37:54.057643 349 raft_consensus.cc:1261] T 0c9d8a5f1a584e139979507bf254718c P 67ace49b76fd44e6a8c3470c4955df32 [term 1 FOLLOWER]: Refusing update from remote peer 1b02549237b24c658bee164182be5737: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:37:54.057660 32574 raft_consensus.cc:1261] T 0c9d8a5f1a584e139979507bf254718c P 3503744f5fb749348c5937fae3dc3f2a [term 1 FOLLOWER]: Refusing update from remote peer 1b02549237b24c658bee164182be5737: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:37:54.058017 715 consensus_queue.cc:1035] T 0c9d8a5f1a584e139979507bf254718c P 1b02549237b24c658bee164182be5737 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67ace49b76fd44e6a8c3470c4955df32" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 36553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:37:54.058136 706 consensus_queue.cc:1035] T 0c9d8a5f1a584e139979507bf254718c P 1b02549237b24c658bee164182be5737 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3503744f5fb749348c5937fae3dc3f2a" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 33513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:37:54.060832 720 mvcc.cc:205] Tried to move back new op lower bound from 7317365858537431040 to 7317365858436067328. Current Snapshot: MvccSnapshot[applied={T|T < 7317365858537431040}]
I20260811 16:37:54.061076 723 mvcc.cc:205] Tried to move back new op lower bound from 7317365858537431040 to 7317365858436067328. Current Snapshot: MvccSnapshot[applied={T|T < 7317365858537431040}]
I20260811 16:37:54.063174 32308 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59118:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:37:54.063279 32308 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59118:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:37:54.063939 32308 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 20af926b48424768bc7240fd951432a3: Sending DeleteTablet for 3 replicas of tablet 0c9d8a5f1a584e139979507bf254718c
I20260811 16:37:54.064262 32542 tablet_service.cc:1514] Processing DeleteTablet for tablet 0c9d8a5f1a584e139979507bf254718c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:37:54 UTC) from {username='kudu', principal='kudu/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:34132
I20260811 16:37:54.064275 312 tablet_service.cc:1514] Processing DeleteTablet for tablet 0c9d8a5f1a584e139979507bf254718c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:37:54 UTC) from {username='kudu', principal='kudu/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:57750
I20260811 16:37:54.064352 559 tablet_service.cc:1514] Processing DeleteTablet for tablet 0c9d8a5f1a584e139979507bf254718c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:37:54 UTC) from {username='kudu', principal='kudu/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:46066
I20260811 16:37:54.064585 741 tablet_replica.cc:330] T 0c9d8a5f1a584e139979507bf254718c P 3503744f5fb749348c5937fae3dc3f2a: stopping tablet replica
I20260811 16:37:54.064612 743 tablet_replica.cc:330] T 0c9d8a5f1a584e139979507bf254718c P 1b02549237b24c658bee164182be5737: stopping tablet replica
I20260811 16:37:54.064702 743 raft_consensus.cc:2229] T 0c9d8a5f1a584e139979507bf254718c P 1b02549237b24c658bee164182be5737 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:37:54.064699 741 raft_consensus.cc:2229] T 0c9d8a5f1a584e139979507bf254718c P 3503744f5fb749348c5937fae3dc3f2a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:37:54.064777 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 32424
I20260811 16:37:54.064800 741 raft_consensus.cc:2258] T 0c9d8a5f1a584e139979507bf254718c P 3503744f5fb749348c5937fae3dc3f2a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:37:54.064814 743 raft_consensus.cc:2258] T 0c9d8a5f1a584e139979507bf254718c P 1b02549237b24c658bee164182be5737 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:37:54.067941 743 ts_tablet_manager.cc:1905] T 0c9d8a5f1a584e139979507bf254718c P 1b02549237b24c658bee164182be5737: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:37:54.069599 743 ts_tablet_manager.cc:1918] T 0c9d8a5f1a584e139979507bf254718c P 1b02549237b24c658bee164182be5737: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:37:54.069664 743 log.cc:1196] T 0c9d8a5f1a584e139979507bf254718c P 1b02549237b24c658bee164182be5737: Deleting WAL directory at /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/ts-2/wal/wals/0c9d8a5f1a584e139979507bf254718c
I20260811 16:37:54.069914 743 ts_tablet_manager.cc:1939] T 0c9d8a5f1a584e139979507bf254718c P 1b02549237b24c658bee164182be5737: Deleting consensus metadata
I20260811 16:37:54.070334 32282 catalog_manager.cc:4841] TS 1b02549237b24c658bee164182be5737 (127.24.175.195:45143): tablet 0c9d8a5f1a584e139979507bf254718c (table test-table [id=c34e846011504307abe5b2c1f6f42379]) successfully deleted
I20260811 16:37:54.071012 739 tablet_replica.cc:330] T 0c9d8a5f1a584e139979507bf254718c P 67ace49b76fd44e6a8c3470c4955df32: stopping tablet replica
I20260811 16:37:54.071134 739 raft_consensus.cc:2229] T 0c9d8a5f1a584e139979507bf254718c P 67ace49b76fd44e6a8c3470c4955df32 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:37:54.071264 739 raft_consensus.cc:2258] T 0c9d8a5f1a584e139979507bf254718c P 67ace49b76fd44e6a8c3470c4955df32 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:37:54.072342 739 ts_tablet_manager.cc:1905] T 0c9d8a5f1a584e139979507bf254718c P 67ace49b76fd44e6a8c3470c4955df32: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:37:54.074221 739 ts_tablet_manager.cc:1918] T 0c9d8a5f1a584e139979507bf254718c P 67ace49b76fd44e6a8c3470c4955df32: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:37:54.074295 739 log.cc:1196] T 0c9d8a5f1a584e139979507bf254718c P 67ace49b76fd44e6a8c3470c4955df32: Deleting WAL directory at /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466249441839-25279-0/minicluster-data/ts-1/wal/wals/0c9d8a5f1a584e139979507bf254718c
I20260811 16:37:54.074617 739 ts_tablet_manager.cc:1939] T 0c9d8a5f1a584e139979507bf254718c P 67ace49b76fd44e6a8c3470c4955df32: Deleting consensus metadata
I20260811 16:37:54.075114 32282 catalog_manager.cc:4841] TS 67ace49b76fd44e6a8c3470c4955df32 (127.24.175.194:36553): tablet 0c9d8a5f1a584e139979507bf254718c (table test-table [id=c34e846011504307abe5b2c1f6f42379]) successfully deleted
W20260811 16:37:54.086299 32282 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.24.175.193:33513 (error 108)
I20260811 16:37:54.086830 692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:54.086695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.193:33513 (local address 127.0.0.1:34138)
0811 16:37:54.086751 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:54.086794 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.193:33513: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260811 16:37:54.086875 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 32675
W20260811 16:37:54.091235 32282 catalog_manager.cc:4584] TS 3503744f5fb749348c5937fae3dc3f2a (127.24.175.193:33513): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0c9d8a5f1a584e139979507bf254718c: Network error: Client connection negotiation failed: client connection to 127.24.175.193:33513: connect: Connection refused (error 111)
I20260811 16:37:54.094414 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 446
I20260811 16:37:54.105764 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 32257
2026-08-11T16:37:54Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2110 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-11T16:37:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:37:54Z Disabled control of system clock
I20260811 16:37:54.137253 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466249441839-25279-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466249441839-25279-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466249441839-25279-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:32783
--webserver_interface=127.24.175.254
--webserver_port=0
--builtin_ntp_servers=127.24.175.212:46323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.175.254:32783
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 16:37:54.216694 752 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:37:54.216889 752 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:37:54.216910 752 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:37:54.218025 752 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:37:54.218065 752 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:37:54.218077 752 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:37:54.218099 752 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:37:54.218115 752 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:37:54.219486 752 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:46323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466249441839-25279-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466249441839-25279-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.175.254:32783
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:32783
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.752
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466249441839-25279-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:37:54.219718 752 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:37:54.219995 752 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:37:54.224664 761 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:54.224663 760 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:37:54.224680 752 server_base.cc:1034] running on GCE node
W20260811 16:37:54.224722 763 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:37:54.225096 752 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:37:54.225381 752 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:37:54.226519 752 hybrid_clock.cc:648] HybridClock initialized: now 1786466274226499 us; error 34 us; skew 500 ppm
I20260811 16:37:54.227836 752 webserver.cc:460] Webserver started at http://127.24.175.254:39143/ using document root <none> and password file <none>
I20260811 16:37:54.228066 752 fs_manager.cc:359] Metadata directory not provided
I20260811 16:37:54.228114 752 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:37:54.228247 752 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:37:54.229251 752 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466249441839-25279-0/minicluster-data/master-0/data/instance:
uuid: "9c8ef5dab55b438f8d491c18da9784bd"
format_stamp: "Formatted at 2026-08-11 16:37:54 on dist-test-slave-zj8q"
server_key: "dbe9c412ea080471699160021781f37a"
server_key_iv: "850fc79db1027ddfa687d5ef444f06f9"
server_key_version: "encryptionkey@0"
I20260811 16:37:54.229573 752 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466249441839-25279-0/minicluster-data/master-0/wal/instance:
uuid: "9c8ef5dab55b438f8d491c18da9784bd"
format_stamp: "Formatted at 2026-08-11 16:37:54 on dist-test-slave-zj8q"
server_key: "dbe9c412ea080471699160021781f37a"
server_key_iv: "850fc79db1027ddfa687d5ef444f06f9"
server_key_version: "encryptionkey@0"
I20260811 16:37:54.230820 752 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:37:54.231496 773 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:54.231647 752 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:37:54.231732 752 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466249441839-25279-0/minicluster-data/master-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466249441839-25279-0/minicluster-data/master-0/wal
uuid: "9c8ef5dab55b438f8d491c18da9784bd"
format_stamp: "Formatted at 2026-08-11 16:37:54 on dist-test-slave-zj8q"
server_key: "dbe9c412ea080471699160021781f37a"
server_key_iv: "850fc79db1027ddfa687d5ef444f06f9"
server_key_version: "encryptionkey@0"
I20260811 16:37:54.231798 752 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466249441839-25279-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466249441839-25279-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466249441839-25279-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:37:54.235009 752 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:37:54.235252 752 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:37:54.235370 752 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:37:54.239035 752 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.254:32783
I20260811 16:37:54.239068 865 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.254:32783 every 8 connection(s)
I20260811 16:37:54.239365 752 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
I20260811 16:37:54.239984 866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:37:54.240839 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 752
I20260811 16:37:54.240927 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466249441839-25279-0/minicluster-data/master-0/wal/instance
I20260811 16:37:54.241092 25279 external_mini_cluster.cc:1428] Setting key f1c3ee38c0222e5b43bb4a283dabd950
I20260811 16:37:54.243472 866 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c8ef5dab55b438f8d491c18da9784bd: Bootstrap starting.
I20260811 16:37:54.243502 873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:54.241545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40204 (local address 127.24.175.254:32783)
0811 16:37:54.241751 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:54.241760 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:54.241794 (+ 34us) server_negotiation.cc:407] Connection header received
0811 16:37:54.242355 (+ 561us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:54.242364 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:54.242416 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:54.242553 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:54.243085 (+ 532us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:54.243089 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:54.243090 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:37:54.243094 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:54.243140 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:37:54.243153 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:54.243223 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:54.243275 (+ 52us) server_negotiation.cc:299] Negotiation successful
0811 16:37:54.243329 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":79,"threads_started":1}
I20260811 16:37:54.244194 866 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9c8ef5dab55b438f8d491c18da9784bd: Neither blocks nor log segments found. Creating new log.
I20260811 16:37:54.244465 866 log.cc:824] T 00000000000000000000000000000000 P 9c8ef5dab55b438f8d491c18da9784bd: Log is configured to *not* fsync() on all Append() calls
I20260811 16:37:54.245155 866 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c8ef5dab55b438f8d491c18da9784bd: No bootstrap required, opened a new log
I20260811 16:37:54.246517 866 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9c8ef5dab55b438f8d491c18da9784bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c8ef5dab55b438f8d491c18da9784bd" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 32783 } }
I20260811 16:37:54.246646 866 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9c8ef5dab55b438f8d491c18da9784bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:37:54.246670 866 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9c8ef5dab55b438f8d491c18da9784bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c8ef5dab55b438f8d491c18da9784bd, State: Initialized, Role: FOLLOWER
I20260811 16:37:54.246759 866 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9c8ef5dab55b438f8d491c18da9784bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c8ef5dab55b438f8d491c18da9784bd" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 32783 } }
I20260811 16:37:54.246845 866 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9c8ef5dab55b438f8d491c18da9784bd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:37:54.246871 866 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9c8ef5dab55b438f8d491c18da9784bd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:37:54.246902 866 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9c8ef5dab55b438f8d491c18da9784bd [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:37:54.247714 866 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9c8ef5dab55b438f8d491c18da9784bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c8ef5dab55b438f8d491c18da9784bd" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 32783 } }
I20260811 16:37:54.247803 866 leader_election.cc:302] T 00000000000000000000000000000000 P 9c8ef5dab55b438f8d491c18da9784bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9c8ef5dab55b438f8d491c18da9784bd; no voters:
I20260811 16:37:54.247916 866 leader_election.cc:288] T 00000000000000000000000000000000 P 9c8ef5dab55b438f8d491c18da9784bd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:37:54.247973 879 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9c8ef5dab55b438f8d491c18da9784bd [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:37:54.248111 879 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9c8ef5dab55b438f8d491c18da9784bd [term 1 LEADER]: Becoming Leader. State: Replica: 9c8ef5dab55b438f8d491c18da9784bd, State: Running, Role: LEADER
I20260811 16:37:54.248157 866 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9c8ef5dab55b438f8d491c18da9784bd [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:37:54.248208 879 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9c8ef5dab55b438f8d491c18da9784bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c8ef5dab55b438f8d491c18da9784bd" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 32783 } }
I20260811 16:37:54.248554 880 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c8ef5dab55b438f8d491c18da9784bd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9c8ef5dab55b438f8d491c18da9784bd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c8ef5dab55b438f8d491c18da9784bd" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 32783 } } }
I20260811 16:37:54.248644 880 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c8ef5dab55b438f8d491c18da9784bd [sys.catalog]: This master's current role is: LEADER
I20260811 16:37:54.248836 881 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c8ef5dab55b438f8d491c18da9784bd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9c8ef5dab55b438f8d491c18da9784bd. Latest consensus state: current_term: 1 leader_uuid: "9c8ef5dab55b438f8d491c18da9784bd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c8ef5dab55b438f8d491c18da9784bd" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 32783 } } }
I20260811 16:37:54.248903 881 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c8ef5dab55b438f8d491c18da9784bd [sys.catalog]: This master's current role is: LEADER
W20260811 16:37:54.249743 904 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9c8ef5dab55b438f8d491c18da9784bd: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 16:37:54.249784 904 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 16:37:54.249840 890 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:37:54.250010 890 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:37:54.251377 890 catalog_manager.cc:1347] Generated new cluster ID: e449c54b52bc4aa3a3e43679d24c6875
I20260811 16:37:54.251432 890 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:37:54.259348 890 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:37:54.259496 890 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:37:54.264397 890 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9c8ef5dab55b438f8d491c18da9784bd: Generated new TSK 0
I20260811 16:37:54.264550 890 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:37:54.272326 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466249441839-25279-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466249441839-25279-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466249441839-25279-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.193:0
--local_ip_for_outbound_sockets=127.24.175.193
--webserver_interface=127.24.175.193
--webserver_port=0
--tserver_master_addrs=127.24.175.254:32783
--builtin_ntp_servers=127.24.175.212:46323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 16:37:54.362373 916 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:37:54.362574 916 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:37:54.362602 916 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:37:54.363735 916 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:37:54.363775 916 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:37:54.363806 916 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.193
I20260811 16:37:54.365134 916 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:46323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466249441839-25279-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466249441839-25279-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.175.193
--webserver_port=0
--tserver_master_addrs=127.24.175.254:32783
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.916
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.193
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466249441839-25279-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:37:54.365368 916 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:37:54.365664 916 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:37:54.370472 922 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:54.370463 925 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:54.370500 923 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:37:54.371078 916 server_base.cc:1034] running on GCE node
I20260811 16:37:54.371287 916 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:37:54.371501 916 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:37:54.372644 916 hybrid_clock.cc:648] HybridClock initialized: now 1786466274372633 us; error 33 us; skew 500 ppm
I20260811 16:37:54.373836 916 webserver.cc:460] Webserver started at http://127.24.175.193:40349/ using document root <none> and password file <none>
I20260811 16:37:54.374060 916 fs_manager.cc:359] Metadata directory not provided
I20260811 16:37:54.374109 916 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:37:54.374303 916 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:37:54.375324 916 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466249441839-25279-0/minicluster-data/ts-0/data/instance:
uuid: "5b96820b1f4b4a1fa7b2d61f7c257a77"
format_stamp: "Formatted at 2026-08-11 16:37:54 on dist-test-slave-zj8q"
server_key: "f617a910a166d51bea342c6cb34e2b68"
server_key_iv: "e4bd904f95499051d1f75d49a375d2bc"
server_key_version: "encryptionkey@0"
I20260811 16:37:54.375658 916 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466249441839-25279-0/minicluster-data/ts-0/wal/instance:
uuid: "5b96820b1f4b4a1fa7b2d61f7c257a77"
format_stamp: "Formatted at 2026-08-11 16:37:54 on dist-test-slave-zj8q"
server_key: "f617a910a166d51bea342c6cb34e2b68"
server_key_iv: "e4bd904f95499051d1f75d49a375d2bc"
server_key_version: "encryptionkey@0"
I20260811 16:37:54.376919 916 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 16:37:54.377637 936 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:54.377791 916 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 16:37:54.377887 916 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466249441839-25279-0/minicluster-data/ts-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466249441839-25279-0/minicluster-data/ts-0/wal
uuid: "5b96820b1f4b4a1fa7b2d61f7c257a77"
format_stamp: "Formatted at 2026-08-11 16:37:54 on dist-test-slave-zj8q"
server_key: "f617a910a166d51bea342c6cb34e2b68"
server_key_iv: "e4bd904f95499051d1f75d49a375d2bc"
server_key_version: "encryptionkey@0"
I20260811 16:37:54.377955 916 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466249441839-25279-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466249441839-25279-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466249441839-25279-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:37:54.381131 916 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:37:54.381371 916 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:37:54.381487 916 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:37:54.381676 916 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:37:54.381958 916 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:37:54.381990 916 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:54.382016 916 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:37:54.382040 916 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:54.387482 916 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.193:40929
I20260811 16:37:54.387543 1126 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.193:40929 every 8 connection(s)
I20260811 16:37:54.387825 916 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
I20260811 16:37:54.390440 873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:54.388501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:47829 (local address 127.24.175.254:32783)
0811 16:37:54.388597 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:54.388598 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:54.388751 (+ 153us) server_negotiation.cc:407] Connection header received
0811 16:37:54.389169 (+ 418us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:54.389170 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:54.389175 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:54.389230 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:54.390248 (+ 1018us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:54.390250 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:54.390250 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:37:54.390254 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:54.390268 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:37:54.390273 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:54.390313 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:54.390376 (+ 63us) server_negotiation.cc:299] Negotiation successful
0811 16:37:54.390387 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 16:37:54.390616 1130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:54.388442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:32783 (local address 127.24.175.193:47829)
0811 16:37:54.388637 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:54.388675 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:54.389091 (+ 416us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:54.389281 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:54.389284 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:54.389292 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:37:54.390073 (+ 781us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 16:37:54.390073 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:37:54.390100 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 16:37:54.390129 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:37:54.390325 (+ 196us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:37:54.390329 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:37:54.390331 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 16:37:54.390384 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 16:37:54.390431 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":95,"threads_started":1}
I20260811 16:37:54.391091 1127 heartbeater.cc:347] Connected to a master server at 127.24.175.254:32783
I20260811 16:37:54.391149 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 916
I20260811 16:37:54.391177 1127 heartbeater.cc:464] Registering TS with master...
I20260811 16:37:54.391260 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466249441839-25279-0/minicluster-data/ts-0/wal/instance
I20260811 16:37:54.391314 1127 heartbeater.cc:511] Master 127.24.175.254:32783 requested a full tablet report, sending...
I20260811 16:37:54.391448 25279 external_mini_cluster.cc:1428] Setting key dc3d833a8b4cff31c01e064699640142
I20260811 16:37:54.391819 797 ts_manager.cc:194] Registered new tserver with Master: 5b96820b1f4b4a1fa7b2d61f7c257a77 (127.24.175.193:40929)
I20260811 16:37:54.392418 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466249441839-25279-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466249441839-25279-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466249441839-25279-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.194:0
--local_ip_for_outbound_sockets=127.24.175.194
--webserver_interface=127.24.175.194
--webserver_port=0
--tserver_master_addrs=127.24.175.254:32783
--builtin_ntp_servers=127.24.175.212:46323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 16:37:54.471709 1131 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:37:54.471897 1131 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:37:54.471918 1131 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:37:54.472985 1131 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:37:54.473016 1131 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:37:54.473040 1131 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.194
I20260811 16:37:54.474334 1131 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:46323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466249441839-25279-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466249441839-25279-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.175.194
--webserver_port=0
--tserver_master_addrs=127.24.175.254:32783
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1131
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.194
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466249441839-25279-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:37:54.474514 1131 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:37:54.474740 1131 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:37:54.479471 1141 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:54.479465 1145 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:54.479462 1140 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:37:54.479640 1131 server_base.cc:1034] running on GCE node
I20260811 16:37:54.479827 1131 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:37:54.480026 1131 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:37:54.481159 1131 hybrid_clock.cc:648] HybridClock initialized: now 1786466274481143 us; error 34 us; skew 500 ppm
I20260811 16:37:54.482417 1131 webserver.cc:460] Webserver started at http://127.24.175.194:42153/ using document root <none> and password file <none>
I20260811 16:37:54.482633 1131 fs_manager.cc:359] Metadata directory not provided
I20260811 16:37:54.482681 1131 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:37:54.482801 1131 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:37:54.483902 1131 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466249441839-25279-0/minicluster-data/ts-1/data/instance:
uuid: "43d42876e3634a308e5a34ba36435e9f"
format_stamp: "Formatted at 2026-08-11 16:37:54 on dist-test-slave-zj8q"
server_key: "a6617ff5d57b28c64c90784ac3fdba87"
server_key_iv: "cc2dc7470dc4b78691a295a9fb2d1499"
server_key_version: "encryptionkey@0"
I20260811 16:37:54.484221 1131 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466249441839-25279-0/minicluster-data/ts-1/wal/instance:
uuid: "43d42876e3634a308e5a34ba36435e9f"
format_stamp: "Formatted at 2026-08-11 16:37:54 on dist-test-slave-zj8q"
server_key: "a6617ff5d57b28c64c90784ac3fdba87"
server_key_iv: "cc2dc7470dc4b78691a295a9fb2d1499"
server_key_version: "encryptionkey@0"
I20260811 16:37:54.485399 1131 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:37:54.486089 1159 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:54.486275 1131 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:37:54.486353 1131 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466249441839-25279-0/minicluster-data/ts-1/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466249441839-25279-0/minicluster-data/ts-1/wal
uuid: "43d42876e3634a308e5a34ba36435e9f"
format_stamp: "Formatted at 2026-08-11 16:37:54 on dist-test-slave-zj8q"
server_key: "a6617ff5d57b28c64c90784ac3fdba87"
server_key_iv: "cc2dc7470dc4b78691a295a9fb2d1499"
server_key_version: "encryptionkey@0"
I20260811 16:37:54.486405 1131 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466249441839-25279-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466249441839-25279-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466249441839-25279-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:37:54.489440 1131 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:37:54.489639 1131 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:37:54.489737 1131 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:37:54.489912 1131 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:37:54.490209 1131 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:37:54.490254 1131 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:54.490283 1131 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:37:54.490306 1131 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:54.495678 1131 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.194:36387
I20260811 16:37:54.495713 1349 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.194:36387 every 8 connection(s)
I20260811 16:37:54.496002 1131 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
I20260811 16:37:54.497071 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 1131
I20260811 16:37:54.497159 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466249441839-25279-0/minicluster-data/ts-1/wal/instance
I20260811 16:37:54.497320 25279 external_mini_cluster.cc:1428] Setting key 8c4b55dfff5102ec66ba5260e9d790ad
I20260811 16:37:54.498266 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466249441839-25279-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466249441839-25279-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466249441839-25279-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.195:0
--local_ip_for_outbound_sockets=127.24.175.195
--webserver_interface=127.24.175.195
--webserver_port=0
--tserver_master_addrs=127.24.175.254:32783
--builtin_ntp_servers=127.24.175.212:46323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260811 16:37:54.499037 873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:54.496664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:43837 (local address 127.24.175.254:32783)
0811 16:37:54.496714 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:54.496717 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:54.496928 (+ 211us) server_negotiation.cc:407] Connection header received
0811 16:37:54.497467 (+ 539us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:54.497468 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:54.497476 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:54.497539 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:54.498827 (+ 1288us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:54.498828 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:54.498829 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:37:54.498832 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:54.498848 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:37:54.498851 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:54.498890 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:54.498973 (+ 83us) server_negotiation.cc:299] Negotiation successful
0811 16:37:54.498983 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 16:37:54.499235 1352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:54.496642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:32783 (local address 127.24.175.194:43837)
0811 16:37:54.496824 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:54.496854 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:54.497317 (+ 463us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:54.497612 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:54.497617 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:54.497627 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:37:54.498663 (+ 1036us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 16:37:54.498663 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:37:54.498698 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 16:37:54.498733 (+ 35us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:37:54.498905 (+ 172us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:37:54.498908 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:37:54.498911 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:37:54.498974 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 16:37:54.499036 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":88,"threads_started":1}
I20260811 16:37:54.499701 1350 heartbeater.cc:347] Connected to a master server at 127.24.175.254:32783
I20260811 16:37:54.499792 1350 heartbeater.cc:464] Registering TS with master...
I20260811 16:37:54.499953 1350 heartbeater.cc:511] Master 127.24.175.254:32783 requested a full tablet report, sending...
I20260811 16:37:54.500325 795 ts_manager.cc:194] Registered new tserver with Master: 43d42876e3634a308e5a34ba36435e9f (127.24.175.194:36387)
W20260811 16:37:54.579213 1355 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:37:54.579407 1355 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:37:54.579427 1355 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:37:54.580592 1355 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:37:54.580631 1355 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:37:54.580657 1355 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.195
I20260811 16:37:54.582026 1355 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:46323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466249441839-25279-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466249441839-25279-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.175.195
--webserver_port=0
--tserver_master_addrs=127.24.175.254:32783
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1355
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.195
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466249441839-25279-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:37:54.582270 1355 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:37:54.582540 1355 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:37:54.587493 1363 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:54.587481 1366 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:54.587472 1375 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:37:54.587507 1355 server_base.cc:1034] running on GCE node
I20260811 16:37:54.587839 1355 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:37:54.588086 1355 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:37:54.589231 1355 hybrid_clock.cc:648] HybridClock initialized: now 1786466274589215 us; error 23 us; skew 500 ppm
I20260811 16:37:54.590478 1355 webserver.cc:460] Webserver started at http://127.24.175.195:43329/ using document root <none> and password file <none>
I20260811 16:37:54.590690 1355 fs_manager.cc:359] Metadata directory not provided
I20260811 16:37:54.590739 1355 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:37:54.590866 1355 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:37:54.591895 1355 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466249441839-25279-0/minicluster-data/ts-2/data/instance:
uuid: "77661a31e9fe4677bfe8697ae8e145ac"
format_stamp: "Formatted at 2026-08-11 16:37:54 on dist-test-slave-zj8q"
server_key: "236100f0ca5ac6c1c431c678a64da027"
server_key_iv: "e89748c89e0b77208a00b390aa970fd4"
server_key_version: "encryptionkey@0"
I20260811 16:37:54.592234 1355 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466249441839-25279-0/minicluster-data/ts-2/wal/instance:
uuid: "77661a31e9fe4677bfe8697ae8e145ac"
format_stamp: "Formatted at 2026-08-11 16:37:54 on dist-test-slave-zj8q"
server_key: "236100f0ca5ac6c1c431c678a64da027"
server_key_iv: "e89748c89e0b77208a00b390aa970fd4"
server_key_version: "encryptionkey@0"
I20260811 16:37:54.593437 1355 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:37:54.594100 1384 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:54.594265 1355 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:37:54.594352 1355 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466249441839-25279-0/minicluster-data/ts-2/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466249441839-25279-0/minicluster-data/ts-2/wal
uuid: "77661a31e9fe4677bfe8697ae8e145ac"
format_stamp: "Formatted at 2026-08-11 16:37:54 on dist-test-slave-zj8q"
server_key: "236100f0ca5ac6c1c431c678a64da027"
server_key_iv: "e89748c89e0b77208a00b390aa970fd4"
server_key_version: "encryptionkey@0"
I20260811 16:37:54.594421 1355 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466249441839-25279-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466249441839-25279-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466249441839-25279-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:37:54.597563 1355 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:37:54.597795 1355 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:37:54.597908 1355 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:37:54.598093 1355 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:37:54.598405 1355 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:37:54.598438 1355 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:54.598464 1355 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:37:54.598489 1355 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:54.603808 1355 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.195:45815
I20260811 16:37:54.603863 1583 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.195:45815 every 8 connection(s)
I20260811 16:37:54.604135 1355 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
I20260811 16:37:54.606832 873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:54.604777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.195:60977 (local address 127.24.175.254:32783)
0811 16:37:54.604851 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:54.604853 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:54.605125 (+ 272us) server_negotiation.cc:407] Connection header received
0811 16:37:54.605589 (+ 464us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:54.605590 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:54.605596 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:54.605643 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:54.606650 (+ 1007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:54.606651 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:54.606651 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:37:54.606655 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:54.606670 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:37:54.606674 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:54.606716 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:54.606765 (+ 49us) server_negotiation.cc:299] Negotiation successful
0811 16:37:54.606776 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 16:37:54.606983 1590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:54.604762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:32783 (local address 127.24.175.195:60977)
0811 16:37:54.605012 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:54.605044 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:54.605495 (+ 451us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:54.605696 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:54.605699 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:54.605707 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:37:54.606527 (+ 820us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 16:37:54.606527 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:37:54.606554 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 16:37:54.606580 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:37:54.606716 (+ 136us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:37:54.606719 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:37:54.606721 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 16:37:54.606768 (+ 47us) client_negotiation.cc:240] Negotiation successful
0811 16:37:54.606811 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":139,"threads_started":1}
I20260811 16:37:54.607405 1585 heartbeater.cc:347] Connected to a master server at 127.24.175.254:32783
I20260811 16:37:54.607488 1585 heartbeater.cc:464] Registering TS with master...
I20260811 16:37:54.607625 1585 heartbeater.cc:511] Master 127.24.175.254:32783 requested a full tablet report, sending...
I20260811 16:37:54.607968 795 ts_manager.cc:194] Registered new tserver with Master: 77661a31e9fe4677bfe8697ae8e145ac (127.24.175.195:45815)
I20260811 16:37:54.613518 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 1355
I20260811 16:37:54.613603 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466249441839-25279-0/minicluster-data/ts-2/wal/instance
I20260811 16:37:54.613747 25279 external_mini_cluster.cc:1428] Setting key 094b2adae070ecebee1bec528c678a0d
I20260811 16:37:54.614487 25279 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 16:37:54.616533 873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:54.615653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40220 (local address 127.24.175.254:32783)
0811 16:37:54.615707 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:54.615708 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:54.615817 (+ 109us) server_negotiation.cc:407] Connection header received
0811 16:37:54.615856 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:54.615857 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:54.615861 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:54.615901 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:54.616398 (+ 497us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:54.616398 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:54.616399 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:37:54.616401 (+ 2us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:54.616410 (+ 9us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:37:54.616412 (+ 2us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:54.616444 (+ 32us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:54.616479 (+ 35us) server_negotiation.cc:299] Negotiation successful
0811 16:37:54.616488 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 16:37:54.617818 795 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40220:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:37:54.619362 795 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:37:54.622736 1602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:54.621201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.194:36387 (local address 127.0.0.1:59634)
0811 16:37:54.621588 (+ 387us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:54.621598 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:54.621644 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:54.621872 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:54.621873 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:54.621876 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:37:54.622344 (+ 468us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 16:37:54.622345 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:37:54.622357 (+ 12us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 16:37:54.622377 (+ 20us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:37:54.622589 (+ 212us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:37:54.622596 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:37:54.622599 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:37:54.622654 (+ 55us) client_negotiation.cc:240] Negotiation successful
0811 16:37:54.622667 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":370,"mutex_wait_us":3,"spinlock_wait_cycles":384,"thread_start_us":89,"threads_started":1}
I20260811 16:37:54.622825 1601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:54.621305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56202 (local address 127.24.175.193:40929)
0811 16:37:54.621625 (+ 320us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:54.621628 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:54.621637 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:37:54.621663 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:54.621666 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:54.621675 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:54.622136 (+ 461us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:54.622495 (+ 359us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:54.622501 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:54.622502 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:37:54.622506 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:54.622539 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:37:54.622560 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:54.622651 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:54.622714 (+ 63us) server_negotiation.cc:299] Negotiation successful
0811 16:37:54.622738 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":286,"thread_start_us":98,"threads_started":1}
I20260811 16:37:54.623014 1600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:54.621200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.193:40929 (local address 127.0.0.1:56202)
0811 16:37:54.621413 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:54.621451 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:54.621504 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:54.621786 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:54.621792 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:54.621798 (+ 6us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:37:54.622410 (+ 612us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 16:37:54.622411 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:37:54.622416 (+ 5us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 16:37:54.622425 (+ 9us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:37:54.622654 (+ 229us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:37:54.622655 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:37:54.622655 (+ 0us) client_negotiation.cc:769] Sending connection context
0811 16:37:54.622698 (+ 43us) client_negotiation.cc:240] Negotiation successful
0811 16:37:54.622710 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":62,"threads_started":1}
I20260811 16:37:54.623029 1603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:54.621403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59634 (local address 127.24.175.194:36387)
0811 16:37:54.621756 (+ 353us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:54.621760 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:54.621769 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:37:54.621793 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:54.621795 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:54.621803 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:54.621872 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:54.622463 (+ 591us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:54.622470 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:54.622471 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:37:54.622475 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:54.622509 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:37:54.622537 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:54.622588 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:54.622926 (+ 338us) server_negotiation.cc:299] Negotiation successful
0811 16:37:54.622943 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":315,"thread_start_us":92,"threads_started":1}
I20260811 16:37:54.623338 1598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:54.621391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.195:45815 (local address 127.0.0.1:34556)
0811 16:37:54.621727 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:54.621736 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:54.621783 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:54.622407 (+ 624us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:54.622408 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:54.622410 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:37:54.622973 (+ 563us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 16:37:54.622973 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:37:54.622980 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 16:37:54.622993 (+ 13us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:37:54.623206 (+ 213us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:37:54.623207 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:37:54.623208 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 16:37:54.623267 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 16:37:54.623279 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":324,"thread_start_us":66,"threads_started":1}
I20260811 16:37:54.623669 1016 tablet_service.cc:1467] Processing CreateTablet for tablet 519a709a97f344859985f9190cf7d79a (DEFAULT_TABLE table=test-table [id=4244afca6a3340e8a5de529e685e09a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:37:54.623677 1256 tablet_service.cc:1467] Processing CreateTablet for tablet 519a709a97f344859985f9190cf7d79a (DEFAULT_TABLE table=test-table [id=4244afca6a3340e8a5de529e685e09a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:37:54.624027 1256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 519a709a97f344859985f9190cf7d79a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:37:54.624027 1016 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 519a709a97f344859985f9190cf7d79a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:37:54.627265 1609 tablet_bootstrap.cc:492] T 519a709a97f344859985f9190cf7d79a P 43d42876e3634a308e5a34ba36435e9f: Bootstrap starting.
I20260811 16:37:54.627355 1606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:54.621559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34556 (local address 127.24.175.195:45815)
0811 16:37:54.621713 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:54.621717 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:54.621783 (+ 66us) server_negotiation.cc:407] Connection header received
0811 16:37:54.621823 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:54.621825 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:54.621833 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:54.621898 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:54.623066 (+ 1168us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:54.623073 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:54.623074 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:37:54.623078 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:54.623112 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:37:54.623133 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:54.623181 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:54.627268 (+ 4087us) server_negotiation.cc:299] Negotiation successful
0811 16:37:54.627283 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":76,"threads_started":1}
I20260811 16:37:54.627947 1609 tablet_bootstrap.cc:654] T 519a709a97f344859985f9190cf7d79a P 43d42876e3634a308e5a34ba36435e9f: Neither blocks nor log segments found. Creating new log.
I20260811 16:37:54.627952 1464 tablet_service.cc:1467] Processing CreateTablet for tablet 519a709a97f344859985f9190cf7d79a (DEFAULT_TABLE table=test-table [id=4244afca6a3340e8a5de529e685e09a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:37:54.628283 1464 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 519a709a97f344859985f9190cf7d79a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:37:54.628275 1609 log.cc:824] T 519a709a97f344859985f9190cf7d79a P 43d42876e3634a308e5a34ba36435e9f: Log is configured to *not* fsync() on all Append() calls
I20260811 16:37:54.628605 1607 tablet_bootstrap.cc:492] T 519a709a97f344859985f9190cf7d79a P 5b96820b1f4b4a1fa7b2d61f7c257a77: Bootstrap starting.
I20260811 16:37:54.628968 1609 tablet_bootstrap.cc:492] T 519a709a97f344859985f9190cf7d79a P 43d42876e3634a308e5a34ba36435e9f: No bootstrap required, opened a new log
I20260811 16:37:54.629060 1609 ts_tablet_manager.cc:1397] T 519a709a97f344859985f9190cf7d79a P 43d42876e3634a308e5a34ba36435e9f: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:37:54.629220 1607 tablet_bootstrap.cc:654] T 519a709a97f344859985f9190cf7d79a P 5b96820b1f4b4a1fa7b2d61f7c257a77: Neither blocks nor log segments found. Creating new log.
I20260811 16:37:54.629572 1607 log.cc:824] T 519a709a97f344859985f9190cf7d79a P 5b96820b1f4b4a1fa7b2d61f7c257a77: Log is configured to *not* fsync() on all Append() calls
I20260811 16:37:54.630373 1607 tablet_bootstrap.cc:492] T 519a709a97f344859985f9190cf7d79a P 5b96820b1f4b4a1fa7b2d61f7c257a77: No bootstrap required, opened a new log
I20260811 16:37:54.630445 1607 ts_tablet_manager.cc:1397] T 519a709a97f344859985f9190cf7d79a P 5b96820b1f4b4a1fa7b2d61f7c257a77: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 16:37:54.631256 1609 raft_consensus.cc:348] T 519a709a97f344859985f9190cf7d79a P 43d42876e3634a308e5a34ba36435e9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b96820b1f4b4a1fa7b2d61f7c257a77" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40929 } } peers { permanent_uuid: "43d42876e3634a308e5a34ba36435e9f" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 36387 } } peers { permanent_uuid: "77661a31e9fe4677bfe8697ae8e145ac" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 45815 } }
I20260811 16:37:54.631373 1612 tablet_bootstrap.cc:492] T 519a709a97f344859985f9190cf7d79a P 77661a31e9fe4677bfe8697ae8e145ac: Bootstrap starting.
I20260811 16:37:54.631436 1609 raft_consensus.cc:374] T 519a709a97f344859985f9190cf7d79a P 43d42876e3634a308e5a34ba36435e9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:37:54.631477 1609 raft_consensus.cc:729] T 519a709a97f344859985f9190cf7d79a P 43d42876e3634a308e5a34ba36435e9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43d42876e3634a308e5a34ba36435e9f, State: Initialized, Role: FOLLOWER
I20260811 16:37:54.631606 1609 consensus_queue.cc:260] T 519a709a97f344859985f9190cf7d79a P 43d42876e3634a308e5a34ba36435e9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b96820b1f4b4a1fa7b2d61f7c257a77" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40929 } } peers { permanent_uuid: "43d42876e3634a308e5a34ba36435e9f" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 36387 } } peers { permanent_uuid: "77661a31e9fe4677bfe8697ae8e145ac" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 45815 } }
I20260811 16:37:54.631886 1609 ts_tablet_manager.cc:1428] T 519a709a97f344859985f9190cf7d79a P 43d42876e3634a308e5a34ba36435e9f: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 16:37:54.632028 1350 heartbeater.cc:503] Master 127.24.175.254:32783 was elected leader, sending a full tablet report...
I20260811 16:37:54.632189 1612 tablet_bootstrap.cc:654] T 519a709a97f344859985f9190cf7d79a P 77661a31e9fe4677bfe8697ae8e145ac: Neither blocks nor log segments found. Creating new log.
I20260811 16:37:54.632489 1612 log.cc:824] T 519a709a97f344859985f9190cf7d79a P 77661a31e9fe4677bfe8697ae8e145ac: Log is configured to *not* fsync() on all Append() calls
I20260811 16:37:54.632807 1607 raft_consensus.cc:348] T 519a709a97f344859985f9190cf7d79a P 5b96820b1f4b4a1fa7b2d61f7c257a77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b96820b1f4b4a1fa7b2d61f7c257a77" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40929 } } peers { permanent_uuid: "43d42876e3634a308e5a34ba36435e9f" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 36387 } } peers { permanent_uuid: "77661a31e9fe4677bfe8697ae8e145ac" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 45815 } }
I20260811 16:37:54.632954 1607 raft_consensus.cc:374] T 519a709a97f344859985f9190cf7d79a P 5b96820b1f4b4a1fa7b2d61f7c257a77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:37:54.632989 1607 raft_consensus.cc:729] T 519a709a97f344859985f9190cf7d79a P 5b96820b1f4b4a1fa7b2d61f7c257a77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b96820b1f4b4a1fa7b2d61f7c257a77, State: Initialized, Role: FOLLOWER
I20260811 16:37:54.633092 1607 consensus_queue.cc:260] T 519a709a97f344859985f9190cf7d79a P 5b96820b1f4b4a1fa7b2d61f7c257a77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b96820b1f4b4a1fa7b2d61f7c257a77" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40929 } } peers { permanent_uuid: "43d42876e3634a308e5a34ba36435e9f" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 36387 } } peers { permanent_uuid: "77661a31e9fe4677bfe8697ae8e145ac" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 45815 } }
I20260811 16:37:54.633319 1612 tablet_bootstrap.cc:492] T 519a709a97f344859985f9190cf7d79a P 77661a31e9fe4677bfe8697ae8e145ac: No bootstrap required, opened a new log
I20260811 16:37:54.633354 1607 ts_tablet_manager.cc:1428] T 519a709a97f344859985f9190cf7d79a P 5b96820b1f4b4a1fa7b2d61f7c257a77: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 16:37:54.633383 1612 ts_tablet_manager.cc:1397] T 519a709a97f344859985f9190cf7d79a P 77661a31e9fe4677bfe8697ae8e145ac: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 16:37:54.633404 1127 heartbeater.cc:503] Master 127.24.175.254:32783 was elected leader, sending a full tablet report...
I20260811 16:37:54.635448 1612 raft_consensus.cc:348] T 519a709a97f344859985f9190cf7d79a P 77661a31e9fe4677bfe8697ae8e145ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b96820b1f4b4a1fa7b2d61f7c257a77" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40929 } } peers { permanent_uuid: "43d42876e3634a308e5a34ba36435e9f" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 36387 } } peers { permanent_uuid: "77661a31e9fe4677bfe8697ae8e145ac" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 45815 } }
I20260811 16:37:54.635566 1612 raft_consensus.cc:374] T 519a709a97f344859985f9190cf7d79a P 77661a31e9fe4677bfe8697ae8e145ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:37:54.635586 1612 raft_consensus.cc:729] T 519a709a97f344859985f9190cf7d79a P 77661a31e9fe4677bfe8697ae8e145ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77661a31e9fe4677bfe8697ae8e145ac, State: Initialized, Role: FOLLOWER
I20260811 16:37:54.635690 1612 consensus_queue.cc:260] T 519a709a97f344859985f9190cf7d79a P 77661a31e9fe4677bfe8697ae8e145ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b96820b1f4b4a1fa7b2d61f7c257a77" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40929 } } peers { permanent_uuid: "43d42876e3634a308e5a34ba36435e9f" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 36387 } } peers { permanent_uuid: "77661a31e9fe4677bfe8697ae8e145ac" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 45815 } }
I20260811 16:37:54.635921 1612 ts_tablet_manager.cc:1428] T 519a709a97f344859985f9190cf7d79a P 77661a31e9fe4677bfe8697ae8e145ac: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 16:37:54.635951 1585 heartbeater.cc:503] Master 127.24.175.254:32783 was elected leader, sending a full tablet report...
W20260811 16:37:54.638257 1129 tablet.cc:2369] T 519a709a97f344859985f9190cf7d79a P 5b96820b1f4b4a1fa7b2d61f7c257a77: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:37:54.707077 1613 raft_consensus.cc:482] T 519a709a97f344859985f9190cf7d79a P 43d42876e3634a308e5a34ba36435e9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:37:54.707199 1613 raft_consensus.cc:504] T 519a709a97f344859985f9190cf7d79a P 43d42876e3634a308e5a34ba36435e9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b96820b1f4b4a1fa7b2d61f7c257a77" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40929 } } peers { permanent_uuid: "43d42876e3634a308e5a34ba36435e9f" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 36387 } } peers { permanent_uuid: "77661a31e9fe4677bfe8697ae8e145ac" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 45815 } }
I20260811 16:37:54.707504 1613 leader_election.cc:288] T 519a709a97f344859985f9190cf7d79a P 43d42876e3634a308e5a34ba36435e9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b96820b1f4b4a1fa7b2d61f7c257a77 (127.24.175.193:40929), 77661a31e9fe4677bfe8697ae8e145ac (127.24.175.195:45815)
I20260811 16:37:54.708683 1601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:54.707742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:51825 (local address 127.24.175.193:40929)
0811 16:37:54.707789 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:54.707792 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:54.707803 (+ 11us) server_negotiation.cc:407] Connection header received
0811 16:37:54.707890 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:54.707891 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:54.707898 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:54.707950 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:54.708465 (+ 515us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:54.708466 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:54.708467 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:37:54.708471 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:54.708490 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:37:54.708496 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:54.708552 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:54.708607 (+ 55us) server_negotiation.cc:299] Negotiation successful
0811 16:37:54.708618 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 16:37:54.708683 1352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:54.707693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.193:40929 (local address 127.24.175.194:51825)
0811 16:37:54.707748 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:54.707760 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:54.707800 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:54.707975 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:54.707976 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:54.707979 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:37:54.708358 (+ 379us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 16:37:54.708358 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:37:54.708369 (+ 11us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 16:37:54.708381 (+ 12us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:37:54.708554 (+ 173us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:37:54.708555 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:37:54.708556 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 16:37:54.708600 (+ 44us) client_negotiation.cc:240] Negotiation successful
0811 16:37:54.708613 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260811 16:37:54.709072 1049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "519a709a97f344859985f9190cf7d79a" candidate_uuid: "43d42876e3634a308e5a34ba36435e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b96820b1f4b4a1fa7b2d61f7c257a77" is_pre_election: true
I20260811 16:37:54.709161 1618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:54.707695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.195:45815 (local address 127.24.175.194:59843)
0811 16:37:54.707970 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:54.707980 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:54.708028 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:54.708352 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:54.708353 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:54.708355 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:37:54.708887 (+ 532us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 16:37:54.708888 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:37:54.708894 (+ 6us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 16:37:54.708907 (+ 13us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:37:54.709066 (+ 159us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:37:54.709067 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:37:54.709067 (+ 0us) client_negotiation.cc:769] Sending connection context
0811 16:37:54.709098 (+ 31us) client_negotiation.cc:240] Negotiation successful
0811 16:37:54.709108 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"mutex_wait_us":81,"thread_start_us":122,"threads_started":1}
I20260811 16:37:54.709189 1606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:54.707802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:59843 (local address 127.24.175.195:45815)
0811 16:37:54.707855 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:54.707856 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:54.708040 (+ 184us) server_negotiation.cc:407] Connection header received
0811 16:37:54.708069 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:54.708070 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:54.708077 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:54.708141 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:54.708981 (+ 840us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:54.708982 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:54.708983 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:37:54.708988 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:54.709006 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:37:54.709010 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:54.709069 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:54.709101 (+ 32us) server_negotiation.cc:299] Negotiation successful
0811 16:37:54.709114 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 16:37:54.709247 1049 raft_consensus.cc:2454] T 519a709a97f344859985f9190cf7d79a P 5b96820b1f4b4a1fa7b2d61f7c257a77 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43d42876e3634a308e5a34ba36435e9f in term 0.
I20260811 16:37:54.709488 1167 leader_election.cc:302] T 519a709a97f344859985f9190cf7d79a P 43d42876e3634a308e5a34ba36435e9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43d42876e3634a308e5a34ba36435e9f, 5b96820b1f4b4a1fa7b2d61f7c257a77; no voters:
I20260811 16:37:54.709573 1500 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "519a709a97f344859985f9190cf7d79a" candidate_uuid: "43d42876e3634a308e5a34ba36435e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77661a31e9fe4677bfe8697ae8e145ac" is_pre_election: true
I20260811 16:37:54.709618 1613 raft_consensus.cc:2781] T 519a709a97f344859985f9190cf7d79a P 43d42876e3634a308e5a34ba36435e9f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:37:54.709685 1613 raft_consensus.cc:482] T 519a709a97f344859985f9190cf7d79a P 43d42876e3634a308e5a34ba36435e9f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:37:54.709717 1613 raft_consensus.cc:3037] T 519a709a97f344859985f9190cf7d79a P 43d42876e3634a308e5a34ba36435e9f [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:37:54.709726 1500 raft_consensus.cc:2454] T 519a709a97f344859985f9190cf7d79a P 77661a31e9fe4677bfe8697ae8e145ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43d42876e3634a308e5a34ba36435e9f in term 0.
I20260811 16:37:54.710481 1613 raft_consensus.cc:504] T 519a709a97f344859985f9190cf7d79a P 43d42876e3634a308e5a34ba36435e9f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b96820b1f4b4a1fa7b2d61f7c257a77" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40929 } } peers { permanent_uuid: "43d42876e3634a308e5a34ba36435e9f" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 36387 } } peers { permanent_uuid: "77661a31e9fe4677bfe8697ae8e145ac" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 45815 } }
I20260811 16:37:54.710600 1613 leader_election.cc:288] T 519a709a97f344859985f9190cf7d79a P 43d42876e3634a308e5a34ba36435e9f [CANDIDATE]: Term 1 election: Requested vote from peers 5b96820b1f4b4a1fa7b2d61f7c257a77 (127.24.175.193:40929), 77661a31e9fe4677bfe8697ae8e145ac (127.24.175.195:45815)
I20260811 16:37:54.710754 1049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "519a709a97f344859985f9190cf7d79a" candidate_uuid: "43d42876e3634a308e5a34ba36435e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b96820b1f4b4a1fa7b2d61f7c257a77"
I20260811 16:37:54.710749 1500 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "519a709a97f344859985f9190cf7d79a" candidate_uuid: "43d42876e3634a308e5a34ba36435e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77661a31e9fe4677bfe8697ae8e145ac"
I20260811 16:37:54.710824 1049 raft_consensus.cc:3037] T 519a709a97f344859985f9190cf7d79a P 5b96820b1f4b4a1fa7b2d61f7c257a77 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:37:54.710827 1500 raft_consensus.cc:3037] T 519a709a97f344859985f9190cf7d79a P 77661a31e9fe4677bfe8697ae8e145ac [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:37:54.711486 1049 raft_consensus.cc:2454] T 519a709a97f344859985f9190cf7d79a P 5b96820b1f4b4a1fa7b2d61f7c257a77 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43d42876e3634a308e5a34ba36435e9f in term 1.
I20260811 16:37:54.711578 1500 raft_consensus.cc:2454] T 519a709a97f344859985f9190cf7d79a P 77661a31e9fe4677bfe8697ae8e145ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43d42876e3634a308e5a34ba36435e9f in term 1.
I20260811 16:37:54.711639 1167 leader_election.cc:302] T 519a709a97f344859985f9190cf7d79a P 43d42876e3634a308e5a34ba36435e9f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43d42876e3634a308e5a34ba36435e9f, 5b96820b1f4b4a1fa7b2d61f7c257a77; no voters:
I20260811 16:37:54.711715 1613 raft_consensus.cc:2781] T 519a709a97f344859985f9190cf7d79a P 43d42876e3634a308e5a34ba36435e9f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:37:54.711861 1613 raft_consensus.cc:686] T 519a709a97f344859985f9190cf7d79a P 43d42876e3634a308e5a34ba36435e9f [term 1 LEADER]: Becoming Leader. State: Replica: 43d42876e3634a308e5a34ba36435e9f, State: Running, Role: LEADER
I20260811 16:37:54.711957 1613 consensus_queue.cc:237] T 519a709a97f344859985f9190cf7d79a P 43d42876e3634a308e5a34ba36435e9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b96820b1f4b4a1fa7b2d61f7c257a77" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40929 } } peers { permanent_uuid: "43d42876e3634a308e5a34ba36435e9f" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 36387 } } peers { permanent_uuid: "77661a31e9fe4677bfe8697ae8e145ac" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 45815 } }
I20260811 16:37:54.712764 795 catalog_manager.cc:5495] T 519a709a97f344859985f9190cf7d79a P 43d42876e3634a308e5a34ba36435e9f reported cstate change: term changed from 0 to 1, leader changed from <none> to 43d42876e3634a308e5a34ba36435e9f (127.24.175.194). New cstate: current_term: 1 leader_uuid: "43d42876e3634a308e5a34ba36435e9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b96820b1f4b4a1fa7b2d61f7c257a77" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43d42876e3634a308e5a34ba36435e9f" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 36387 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77661a31e9fe4677bfe8697ae8e145ac" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 45815 } health_report { overall_health: UNKNOWN } } }
I20260811 16:37:54.737576 1603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:54.736747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59648 (local address 127.24.175.194:36387)
0811 16:37:54.736802 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:54.736804 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:54.736812 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:37:54.736849 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:54.736850 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:54.736864 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:54.736912 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:54.737366 (+ 454us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:54.737368 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:54.737368 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:37:54.737372 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:54.737385 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:37:54.737389 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:54.737437 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:54.737493 (+ 56us) server_negotiation.cc:299] Negotiation successful
0811 16:37:54.737505 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 16:37:54.739327 1049 raft_consensus.cc:1261] T 519a709a97f344859985f9190cf7d79a P 5b96820b1f4b4a1fa7b2d61f7c257a77 [term 1 FOLLOWER]: Refusing update from remote peer 43d42876e3634a308e5a34ba36435e9f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:37:54.739327 1500 raft_consensus.cc:1261] T 519a709a97f344859985f9190cf7d79a P 77661a31e9fe4677bfe8697ae8e145ac [term 1 FOLLOWER]: Refusing update from remote peer 43d42876e3634a308e5a34ba36435e9f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:37:54.739665 1619 consensus_queue.cc:1035] T 519a709a97f344859985f9190cf7d79a P 43d42876e3634a308e5a34ba36435e9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77661a31e9fe4677bfe8697ae8e145ac" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 45815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:37:54.739800 1613 consensus_queue.cc:1035] T 519a709a97f344859985f9190cf7d79a P 43d42876e3634a308e5a34ba36435e9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b96820b1f4b4a1fa7b2d61f7c257a77" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:37:54.742045 1629 mvcc.cc:205] Tried to move back new op lower bound from 7317365861329571840 to 7317365861220818944. Current Snapshot: MvccSnapshot[applied={T|T < 7317365861329571840}]
I20260811 16:37:54.742439 1632 mvcc.cc:205] Tried to move back new op lower bound from 7317365861329571840 to 7317365861220818944. Current Snapshot: MvccSnapshot[applied={T|T < 7317365861329571840}]
I20260811 16:37:54.744522 797 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40220:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:37:54.744606 797 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40220:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:37:54.745302 797 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9c8ef5dab55b438f8d491c18da9784bd: Sending DeleteTablet for 3 replicas of tablet 519a709a97f344859985f9190cf7d79a
I20260811 16:37:54.745625 1016 tablet_service.cc:1514] Processing DeleteTablet for tablet 519a709a97f344859985f9190cf7d79a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:37:54 UTC) from {username='slave'} at 127.0.0.1:56202
I20260811 16:37:54.745637 1256 tablet_service.cc:1514] Processing DeleteTablet for tablet 519a709a97f344859985f9190cf7d79a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:37:54 UTC) from {username='slave'} at 127.0.0.1:59634
I20260811 16:37:54.745661 1464 tablet_service.cc:1514] Processing DeleteTablet for tablet 519a709a97f344859985f9190cf7d79a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:37:54 UTC) from {username='slave'} at 127.0.0.1:34556
I20260811 16:37:54.745872 1648 tablet_replica.cc:330] T 519a709a97f344859985f9190cf7d79a P 43d42876e3634a308e5a34ba36435e9f: stopping tablet replica
I20260811 16:37:54.745975 1648 raft_consensus.cc:2229] T 519a709a97f344859985f9190cf7d79a P 43d42876e3634a308e5a34ba36435e9f [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:37:54.746038 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 916
I20260811 16:37:54.746063 1648 raft_consensus.cc:2258] T 519a709a97f344859985f9190cf7d79a P 43d42876e3634a308e5a34ba36435e9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:37:54.752018 1647 tablet_replica.cc:330] T 519a709a97f344859985f9190cf7d79a P 77661a31e9fe4677bfe8697ae8e145ac: stopping tablet replica
I20260811 16:37:54.752131 1647 raft_consensus.cc:2229] T 519a709a97f344859985f9190cf7d79a P 77661a31e9fe4677bfe8697ae8e145ac [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:37:54.752247 1647 raft_consensus.cc:2258] T 519a709a97f344859985f9190cf7d79a P 77661a31e9fe4677bfe8697ae8e145ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:37:54.753718 1647 ts_tablet_manager.cc:1905] T 519a709a97f344859985f9190cf7d79a P 77661a31e9fe4677bfe8697ae8e145ac: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:37:54.755385 1647 ts_tablet_manager.cc:1918] T 519a709a97f344859985f9190cf7d79a P 77661a31e9fe4677bfe8697ae8e145ac: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:37:54.755515 1647 log.cc:1196] T 519a709a97f344859985f9190cf7d79a P 77661a31e9fe4677bfe8697ae8e145ac: Deleting WAL directory at /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466249441839-25279-0/minicluster-data/ts-2/wal/wals/519a709a97f344859985f9190cf7d79a
I20260811 16:37:54.755779 1647 ts_tablet_manager.cc:1939] T 519a709a97f344859985f9190cf7d79a P 77661a31e9fe4677bfe8697ae8e145ac: Deleting consensus metadata
I20260811 16:37:54.756181 776 catalog_manager.cc:4841] TS 77661a31e9fe4677bfe8697ae8e145ac (127.24.175.195:45815): tablet 519a709a97f344859985f9190cf7d79a (table test-table [id=4244afca6a3340e8a5de529e685e09a0]) successfully deleted
W20260811 16:37:54.757681 777 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.24.175.193:40929 (error 108)
I20260811 16:37:54.758132 1598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:54.758008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.193:40929 (local address 127.0.0.1:56216)
0811 16:37:54.758061 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:54.758101 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.193:40929: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260811 16:37:54.758242 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 1131
W20260811 16:37:54.763721 777 catalog_manager.cc:4584] TS 5b96820b1f4b4a1fa7b2d61f7c257a77 (127.24.175.193:40929): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 519a709a97f344859985f9190cf7d79a: Network error: Client connection negotiation failed: client connection to 127.24.175.193:40929: connect: Connection refused (error 111)
I20260811 16:37:54.767354 1598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:54.767262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.194:36387 (local address 127.0.0.1:59654)
0811 16:37:54.767303 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:54.767326 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.194:36387: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260811 16:37:54.767366 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 1355
I20260811 16:37:54.774603 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 752
2026-08-11T16:37:54Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (668 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260811 16:37:54.799116 25279 mini_oidc.cc:152] Starting JWKS server
I20260811 16:37:54.800302 25279 webserver.cc:460] Webserver started at https://127.0.0.1:39961/ using document root <none> and password file <none>
I20260811 16:37:54.800396 25279 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 16:37:54.800565 25279 webserver.cc:460] Webserver started at http://127.0.0.1:44753/ using document root <none> and password file <none>
2026-08-11T16:37:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:37:54Z Disabled control of system clock
I20260811 16:37:54.808871 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786466249441839-25279-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786466249441839-25279-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786466249441839-25279-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:33101
--webserver_interface=127.24.175.254
--webserver_port=0
--builtin_ntp_servers=127.24.175.212:41799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.175.254:33101
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39961/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786466249441839-25279-0/testchainca.cert with env {}
W20260811 16:37:54.888537 1658 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:37:54.888732 1658 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:37:54.888754 1658 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:37:54.889907 1658 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:37:54.889947 1658 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:37:54.889961 1658 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:37:54.889984 1658 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:37:54.890029 1658 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 16:37:54.890044 1658 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 16:37:54.890067 1658 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:39961/jwks.json
I20260811 16:37:54.891662 1658 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:41799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786466249441839-25279-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786466249441839-25279-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.175.254:33101
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:33101
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39961/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.175.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786466249441839-25279-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1658
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786466249441839-25279-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:37:54.891883 1658 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:37:54.892068 1658 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:37:54.896852 1672 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:37:54.897022 1658 server_base.cc:1034] running on GCE node
W20260811 16:37:54.896790 1666 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:54.896898 1667 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:37:54.897441 1658 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:37:54.897717 1658 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:37:54.898854 1658 hybrid_clock.cc:648] HybridClock initialized: now 1786466274898840 us; error 27 us; skew 500 ppm
I20260811 16:37:54.900466 1658 webserver.cc:460] Webserver started at http://127.24.175.254:44335/ using document root <none> and password file <none>
I20260811 16:37:54.900681 1658 fs_manager.cc:359] Metadata directory not provided
I20260811 16:37:54.900729 1658 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:37:54.900848 1658 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:37:54.901799 1658 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786466249441839-25279-0/minicluster-data/master-0/data/instance:
uuid: "10025ef19adf4ad1bbabe2eebc4be62b"
format_stamp: "Formatted at 2026-08-11 16:37:54 on dist-test-slave-zj8q"
server_key: "91a978dbbaede52c65c995dba4fb6358"
server_key_iv: "57106c6c05096c7bf71a1ee4ca197669"
server_key_version: "encryptionkey@0"
I20260811 16:37:54.902117 1658 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786466249441839-25279-0/minicluster-data/master-0/wal/instance:
uuid: "10025ef19adf4ad1bbabe2eebc4be62b"
format_stamp: "Formatted at 2026-08-11 16:37:54 on dist-test-slave-zj8q"
server_key: "91a978dbbaede52c65c995dba4fb6358"
server_key_iv: "57106c6c05096c7bf71a1ee4ca197669"
server_key_version: "encryptionkey@0"
I20260811 16:37:54.903358 1658 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:37:54.903998 1683 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:54.904145 1658 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:37:54.904232 1658 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786466249441839-25279-0/minicluster-data/master-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786466249441839-25279-0/minicluster-data/master-0/wal
uuid: "10025ef19adf4ad1bbabe2eebc4be62b"
format_stamp: "Formatted at 2026-08-11 16:37:54 on dist-test-slave-zj8q"
server_key: "91a978dbbaede52c65c995dba4fb6358"
server_key_iv: "57106c6c05096c7bf71a1ee4ca197669"
server_key_version: "encryptionkey@0"
I20260811 16:37:54.904291 1658 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786466249441839-25279-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786466249441839-25279-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786466249441839-25279-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:37:54.918550 1658 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:37:54.918817 1658 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:37:54.918943 1658 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:37:54.922708 1658 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.254:33101
I20260811 16:37:54.922742 1780 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.254:33101 every 8 connection(s)
I20260811 16:37:54.923038 1658 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
I20260811 16:37:54.923938 1782 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:37:54.926137 1782 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10025ef19adf4ad1bbabe2eebc4be62b: Bootstrap starting.
I20260811 16:37:54.926712 1782 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 10025ef19adf4ad1bbabe2eebc4be62b: Neither blocks nor log segments found. Creating new log.
I20260811 16:37:54.926954 1782 log.cc:824] T 00000000000000000000000000000000 P 10025ef19adf4ad1bbabe2eebc4be62b: Log is configured to *not* fsync() on all Append() calls
I20260811 16:37:54.927528 1782 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10025ef19adf4ad1bbabe2eebc4be62b: No bootstrap required, opened a new log
I20260811 16:37:54.929296 1782 raft_consensus.cc:348] T 00000000000000000000000000000000 P 10025ef19adf4ad1bbabe2eebc4be62b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10025ef19adf4ad1bbabe2eebc4be62b" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 33101 } }
I20260811 16:37:54.929432 1782 raft_consensus.cc:374] T 00000000000000000000000000000000 P 10025ef19adf4ad1bbabe2eebc4be62b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:37:54.929455 1782 raft_consensus.cc:729] T 00000000000000000000000000000000 P 10025ef19adf4ad1bbabe2eebc4be62b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10025ef19adf4ad1bbabe2eebc4be62b, State: Initialized, Role: FOLLOWER
I20260811 16:37:54.929589 1782 consensus_queue.cc:260] T 00000000000000000000000000000000 P 10025ef19adf4ad1bbabe2eebc4be62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10025ef19adf4ad1bbabe2eebc4be62b" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 33101 } }
I20260811 16:37:54.929672 1782 raft_consensus.cc:388] T 00000000000000000000000000000000 P 10025ef19adf4ad1bbabe2eebc4be62b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:37:54.929702 1782 raft_consensus.cc:482] T 00000000000000000000000000000000 P 10025ef19adf4ad1bbabe2eebc4be62b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:37:54.929735 1782 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 10025ef19adf4ad1bbabe2eebc4be62b [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:37:54.930228 1782 raft_consensus.cc:504] T 00000000000000000000000000000000 P 10025ef19adf4ad1bbabe2eebc4be62b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10025ef19adf4ad1bbabe2eebc4be62b" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 33101 } }
I20260811 16:37:54.930313 1782 leader_election.cc:302] T 00000000000000000000000000000000 P 10025ef19adf4ad1bbabe2eebc4be62b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 10025ef19adf4ad1bbabe2eebc4be62b; no voters:
I20260811 16:37:54.930441 1782 leader_election.cc:288] T 00000000000000000000000000000000 P 10025ef19adf4ad1bbabe2eebc4be62b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:37:54.930500 1786 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 10025ef19adf4ad1bbabe2eebc4be62b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:37:54.930646 1786 raft_consensus.cc:686] T 00000000000000000000000000000000 P 10025ef19adf4ad1bbabe2eebc4be62b [term 1 LEADER]: Becoming Leader. State: Replica: 10025ef19adf4ad1bbabe2eebc4be62b, State: Running, Role: LEADER
I20260811 16:37:54.930666 1782 sys_catalog.cc:564] T 00000000000000000000000000000000 P 10025ef19adf4ad1bbabe2eebc4be62b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:37:54.930757 1786 consensus_queue.cc:237] T 00000000000000000000000000000000 P 10025ef19adf4ad1bbabe2eebc4be62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10025ef19adf4ad1bbabe2eebc4be62b" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 33101 } }
I20260811 16:37:54.931181 1787 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10025ef19adf4ad1bbabe2eebc4be62b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "10025ef19adf4ad1bbabe2eebc4be62b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10025ef19adf4ad1bbabe2eebc4be62b" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 33101 } } }
I20260811 16:37:54.931269 1787 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10025ef19adf4ad1bbabe2eebc4be62b [sys.catalog]: This master's current role is: LEADER
I20260811 16:37:54.931445 1789 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10025ef19adf4ad1bbabe2eebc4be62b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 10025ef19adf4ad1bbabe2eebc4be62b. Latest consensus state: current_term: 1 leader_uuid: "10025ef19adf4ad1bbabe2eebc4be62b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10025ef19adf4ad1bbabe2eebc4be62b" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 33101 } } }
I20260811 16:37:54.931473 1803 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:37:54.931515 1789 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10025ef19adf4ad1bbabe2eebc4be62b [sys.catalog]: This master's current role is: LEADER
I20260811 16:37:54.931991 1803 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:37:54.933221 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 1658
I20260811 16:37:54.933311 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786466249441839-25279-0/minicluster-data/master-0/wal/instance
I20260811 16:37:54.933490 25279 external_mini_cluster.cc:1428] Setting key bb8352f190c7cf064fe3bff18ed14972
I20260811 16:37:54.933602 1803 catalog_manager.cc:1347] Generated new cluster ID: 23249c8ed57a4837ba637dc27c770915
I20260811 16:37:54.934012 1803 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:37:54.938189 1826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:54.933875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45002 (local address 127.24.175.254:33101)
0811 16:37:54.934278 (+ 403us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:54.934285 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:54.934308 (+ 23us) server_negotiation.cc:407] Connection header received
0811 16:37:54.934399 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:54.934404 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:54.934451 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:54.934562 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:54.934767 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:54.935652 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:54.936409 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:54.936855 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:54.936962 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:54.937563 (+ 601us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:54.937567 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:54.937567 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:37:54.937746 (+ 179us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:54.937779 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:37:54.937789 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:54.937845 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:54.937919 (+ 74us) server_negotiation.cc:299] Negotiation successful
0811 16:37:54.937997 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":342,"thread_start_us":74,"threads_started":1}
I20260811 16:37:54.939105 25279 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:37:54.950109 1803 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:37:54.950580 1803 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:37:54.958461 1803 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 10025ef19adf4ad1bbabe2eebc4be62b: Generated new TSK 0
I20260811 16:37:54.958613 1803 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260811 16:37:54.991911 1837 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
I20260811 16:37:54.992043 1826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:54.969501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45012 (local address 127.24.175.254:33101)
0811 16:37:54.969554 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:54.969557 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:54.969684 (+ 127us) server_negotiation.cc:407] Connection header received
0811 16:37:54.969785 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:54.969785 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:54.969796 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:54.969848 (+ 52us) server_negotiation.cc:226] Negotiated authn=JWT
0811 16:37:54.969983 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:54.970485 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:54.971597 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:54.971781 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:54.971821 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:54.972007 (+ 186us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 16:37:54.991845 (+ 19838us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39961/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0811 16:37:54.991978 (+ 133us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:45012: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39961/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":32}
W20260811 16:37:54.992107 1826 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:45012: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39961/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260811 16:37:54.992462 1835 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:37:54.969439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:33101 (local address 127.0.0.1:45012)
0811 16:37:54.969618 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:54.969629 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:54.969697 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:54.969855 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:54.969856 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:54.969858 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0811 16:37:54.969931 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:54.969933 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:54.970551 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:54.970552 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:54.971521 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:54.971524 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:54.971836 (+ 312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:54.971837 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:54.971899 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:54.971920 (+ 21us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 16:37:54.991968 (+ 20048us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39961/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0811 16:37:54.992087 (+ 119us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.24.175.254:33101: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39961/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":80,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.24.175.254:33101: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39961/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260811 16:37:54.992903 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 1658
E20260811 16:37:54.992885 1837 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-11T16:37:55Z chronyd exiting
I20260811 16:37:55.034092 25279 test_util.cc:175] -----------------------------------------------
I20260811 16:37:55.034189 25279 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786466249441839-25279-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (236 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260811 16:37:55.035054 25279 mini_oidc.cc:152] Starting JWKS server
I20260811 16:37:55.035789 25279 webserver.cc:460] Webserver started at https://127.0.0.1:35911/ using document root <none> and password file <none>
I20260811 16:37:55.035835 25279 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 16:37:55.035971 25279 webserver.cc:460] Webserver started at http://127.0.0.1:45115/ using document root <none> and password file <none>
2026-08-11T16:37:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:37:55Z Disabled control of system clock
I20260811 16:37:55.043874 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786466249441839-25279-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786466249441839-25279-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786466249441839-25279-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:45579
--webserver_interface=127.24.175.254
--webserver_port=0
--builtin_ntp_servers=127.24.175.212:44617
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.175.254:45579
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35911/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786466249441839-25279-0/testchainca.cert with env {}
W20260811 16:37:55.125541 1848 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:37:55.125742 1848 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:37:55.125773 1848 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:37:55.126910 1848 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:37:55.126950 1848 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:37:55.126967 1848 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:37:55.126982 1848 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:37:55.126998 1848 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 16:37:55.127022 1848 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 16:37:55.127038 1848 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:35911/jwks.json
I20260811 16:37:55.128562 1848 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:44617
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786466249441839-25279-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786466249441839-25279-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.175.254:45579
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:45579
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35911/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.175.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786466249441839-25279-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1848
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786466249441839-25279-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:37:55.128808 1848 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:37:55.128994 1848 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:37:55.133459 1861 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:55.133483 1855 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:55.133545 1856 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:37:55.133872 1848 server_base.cc:1034] running on GCE node
I20260811 16:37:55.134109 1848 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:37:55.134398 1848 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:37:55.135540 1848 hybrid_clock.cc:648] HybridClock initialized: now 1786466275135526 us; error 25 us; skew 500 ppm
I20260811 16:37:55.136729 1848 webserver.cc:460] Webserver started at http://127.24.175.254:34411/ using document root <none> and password file <none>
I20260811 16:37:55.136932 1848 fs_manager.cc:359] Metadata directory not provided
I20260811 16:37:55.136981 1848 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:37:55.137096 1848 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:37:55.138072 1848 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786466249441839-25279-0/minicluster-data/master-0/data/instance:
uuid: "ce2ed2cd60d74faf94cba7dc106877c7"
format_stamp: "Formatted at 2026-08-11 16:37:55 on dist-test-slave-zj8q"
server_key: "a903a103b2c85242842bd246fd3ef3e9"
server_key_iv: "292e7b2f6a689bd97bd1d67acb563342"
server_key_version: "encryptionkey@0"
I20260811 16:37:55.138448 1848 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786466249441839-25279-0/minicluster-data/master-0/wal/instance:
uuid: "ce2ed2cd60d74faf94cba7dc106877c7"
format_stamp: "Formatted at 2026-08-11 16:37:55 on dist-test-slave-zj8q"
server_key: "a903a103b2c85242842bd246fd3ef3e9"
server_key_iv: "292e7b2f6a689bd97bd1d67acb563342"
server_key_version: "encryptionkey@0"
I20260811 16:37:55.139607 1848 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:37:55.140232 1871 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:55.140396 1848 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 16:37:55.140482 1848 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786466249441839-25279-0/minicluster-data/master-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786466249441839-25279-0/minicluster-data/master-0/wal
uuid: "ce2ed2cd60d74faf94cba7dc106877c7"
format_stamp: "Formatted at 2026-08-11 16:37:55 on dist-test-slave-zj8q"
server_key: "a903a103b2c85242842bd246fd3ef3e9"
server_key_iv: "292e7b2f6a689bd97bd1d67acb563342"
server_key_version: "encryptionkey@0"
I20260811 16:37:55.140547 1848 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786466249441839-25279-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786466249441839-25279-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786466249441839-25279-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:37:55.169051 1848 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:37:55.169330 1848 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:37:55.169459 1848 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:37:55.173225 1848 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.254:45579
I20260811 16:37:55.173260 1949 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.254:45579 every 8 connection(s)
I20260811 16:37:55.173566 1848 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
I20260811 16:37:55.174257 1950 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:37:55.176903 1950 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce2ed2cd60d74faf94cba7dc106877c7: Bootstrap starting.
I20260811 16:37:55.177434 1950 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ce2ed2cd60d74faf94cba7dc106877c7: Neither blocks nor log segments found. Creating new log.
I20260811 16:37:55.177670 1950 log.cc:824] T 00000000000000000000000000000000 P ce2ed2cd60d74faf94cba7dc106877c7: Log is configured to *not* fsync() on all Append() calls
I20260811 16:37:55.178056 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 1848
I20260811 16:37:55.178174 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786466249441839-25279-0/minicluster-data/master-0/wal/instance
I20260811 16:37:55.178392 25279 external_mini_cluster.cc:1428] Setting key 83298b2998e27868ae01f86cd714d9c3
I20260811 16:37:55.178422 1950 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce2ed2cd60d74faf94cba7dc106877c7: No bootstrap required, opened a new log
I20260811 16:37:55.180832 1950 raft_consensus.cc:348] T 00000000000000000000000000000000 P ce2ed2cd60d74faf94cba7dc106877c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce2ed2cd60d74faf94cba7dc106877c7" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 45579 } }
I20260811 16:37:55.180968 1950 raft_consensus.cc:374] T 00000000000000000000000000000000 P ce2ed2cd60d74faf94cba7dc106877c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:37:55.181002 1950 raft_consensus.cc:729] T 00000000000000000000000000000000 P ce2ed2cd60d74faf94cba7dc106877c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce2ed2cd60d74faf94cba7dc106877c7, State: Initialized, Role: FOLLOWER
I20260811 16:37:55.181125 1950 consensus_queue.cc:260] T 00000000000000000000000000000000 P ce2ed2cd60d74faf94cba7dc106877c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce2ed2cd60d74faf94cba7dc106877c7" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 45579 } }
I20260811 16:37:55.181201 1950 raft_consensus.cc:388] T 00000000000000000000000000000000 P ce2ed2cd60d74faf94cba7dc106877c7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:37:55.181245 1950 raft_consensus.cc:482] T 00000000000000000000000000000000 P ce2ed2cd60d74faf94cba7dc106877c7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:37:55.181293 1950 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ce2ed2cd60d74faf94cba7dc106877c7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:37:55.181929 1950 raft_consensus.cc:504] T 00000000000000000000000000000000 P ce2ed2cd60d74faf94cba7dc106877c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce2ed2cd60d74faf94cba7dc106877c7" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 45579 } }
I20260811 16:37:55.182029 1950 leader_election.cc:302] T 00000000000000000000000000000000 P ce2ed2cd60d74faf94cba7dc106877c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ce2ed2cd60d74faf94cba7dc106877c7; no voters:
I20260811 16:37:55.182183 1950 leader_election.cc:288] T 00000000000000000000000000000000 P ce2ed2cd60d74faf94cba7dc106877c7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:37:55.182217 1957 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ce2ed2cd60d74faf94cba7dc106877c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:37:55.182332 1957 raft_consensus.cc:686] T 00000000000000000000000000000000 P ce2ed2cd60d74faf94cba7dc106877c7 [term 1 LEADER]: Becoming Leader. State: Replica: ce2ed2cd60d74faf94cba7dc106877c7, State: Running, Role: LEADER
I20260811 16:37:55.182412 1957 consensus_queue.cc:237] T 00000000000000000000000000000000 P ce2ed2cd60d74faf94cba7dc106877c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce2ed2cd60d74faf94cba7dc106877c7" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 45579 } }
I20260811 16:37:55.182449 1950 sys_catalog.cc:564] T 00000000000000000000000000000000 P ce2ed2cd60d74faf94cba7dc106877c7 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:37:55.182755 1957 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce2ed2cd60d74faf94cba7dc106877c7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ce2ed2cd60d74faf94cba7dc106877c7. Latest consensus state: current_term: 1 leader_uuid: "ce2ed2cd60d74faf94cba7dc106877c7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce2ed2cd60d74faf94cba7dc106877c7" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 45579 } } }
I20260811 16:37:55.182762 1959 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce2ed2cd60d74faf94cba7dc106877c7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ce2ed2cd60d74faf94cba7dc106877c7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce2ed2cd60d74faf94cba7dc106877c7" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 45579 } } }
I20260811 16:37:55.182899 1959 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce2ed2cd60d74faf94cba7dc106877c7 [sys.catalog]: This master's current role is: LEADER
I20260811 16:37:55.183086 1975 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:37:55.182835 1957 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce2ed2cd60d74faf94cba7dc106877c7 [sys.catalog]: This master's current role is: LEADER
I20260811 16:37:55.183609 1975 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:37:55.184662 1956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:55.178907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54586 (local address 127.24.175.254:45579)
0811 16:37:55.179099 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:55.179106 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:55.179130 (+ 24us) server_negotiation.cc:407] Connection header received
0811 16:37:55.179651 (+ 521us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:55.179658 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:55.179721 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:55.179830 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:55.180058 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:55.180918 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:55.181974 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:55.182655 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:55.183529 (+ 874us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:55.183729 (+ 200us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:55.183733 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:55.183733 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:37:55.183978 (+ 245us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:55.184024 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:37:55.184039 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:55.184128 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:55.184199 (+ 71us) server_negotiation.cc:299] Negotiation successful
0811 16:37:55.184457 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":67,"threads_started":1}
I20260811 16:37:55.185562 1975 catalog_manager.cc:1347] Generated new cluster ID: 1d267ede27a9494bb8a499cd5f39a282
I20260811 16:37:55.185616 1975 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:37:55.185593 25279 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:37:55.198753 1975 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:37:55.199414 1975 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:37:55.204890 1975 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ce2ed2cd60d74faf94cba7dc106877c7: Generated new TSK 0
I20260811 16:37:55.205052 1975 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260811 16:37:55.224972 2006 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260811 16:37:55.225042 2006 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260811 16:37:55.225342 1956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:55.211457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54594 (local address 127.24.175.254:45579)
0811 16:37:55.211508 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:55.211510 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:55.211564 (+ 54us) server_negotiation.cc:407] Connection header received
0811 16:37:55.211611 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:55.211613 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:55.211625 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:55.211707 (+ 82us) server_negotiation.cc:226] Negotiated authn=JWT
0811 16:37:55.211798 (+ 91us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:55.212578 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:55.213300 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:55.213622 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:55.213685 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:55.213817 (+ 132us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 16:37:55.225141 (+ 11324us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35911/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0811 16:37:55.225277 (+ 136us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:54594: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35911/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":31}
W20260811 16:37:55.225386 2005 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:37:55.211365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:45579 (local address 127.0.0.1:54594)
0811 16:37:55.211500 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:55.211509 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:55.211562 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:55.211704 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:55.211704 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:55.211706 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0811 16:37:55.211750 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:55.211752 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:55.212660 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:55.212661 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:55.213234 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:55.213236 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:55.213699 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:55.213700 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:55.213738 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:55.213742 (+ 4us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 16:37:55.225230 (+ 11488us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35911/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0811 16:37:55.225313 (+ 83us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.24.175.254:45579: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35911/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":62,"threads_started":1}
W20260811 16:37:55.225397 1956 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:54594: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35911/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
I20260811 16:37:55.225621 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 1848
2026-08-11T16:37:55Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (238 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260811 16:37:55.273536 25279 mini_oidc.cc:152] Starting JWKS server
I20260811 16:37:55.274222 25279 webserver.cc:460] Webserver started at https://127.0.0.1:44455/ using document root <none> and password file <none>
I20260811 16:37:55.274268 25279 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 16:37:55.274405 25279 webserver.cc:460] Webserver started at http://127.0.0.1:46493/ using document root <none> and password file <none>
2026-08-11T16:37:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:37:55Z Disabled control of system clock
I20260811 16:37:55.282537 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786466249441839-25279-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786466249441839-25279-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786466249441839-25279-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:44187
--webserver_interface=127.24.175.254
--webserver_port=0
--builtin_ntp_servers=127.24.175.212:41751
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.175.254:44187
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44455/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260811 16:37:55.363021 2015 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:37:55.363214 2015 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:37:55.363233 2015 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:37:55.364333 2015 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:37:55.364369 2015 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:37:55.364382 2015 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:37:55.364392 2015 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:37:55.364406 2015 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 16:37:55.364418 2015 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 16:37:55.364432 2015 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:44455/jwks.json
I20260811 16:37:55.365753 2015 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:41751
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786466249441839-25279-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786466249441839-25279-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.175.254:44187
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:44187
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44455/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2015
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786466249441839-25279-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:37:55.365975 2015 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:37:55.366240 2015 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:37:55.370710 2023 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:55.370702 2021 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:55.370700 2020 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:37:55.371193 2015 server_base.cc:1034] running on GCE node
I20260811 16:37:55.371417 2015 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:37:55.371686 2015 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:37:55.372824 2015 hybrid_clock.cc:648] HybridClock initialized: now 1786466275372821 us; error 30 us; skew 500 ppm
I20260811 16:37:55.373935 2015 webserver.cc:460] Webserver started at http://127.24.175.254:33573/ using document root <none> and password file <none>
I20260811 16:37:55.374172 2015 fs_manager.cc:359] Metadata directory not provided
I20260811 16:37:55.374233 2015 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:37:55.374359 2015 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:37:55.375367 2015 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786466249441839-25279-0/minicluster-data/master-0/data/instance:
uuid: "226a2d7e5dbc4969a8c922687fd9db05"
format_stamp: "Formatted at 2026-08-11 16:37:55 on dist-test-slave-zj8q"
server_key: "310488a42030399fde27cb7cd5faeb78"
server_key_iv: "cab5c29265d3eee3417c166d07b4977b"
server_key_version: "encryptionkey@0"
I20260811 16:37:55.375705 2015 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786466249441839-25279-0/minicluster-data/master-0/wal/instance:
uuid: "226a2d7e5dbc4969a8c922687fd9db05"
format_stamp: "Formatted at 2026-08-11 16:37:55 on dist-test-slave-zj8q"
server_key: "310488a42030399fde27cb7cd5faeb78"
server_key_iv: "cab5c29265d3eee3417c166d07b4977b"
server_key_version: "encryptionkey@0"
I20260811 16:37:55.376865 2015 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:37:55.377507 2032 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:55.377660 2015 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:37:55.377750 2015 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786466249441839-25279-0/minicluster-data/master-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786466249441839-25279-0/minicluster-data/master-0/wal
uuid: "226a2d7e5dbc4969a8c922687fd9db05"
format_stamp: "Formatted at 2026-08-11 16:37:55 on dist-test-slave-zj8q"
server_key: "310488a42030399fde27cb7cd5faeb78"
server_key_iv: "cab5c29265d3eee3417c166d07b4977b"
server_key_version: "encryptionkey@0"
I20260811 16:37:55.377816 2015 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786466249441839-25279-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786466249441839-25279-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786466249441839-25279-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:37:55.400329 2015 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:37:55.400604 2015 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:37:55.400734 2015 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:37:55.404445 2015 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.254:44187
I20260811 16:37:55.404481 2125 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.254:44187 every 8 connection(s)
I20260811 16:37:55.404793 2015 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
I20260811 16:37:55.405432 2126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:37:55.406533 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 2015
I20260811 16:37:55.406638 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786466249441839-25279-0/minicluster-data/master-0/wal/instance
I20260811 16:37:55.406824 25279 external_mini_cluster.cc:1428] Setting key 1b2ea28e0a1a13b5f40de156ffd0c152
I20260811 16:37:55.408691 2126 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 226a2d7e5dbc4969a8c922687fd9db05: Bootstrap starting.
I20260811 16:37:55.409291 2126 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 226a2d7e5dbc4969a8c922687fd9db05: Neither blocks nor log segments found. Creating new log.
I20260811 16:37:55.409554 2126 log.cc:824] T 00000000000000000000000000000000 P 226a2d7e5dbc4969a8c922687fd9db05: Log is configured to *not* fsync() on all Append() calls
I20260811 16:37:55.410216 2126 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 226a2d7e5dbc4969a8c922687fd9db05: No bootstrap required, opened a new log
I20260811 16:37:55.411846 2130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:55.407403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38720 (local address 127.24.175.254:44187)
0811 16:37:55.407585 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:55.407592 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:55.407615 (+ 23us) server_negotiation.cc:407] Connection header received
0811 16:37:55.408027 (+ 412us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:55.408034 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:55.408093 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:55.408210 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:55.408419 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:55.409298 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:55.410059 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:55.410529 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:55.410632 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:55.411281 (+ 649us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:55.411285 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:55.411285 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:37:55.411437 (+ 152us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:55.411468 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:37:55.411478 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:55.411530 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:55.411614 (+ 84us) server_negotiation.cc:299] Negotiation successful
0811 16:37:55.411690 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":83,"threads_started":1}
I20260811 16:37:55.412174 2126 raft_consensus.cc:348] T 00000000000000000000000000000000 P 226a2d7e5dbc4969a8c922687fd9db05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "226a2d7e5dbc4969a8c922687fd9db05" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 44187 } }
I20260811 16:37:55.412307 2126 raft_consensus.cc:374] T 00000000000000000000000000000000 P 226a2d7e5dbc4969a8c922687fd9db05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:37:55.412339 2126 raft_consensus.cc:729] T 00000000000000000000000000000000 P 226a2d7e5dbc4969a8c922687fd9db05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 226a2d7e5dbc4969a8c922687fd9db05, State: Initialized, Role: FOLLOWER
I20260811 16:37:55.412462 2126 consensus_queue.cc:260] T 00000000000000000000000000000000 P 226a2d7e5dbc4969a8c922687fd9db05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "226a2d7e5dbc4969a8c922687fd9db05" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 44187 } }
I20260811 16:37:55.412539 2126 raft_consensus.cc:388] T 00000000000000000000000000000000 P 226a2d7e5dbc4969a8c922687fd9db05 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:37:55.412562 2126 raft_consensus.cc:482] T 00000000000000000000000000000000 P 226a2d7e5dbc4969a8c922687fd9db05 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:37:55.412608 2126 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 226a2d7e5dbc4969a8c922687fd9db05 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:37:55.412752 25279 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:37:55.413152 2126 raft_consensus.cc:504] T 00000000000000000000000000000000 P 226a2d7e5dbc4969a8c922687fd9db05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "226a2d7e5dbc4969a8c922687fd9db05" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 44187 } }
I20260811 16:37:55.413246 2126 leader_election.cc:302] T 00000000000000000000000000000000 P 226a2d7e5dbc4969a8c922687fd9db05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 226a2d7e5dbc4969a8c922687fd9db05; no voters:
I20260811 16:37:55.413410 2126 leader_election.cc:288] T 00000000000000000000000000000000 P 226a2d7e5dbc4969a8c922687fd9db05 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:37:55.413443 2135 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 226a2d7e5dbc4969a8c922687fd9db05 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:37:55.413542 2135 raft_consensus.cc:686] T 00000000000000000000000000000000 P 226a2d7e5dbc4969a8c922687fd9db05 [term 1 LEADER]: Becoming Leader. State: Replica: 226a2d7e5dbc4969a8c922687fd9db05, State: Running, Role: LEADER
I20260811 16:37:55.413614 2135 consensus_queue.cc:237] T 00000000000000000000000000000000 P 226a2d7e5dbc4969a8c922687fd9db05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "226a2d7e5dbc4969a8c922687fd9db05" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 44187 } }
I20260811 16:37:55.413666 2126 sys_catalog.cc:564] T 00000000000000000000000000000000 P 226a2d7e5dbc4969a8c922687fd9db05 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:37:55.413926 2135 sys_catalog.cc:455] T 00000000000000000000000000000000 P 226a2d7e5dbc4969a8c922687fd9db05 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 226a2d7e5dbc4969a8c922687fd9db05. Latest consensus state: current_term: 1 leader_uuid: "226a2d7e5dbc4969a8c922687fd9db05" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "226a2d7e5dbc4969a8c922687fd9db05" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 44187 } } }
I20260811 16:37:55.413998 2135 sys_catalog.cc:458] T 00000000000000000000000000000000 P 226a2d7e5dbc4969a8c922687fd9db05 [sys.catalog]: This master's current role is: LEADER
I20260811 16:37:55.413959 2136 sys_catalog.cc:455] T 00000000000000000000000000000000 P 226a2d7e5dbc4969a8c922687fd9db05 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "226a2d7e5dbc4969a8c922687fd9db05" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "226a2d7e5dbc4969a8c922687fd9db05" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 44187 } } }
I20260811 16:37:55.414141 2136 sys_catalog.cc:458] T 00000000000000000000000000000000 P 226a2d7e5dbc4969a8c922687fd9db05 [sys.catalog]: This master's current role is: LEADER
W20260811 16:37:55.415299 2163 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 226a2d7e5dbc4969a8c922687fd9db05: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 16:37:55.415341 2163 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 16:37:55.415410 2145 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:37:55.415591 2145 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:37:55.416970 2145 catalog_manager.cc:1347] Generated new cluster ID: 31b7382f847d412b964853c4e54b2c20
I20260811 16:37:55.417011 2145 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:37:55.428325 2145 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:37:55.428750 2145 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:37:55.430576 2145 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 226a2d7e5dbc4969a8c922687fd9db05: Generated new TSK 0
I20260811 16:37:55.430713 2145 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:37:55.439612 2130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:55.436580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38732 (local address 127.24.175.254:44187)
0811 16:37:55.436633 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:55.436635 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:55.436725 (+ 90us) server_negotiation.cc:407] Connection header received
0811 16:37:55.436792 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:55.436793 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:55.436804 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:55.436863 (+ 59us) server_negotiation.cc:226] Negotiated authn=JWT
0811 16:37:55.436983 (+ 120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:55.437468 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:55.438231 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:55.438437 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:55.438490 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:55.438645 (+ 155us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 16:37:55.439431 (+ 786us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44455/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0811 16:37:55.439551 (+ 120us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:38732: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44455/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":31}
W20260811 16:37:55.439662 2130 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:38732: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44455/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260811 16:37:55.439741 2181 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:37:55.436522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:44187 (local address 127.0.0.1:38732)
0811 16:37:55.436668 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:55.436676 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:55.436738 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:55.436869 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:55.436870 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:55.436872 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0811 16:37:55.436931 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:55.436933 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:55.437547 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:55.437548 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:55.438130 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:55.438132 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:55.438503 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:55.438505 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:55.438566 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:55.438570 (+ 4us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 16:37:55.439527 (+ 957us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44455/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0811 16:37:55.439633 (+ 106us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.24.175.254:44187: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44455/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":79,"threads_started":1}
I20260811 16:37:55.440054 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 2015
E20260811 16:37:55.457127 2182 webserver.cc:533] Webserver: sslize failed:
E20260811 16:37:55.457191 2182 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-11T16:37:55Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (214 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-11T16:37:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:37:55Z Disabled control of system clock
I20260811 16:37:55.496181 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786466249441839-25279-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786466249441839-25279-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786466249441839-25279-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:36977
--webserver_interface=127.24.175.254
--webserver_port=0
--builtin_ntp_servers=127.24.175.212:37857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.175.254:36977
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786466249441839-25279-0/testchainca.cert with env {}
W20260811 16:37:55.575367 2188 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:37:55.575583 2188 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:37:55.575615 2188 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:37:55.576776 2188 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:37:55.576818 2188 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:37:55.576834 2188 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:37:55.576850 2188 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:37:55.576865 2188 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 16:37:55.576882 2188 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 16:37:55.576903 2188 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260811 16:37:55.578476 2188 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:37857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786466249441839-25279-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786466249441839-25279-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.175.254:36977
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:36977
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.175.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786466249441839-25279-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2188
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786466249441839-25279-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:37:55.578745 2188 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:37:55.578943 2188 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:37:55.583597 2196 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:37:55.583719 2188 server_base.cc:1034] running on GCE node
W20260811 16:37:55.583606 2197 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:55.583681 2201 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:37:55.584062 2188 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:37:55.584369 2188 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:37:55.585512 2188 hybrid_clock.cc:648] HybridClock initialized: now 1786466275585492 us; error 32 us; skew 500 ppm
I20260811 16:37:55.586727 2188 webserver.cc:460] Webserver started at http://127.24.175.254:39533/ using document root <none> and password file <none>
I20260811 16:37:55.586949 2188 fs_manager.cc:359] Metadata directory not provided
I20260811 16:37:55.587000 2188 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:37:55.587127 2188 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:37:55.588162 2188 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786466249441839-25279-0/minicluster-data/master-0/data/instance:
uuid: "668525522fb44d59a3025f0e7c631b8f"
format_stamp: "Formatted at 2026-08-11 16:37:55 on dist-test-slave-zj8q"
server_key: "c3adf591718dfc099e822039146ab6e0"
server_key_iv: "4ecf8962fac14c873e1efa2188b97762"
server_key_version: "encryptionkey@0"
I20260811 16:37:55.588490 2188 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786466249441839-25279-0/minicluster-data/master-0/wal/instance:
uuid: "668525522fb44d59a3025f0e7c631b8f"
format_stamp: "Formatted at 2026-08-11 16:37:55 on dist-test-slave-zj8q"
server_key: "c3adf591718dfc099e822039146ab6e0"
server_key_iv: "4ecf8962fac14c873e1efa2188b97762"
server_key_version: "encryptionkey@0"
I20260811 16:37:55.589761 2188 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 16:37:55.590480 2216 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:55.590637 2188 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:55.590723 2188 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786466249441839-25279-0/minicluster-data/master-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786466249441839-25279-0/minicluster-data/master-0/wal
uuid: "668525522fb44d59a3025f0e7c631b8f"
format_stamp: "Formatted at 2026-08-11 16:37:55 on dist-test-slave-zj8q"
server_key: "c3adf591718dfc099e822039146ab6e0"
server_key_iv: "4ecf8962fac14c873e1efa2188b97762"
server_key_version: "encryptionkey@0"
I20260811 16:37:55.590801 2188 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786466249441839-25279-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786466249441839-25279-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786466249441839-25279-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:37:55.611740 2188 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:37:55.612056 2188 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:37:55.612196 2188 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:37:55.615993 2188 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.254:36977
I20260811 16:37:55.616029 2322 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.254:36977 every 8 connection(s)
I20260811 16:37:55.616353 2188 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
I20260811 16:37:55.617314 2326 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:37:55.619627 2326 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 668525522fb44d59a3025f0e7c631b8f: Bootstrap starting.
I20260811 16:37:55.620090 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 2188
I20260811 16:37:55.620203 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786466249441839-25279-0/minicluster-data/master-0/wal/instance
I20260811 16:37:55.620296 2326 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 668525522fb44d59a3025f0e7c631b8f: Neither blocks nor log segments found. Creating new log.
I20260811 16:37:55.620404 25279 external_mini_cluster.cc:1428] Setting key e987dfbb5ba7d623b4a80a133e409cca
I20260811 16:37:55.620608 2326 log.cc:824] T 00000000000000000000000000000000 P 668525522fb44d59a3025f0e7c631b8f: Log is configured to *not* fsync() on all Append() calls
I20260811 16:37:55.621304 2326 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 668525522fb44d59a3025f0e7c631b8f: No bootstrap required, opened a new log
I20260811 16:37:55.623240 2326 raft_consensus.cc:348] T 00000000000000000000000000000000 P 668525522fb44d59a3025f0e7c631b8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "668525522fb44d59a3025f0e7c631b8f" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 36977 } }
I20260811 16:37:55.623373 2326 raft_consensus.cc:374] T 00000000000000000000000000000000 P 668525522fb44d59a3025f0e7c631b8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:37:55.623406 2326 raft_consensus.cc:729] T 00000000000000000000000000000000 P 668525522fb44d59a3025f0e7c631b8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 668525522fb44d59a3025f0e7c631b8f, State: Initialized, Role: FOLLOWER
I20260811 16:37:55.623525 2326 consensus_queue.cc:260] T 00000000000000000000000000000000 P 668525522fb44d59a3025f0e7c631b8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "668525522fb44d59a3025f0e7c631b8f" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 36977 } }
I20260811 16:37:55.623611 2326 raft_consensus.cc:388] T 00000000000000000000000000000000 P 668525522fb44d59a3025f0e7c631b8f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:37:55.623644 2326 raft_consensus.cc:482] T 00000000000000000000000000000000 P 668525522fb44d59a3025f0e7c631b8f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:37:55.623692 2326 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 668525522fb44d59a3025f0e7c631b8f [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:37:55.624191 2326 raft_consensus.cc:504] T 00000000000000000000000000000000 P 668525522fb44d59a3025f0e7c631b8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "668525522fb44d59a3025f0e7c631b8f" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 36977 } }
I20260811 16:37:55.624295 2326 leader_election.cc:302] T 00000000000000000000000000000000 P 668525522fb44d59a3025f0e7c631b8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 668525522fb44d59a3025f0e7c631b8f; no voters:
I20260811 16:37:55.624454 2326 leader_election.cc:288] T 00000000000000000000000000000000 P 668525522fb44d59a3025f0e7c631b8f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:37:55.624500 2335 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 668525522fb44d59a3025f0e7c631b8f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:37:55.624611 2335 raft_consensus.cc:686] T 00000000000000000000000000000000 P 668525522fb44d59a3025f0e7c631b8f [term 1 LEADER]: Becoming Leader. State: Replica: 668525522fb44d59a3025f0e7c631b8f, State: Running, Role: LEADER
I20260811 16:37:55.624711 2326 sys_catalog.cc:564] T 00000000000000000000000000000000 P 668525522fb44d59a3025f0e7c631b8f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:37:55.624692 2335 consensus_queue.cc:237] T 00000000000000000000000000000000 P 668525522fb44d59a3025f0e7c631b8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "668525522fb44d59a3025f0e7c631b8f" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 36977 } }
I20260811 16:37:55.625061 2337 sys_catalog.cc:455] T 00000000000000000000000000000000 P 668525522fb44d59a3025f0e7c631b8f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 668525522fb44d59a3025f0e7c631b8f. Latest consensus state: current_term: 1 leader_uuid: "668525522fb44d59a3025f0e7c631b8f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "668525522fb44d59a3025f0e7c631b8f" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 36977 } } }
I20260811 16:37:55.625151 2337 sys_catalog.cc:458] T 00000000000000000000000000000000 P 668525522fb44d59a3025f0e7c631b8f [sys.catalog]: This master's current role is: LEADER
I20260811 16:37:55.625401 2336 sys_catalog.cc:455] T 00000000000000000000000000000000 P 668525522fb44d59a3025f0e7c631b8f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "668525522fb44d59a3025f0e7c631b8f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "668525522fb44d59a3025f0e7c631b8f" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 36977 } } }
I20260811 16:37:55.625483 2336 sys_catalog.cc:458] T 00000000000000000000000000000000 P 668525522fb44d59a3025f0e7c631b8f [sys.catalog]: This master's current role is: LEADER
I20260811 16:37:55.625406 2344 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:37:55.625818 2333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:55.620889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46976 (local address 127.24.175.254:36977)
0811 16:37:55.621131 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:55.621139 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:55.621171 (+ 32us) server_negotiation.cc:407] Connection header received
0811 16:37:55.621627 (+ 456us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:55.621634 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:55.621694 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:55.621814 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:55.622026 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:55.622936 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:55.623777 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:55.624197 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:55.624307 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:55.625009 (+ 702us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:55.625014 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:55.625014 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:37:55.625227 (+ 213us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:55.625272 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:37:55.625290 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:55.625353 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:55.625545 (+ 192us) server_negotiation.cc:299] Negotiation successful
0811 16:37:55.625629 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":76,"threads_started":1}
I20260811 16:37:55.625979 2344 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:37:55.626778 25279 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:37:55.631116 2344 catalog_manager.cc:1347] Generated new cluster ID: b60993d896f64bd99a7b0368850aa7f1
I20260811 16:37:55.631179 2344 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:37:55.653847 2344 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:37:55.654601 2344 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:37:55.659049 2344 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 668525522fb44d59a3025f0e7c631b8f: Generated new TSK 0
I20260811 16:37:55.659232 2344 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:37:55.765264 2333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:55.670040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46992 (local address 127.24.175.254:36977)
0811 16:37:55.670096 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:55.670098 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:55.670175 (+ 77us) server_negotiation.cc:407] Connection header received
0811 16:37:55.670235 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:55.670236 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:55.670248 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:55.670319 (+ 71us) server_negotiation.cc:226] Negotiated authn=JWT
0811 16:37:55.670416 (+ 97us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:55.671215 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:55.671921 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:55.672239 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:55.672307 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:55.672410 (+ 103us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 16:37:55.765027 (+ 92617us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0811 16:37:55.765204 (+ 177us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:46992: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":33}
W20260811 16:37:55.765333 2333 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:46992: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260811 16:37:55.765386 2376 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:37:55.669957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:36977 (local address 127.0.0.1:46992)
0811 16:37:55.670098 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:55.670107 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:55.670174 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:55.670327 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:55.670328 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:55.670330 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0811 16:37:55.670379 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:55.670381 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:55.671280 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:55.671280 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:55.671857 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:55.671858 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:55.672306 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:55.672307 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:55.672342 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:55.672346 (+ 4us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 16:37:55.765166 (+ 92820us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0811 16:37:55.765303 (+ 137us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.24.175.254:36977: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":82,"threads_started":1}
I20260811 16:37:55.765715 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 2188
2026-08-11T16:37:55Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (303 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (88 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (88 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:37:56 dist-test-slave-zj8q krb5kdc[2398](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:37:56 dist-test-slave-zj8q krb5kdc[2398](info): set up 2 sockets
Aug 11 16:37:56 dist-test-slave-zj8q krb5kdc[2398](info): commencing operation
krb5kdc: starting...
W20260811 16:37:57.109903 25279 mini_kdc.cc:121] Time spent starting KDC: real 1.140s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Aug 11 16:37:57 dist-test-slave-zj8q krb5kdc[2398](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466277, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:37:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:37:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab.
Entry for principal kudu/127.24.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab.
I20260811 16:37:57.222827 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:35605
--webserver_interface=127.24.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:40001
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.175.254:35605
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:37:57.302958 2420 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:37:57.303161 2420 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:37:57.303184 2420 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:37:57.304386 2420 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:37:57.304425 2420 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:37:57.304438 2420 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:37:57.304450 2420 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:37:57.304466 2420 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:37:57.305962 2420 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:40001
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.175.254:35605
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:35605
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2420
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:37:57.306172 2420 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:37:57.306348 2420 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:37:57.310963 2430 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:57.310978 2428 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:57.310967 2434 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:37:57.311077 2420 server_base.cc:1034] running on GCE node
I20260811 16:37:57.311357 2420 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:37:57.311640 2420 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:37:57.312809 2420 hybrid_clock.cc:648] HybridClock initialized: now 1786466277312791 us; error 27 us; skew 500 ppm
Aug 11 16:37:57 dist-test-slave-zj8q krb5kdc[2398](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466277, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:37:57.318929 2420 init.cc:377] Logged in from keytab as kudu/127.24.175.254@KRBTEST.COM (short username kudu)
I20260811 16:37:57.319355 2420 webserver.cc:460] Webserver started at http://127.24.175.254:45197/ using document root <none> and password file <none>
I20260811 16:37:57.319557 2420 fs_manager.cc:359] Metadata directory not provided
I20260811 16:37:57.319597 2420 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:37:57.319687 2420 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:37:57.320653 2420 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/minicluster-data/master-0/data/instance:
uuid: "4d847362112f4b1e99e9de42aefdcadc"
format_stamp: "Formatted at 2026-08-11 16:37:57 on dist-test-slave-zj8q"
server_key: "f5a7c9cfd359a87868d785dad6133b8d"
server_key_iv: "9f2e844b9e5be8070a9785908dcdb9e2"
server_key_version: "encryptionkey@0"
I20260811 16:37:57.320938 2420 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/minicluster-data/master-0/wal/instance:
uuid: "4d847362112f4b1e99e9de42aefdcadc"
format_stamp: "Formatted at 2026-08-11 16:37:57 on dist-test-slave-zj8q"
server_key: "f5a7c9cfd359a87868d785dad6133b8d"
server_key_iv: "9f2e844b9e5be8070a9785908dcdb9e2"
server_key_version: "encryptionkey@0"
I20260811 16:37:57.322098 2420 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 16:37:57.322796 2453 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:57.322942 2420 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 16:37:57.323020 2420 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/minicluster-data/master-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/minicluster-data/master-0/wal
uuid: "4d847362112f4b1e99e9de42aefdcadc"
format_stamp: "Formatted at 2026-08-11 16:37:57 on dist-test-slave-zj8q"
server_key: "f5a7c9cfd359a87868d785dad6133b8d"
server_key_iv: "9f2e844b9e5be8070a9785908dcdb9e2"
server_key_version: "encryptionkey@0"
I20260811 16:37:57.323083 2420 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:37:57.332144 2420 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:37:57.334067 2420 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:37:57.334218 2420 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:37:57.337906 2420 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.254:35605
I20260811 16:37:57.337940 2555 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.254:35605 every 8 connection(s)
I20260811 16:37:57.338277 2420 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
I20260811 16:37:57.339145 2557 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:37:57.341343 2557 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d847362112f4b1e99e9de42aefdcadc: Bootstrap starting.
I20260811 16:37:57.341905 2557 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4d847362112f4b1e99e9de42aefdcadc: Neither blocks nor log segments found. Creating new log.
I20260811 16:37:57.342200 2557 log.cc:824] T 00000000000000000000000000000000 P 4d847362112f4b1e99e9de42aefdcadc: Log is configured to *not* fsync() on all Append() calls
I20260811 16:37:57.342828 2557 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d847362112f4b1e99e9de42aefdcadc: No bootstrap required, opened a new log
I20260811 16:37:57.344383 2557 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4d847362112f4b1e99e9de42aefdcadc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d847362112f4b1e99e9de42aefdcadc" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 35605 } }
I20260811 16:37:57.344517 2557 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4d847362112f4b1e99e9de42aefdcadc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:37:57.344551 2557 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4d847362112f4b1e99e9de42aefdcadc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d847362112f4b1e99e9de42aefdcadc, State: Initialized, Role: FOLLOWER
I20260811 16:37:57.344688 2557 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4d847362112f4b1e99e9de42aefdcadc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d847362112f4b1e99e9de42aefdcadc" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 35605 } }
I20260811 16:37:57.344764 2557 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4d847362112f4b1e99e9de42aefdcadc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:37:57.344796 2557 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4d847362112f4b1e99e9de42aefdcadc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:37:57.344844 2557 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4d847362112f4b1e99e9de42aefdcadc [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:37:57.345338 2557 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4d847362112f4b1e99e9de42aefdcadc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d847362112f4b1e99e9de42aefdcadc" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 35605 } }
I20260811 16:37:57.345436 2557 leader_election.cc:302] T 00000000000000000000000000000000 P 4d847362112f4b1e99e9de42aefdcadc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4d847362112f4b1e99e9de42aefdcadc; no voters:
I20260811 16:37:57.345607 2557 leader_election.cc:288] T 00000000000000000000000000000000 P 4d847362112f4b1e99e9de42aefdcadc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:37:57.345638 2562 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4d847362112f4b1e99e9de42aefdcadc [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:37:57.345855 2557 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4d847362112f4b1e99e9de42aefdcadc [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:37:57.345932 2562 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4d847362112f4b1e99e9de42aefdcadc [term 1 LEADER]: Becoming Leader. State: Replica: 4d847362112f4b1e99e9de42aefdcadc, State: Running, Role: LEADER
I20260811 16:37:57.346028 2562 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4d847362112f4b1e99e9de42aefdcadc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d847362112f4b1e99e9de42aefdcadc" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 35605 } }
I20260811 16:37:57.346369 2563 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d847362112f4b1e99e9de42aefdcadc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4d847362112f4b1e99e9de42aefdcadc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d847362112f4b1e99e9de42aefdcadc" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 35605 } } }
I20260811 16:37:57.346390 2565 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d847362112f4b1e99e9de42aefdcadc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4d847362112f4b1e99e9de42aefdcadc. Latest consensus state: current_term: 1 leader_uuid: "4d847362112f4b1e99e9de42aefdcadc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d847362112f4b1e99e9de42aefdcadc" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 35605 } } }
I20260811 16:37:57.346446 2563 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d847362112f4b1e99e9de42aefdcadc [sys.catalog]: This master's current role is: LEADER
I20260811 16:37:57.346472 2565 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d847362112f4b1e99e9de42aefdcadc [sys.catalog]: This master's current role is: LEADER
I20260811 16:37:57.346756 2575 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:37:57.347014 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 2420
I20260811 16:37:57.347110 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/minicluster-data/master-0/wal/instance
I20260811 16:37:57.347232 2575 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:37:57.347275 25279 external_mini_cluster.cc:1428] Setting key df8de3e5f973825242fdaff0fc3911a7
I20260811 16:37:57.348779 2575 catalog_manager.cc:1347] Generated new cluster ID: caa25206be3646d88732718429ff041d
I20260811 16:37:57.348834 2575 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 16:37:57 dist-test-slave-zj8q krb5kdc[2398](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466277, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:37:57.356572 2595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:57.347843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45374 (local address 127.24.175.254:35605)
0811 16:37:57.348252 (+ 409us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:57.348261 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:57.348292 (+ 31us) server_negotiation.cc:407] Connection header received
0811 16:37:57.348411 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:57.348418 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:57.348471 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:57.348610 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:57.349299 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:57.350257 (+ 958us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:57.350984 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:57.351443 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:57.351548 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:57.353662 (+ 2114us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:57.353666 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:57.353667 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:37:57.353679 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:57.355153 (+ 1474us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:57.355463 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:57.355466 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:57.355466 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:57.355553 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:57.355724 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:57.355724 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:57.355724 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:57.355969 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:57.356112 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:57.356223 (+ 111us) server_negotiation.cc:299] Negotiation successful
0811 16:37:57.356367 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":368,"thread_start_us":78,"threads_started":1}
I20260811 16:37:57.360167 2575 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:37:57.360630 2575 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:37:57.363758 2575 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4d847362112f4b1e99e9de42aefdcadc: Generated new TSK 0
I20260811 16:37:57.363909 2575 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.175.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab.
Entry for principal kudu/127.24.175.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab.
I20260811 16:37:57.394447 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.193:0
--local_ip_for_outbound_sockets=127.24.175.193
--webserver_interface=127.24.175.193
--webserver_port=0
--tserver_master_addrs=127.24.175.254:35605
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab
--principal=kudu/127.24.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:40001
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:37:57.480715 2602 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:37:57.480911 2602 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:37:57.480943 2602 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:37:57.482082 2602 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:37:57.482124 2602 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:37:57.482177 2602 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.193
I20260811 16:37:57.483659 2602 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:40001
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab
--principal=kudu/127.24.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.175.193
--webserver_port=0
--tserver_master_addrs=127.24.175.254:35605
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2602
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.193
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:37:57.483883 2602 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:37:57.484095 2602 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:37:57.488905 2617 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:57.488904 2612 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:57.488971 2613 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:37:57.489140 2602 server_base.cc:1034] running on GCE node
I20260811 16:37:57.489348 2602 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:37:57.489565 2602 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:37:57.490706 2602 hybrid_clock.cc:648] HybridClock initialized: now 1786466277490687 us; error 30 us; skew 500 ppm
Aug 11 16:37:57 dist-test-slave-zj8q krb5kdc[2398](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466277, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:37:57.493049 2602 init.cc:377] Logged in from keytab as kudu/127.24.175.193@KRBTEST.COM (short username kudu)
I20260811 16:37:57.493453 2602 webserver.cc:460] Webserver started at http://127.24.175.193:43089/ using document root <none> and password file <none>
I20260811 16:37:57.493644 2602 fs_manager.cc:359] Metadata directory not provided
I20260811 16:37:57.493686 2602 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:37:57.493778 2602 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:37:57.494776 2602 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/minicluster-data/ts-0/data/instance:
uuid: "24c7c6ffec0f4b95b47eacaf619e6896"
format_stamp: "Formatted at 2026-08-11 16:37:57 on dist-test-slave-zj8q"
server_key: "e57b7898433deffbfde6b66398d30ee5"
server_key_iv: "8fe3d560c8edc61831aca8c00d40ace9"
server_key_version: "encryptionkey@0"
I20260811 16:37:57.495066 2602 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/minicluster-data/ts-0/wal/instance:
uuid: "24c7c6ffec0f4b95b47eacaf619e6896"
format_stamp: "Formatted at 2026-08-11 16:37:57 on dist-test-slave-zj8q"
server_key: "e57b7898433deffbfde6b66398d30ee5"
server_key_iv: "8fe3d560c8edc61831aca8c00d40ace9"
server_key_version: "encryptionkey@0"
I20260811 16:37:57.496222 2602 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:37:57.496876 2632 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:57.497037 2602 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:37:57.497118 2602 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/minicluster-data/ts-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/minicluster-data/ts-0/wal
uuid: "24c7c6ffec0f4b95b47eacaf619e6896"
format_stamp: "Formatted at 2026-08-11 16:37:57 on dist-test-slave-zj8q"
server_key: "e57b7898433deffbfde6b66398d30ee5"
server_key_iv: "8fe3d560c8edc61831aca8c00d40ace9"
server_key_version: "encryptionkey@0"
I20260811 16:37:57.497189 2602 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:37:57.526322 2602 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:37:57.527971 2602 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:37:57.528079 2602 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:37:57.528280 2602 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:37:57.528527 2602 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:37:57.528558 2602 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:57.528579 2602 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:37:57.528595 2602 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:57.534140 2602 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.193:32809
I20260811 16:37:57.534204 2823 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.193:32809 every 8 connection(s)
I20260811 16:37:57.534512 2602 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
I20260811 16:37:57.540056 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 2602
I20260811 16:37:57.540158 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/minicluster-data/ts-0/wal/instance
I20260811 16:37:57.540349 25279 external_mini_cluster.cc:1428] Setting key cf5152b26917c5d1d7cc9c49b2f924cf
Aug 11 16:37:57 dist-test-slave-zj8q krb5kdc[2398](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466277, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.193@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:37:57.543370 2595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:57.535175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:34135 (local address 127.24.175.254:35605)
0811 16:37:57.535234 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:57.535236 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:57.535421 (+ 185us) server_negotiation.cc:407] Connection header received
0811 16:37:57.536340 (+ 919us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:57.536341 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:57.536359 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:57.536409 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:57.536997 (+ 588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:57.537500 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:57.538496 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:57.538705 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:57.538767 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:57.540824 (+ 2057us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:57.540825 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:57.540825 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:37:57.540836 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:57.542036 (+ 1200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:57.542437 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:57.542438 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:57.542438 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:57.542496 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:57.542795 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:57.542795 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:57.542796 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:57.542920 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:57.542984 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:57.543198 (+ 214us) server_negotiation.cc:299] Negotiation successful
0811 16:37:57.543281 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 16:37:57.543452 2830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:57.535160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:35605 (local address 127.24.175.193:34135)
0811 16:37:57.535315 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:57.535349 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:57.536238 (+ 889us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:57.536477 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:57.536480 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:57.536723 (+ 243us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:37:57.536909 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:57.536913 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:57.537581 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:57.537582 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:57.538418 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:57.538421 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:57.538780 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:57.538781 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:57.538889 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:57.539293 (+ 404us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:37:57.539301 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:37:57.540747 (+ 1446us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:37:57.542106 (+ 1359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:57.542113 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:57.542115 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:57.542374 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:57.542575 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:57.542576 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:57.542577 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:57.542730 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:57.542976 (+ 246us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:37:57.542979 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:37:57.543086 (+ 107us) client_negotiation.cc:769] Sending connection context
0811 16:37:57.543173 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 16:37:57.543294 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":76,"threads_started":1}
I20260811 16:37:57.543906 2824 heartbeater.cc:347] Connected to a master server at 127.24.175.254:35605
I20260811 16:37:57.543994 2824 heartbeater.cc:464] Registering TS with master...
I20260811 16:37:57.544168 2824 heartbeater.cc:511] Master 127.24.175.254:35605 requested a full tablet report, sending...
I20260811 16:37:57.544687 2496 ts_manager.cc:194] Registered new tserver with Master: 24c7c6ffec0f4b95b47eacaf619e6896 (127.24.175.193:32809)
I20260811 16:37:57.545548 2496 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.175.193@KRBTEST.COM'} at 127.24.175.193:34135
WARNING: no policy specified for kudu/127.24.175.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab.
Entry for principal kudu/127.24.175.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab.
I20260811 16:37:57.563978 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.194:0
--local_ip_for_outbound_sockets=127.24.175.194
--webserver_interface=127.24.175.194
--webserver_port=0
--tserver_master_addrs=127.24.175.254:35605
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab
--principal=kudu/127.24.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:40001
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:37:57.644640 2835 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:37:57.644843 2835 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:37:57.644873 2835 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:37:57.646008 2835 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:37:57.646049 2835 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:37:57.646082 2835 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.194
I20260811 16:37:57.647579 2835 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:40001
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab
--principal=kudu/127.24.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.175.194
--webserver_port=0
--tserver_master_addrs=127.24.175.254:35605
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2835
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.194
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:37:57.647797 2835 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:37:57.647976 2835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:37:57.652868 2851 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:57.652864 2846 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:57.652886 2845 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:37:57.653146 2835 server_base.cc:1034] running on GCE node
I20260811 16:37:57.653455 2835 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:37:57.653743 2835 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:37:57.654917 2835 hybrid_clock.cc:648] HybridClock initialized: now 1786466277654901 us; error 31 us; skew 500 ppm
Aug 11 16:37:57 dist-test-slave-zj8q krb5kdc[2398](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466277, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:37:57.657336 2835 init.cc:377] Logged in from keytab as kudu/127.24.175.194@KRBTEST.COM (short username kudu)
I20260811 16:37:57.657788 2835 webserver.cc:460] Webserver started at http://127.24.175.194:44529/ using document root <none> and password file <none>
I20260811 16:37:57.658010 2835 fs_manager.cc:359] Metadata directory not provided
I20260811 16:37:57.658061 2835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:37:57.658226 2835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:37:57.659273 2835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/minicluster-data/ts-1/data/instance:
uuid: "28d97a698d0640bfbc67f41ccb287694"
format_stamp: "Formatted at 2026-08-11 16:37:57 on dist-test-slave-zj8q"
server_key: "55f68c002a47eea3939ca4a5ab69b984"
server_key_iv: "711b04752bd34a892b665e49b14ddd6a"
server_key_version: "encryptionkey@0"
I20260811 16:37:57.659622 2835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/minicluster-data/ts-1/wal/instance:
uuid: "28d97a698d0640bfbc67f41ccb287694"
format_stamp: "Formatted at 2026-08-11 16:37:57 on dist-test-slave-zj8q"
server_key: "55f68c002a47eea3939ca4a5ab69b984"
server_key_iv: "711b04752bd34a892b665e49b14ddd6a"
server_key_version: "encryptionkey@0"
I20260811 16:37:57.660818 2835 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:37:57.661471 2863 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:57.661620 2835 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:37:57.661707 2835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/minicluster-data/ts-1/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/minicluster-data/ts-1/wal
uuid: "28d97a698d0640bfbc67f41ccb287694"
format_stamp: "Formatted at 2026-08-11 16:37:57 on dist-test-slave-zj8q"
server_key: "55f68c002a47eea3939ca4a5ab69b984"
server_key_iv: "711b04752bd34a892b665e49b14ddd6a"
server_key_version: "encryptionkey@0"
I20260811 16:37:57.661769 2835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:37:57.672096 2835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:37:57.673785 2835 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:37:57.673913 2835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:37:57.674124 2835 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:37:57.674436 2835 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:37:57.674470 2835 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:57.674499 2835 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:37:57.674515 2835 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:57.680094 2835 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.194:45491
I20260811 16:37:57.680141 3071 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.194:45491 every 8 connection(s)
I20260811 16:37:57.680433 2835 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
Aug 11 16:37:57 dist-test-slave-zj8q krb5kdc[2398](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466277, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.194@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:37:57.688607 2595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:57.681107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:34459 (local address 127.24.175.254:35605)
0811 16:37:57.681182 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:57.681185 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:57.681336 (+ 151us) server_negotiation.cc:407] Connection header received
0811 16:37:57.682242 (+ 906us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:57.682244 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:57.682254 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:57.682304 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:57.682856 (+ 552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:57.683348 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:57.684266 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:57.684453 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:57.684501 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:57.686409 (+ 1908us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:57.686410 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:57.686410 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:37:57.686417 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:57.687603 (+ 1186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:57.687911 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:57.687912 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:57.687912 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:57.687959 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:57.688142 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:57.688143 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:57.688143 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:57.688240 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:57.688284 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:57.688478 (+ 194us) server_negotiation.cc:299] Negotiation successful
0811 16:37:57.688544 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 16:37:57.688733 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 2835
I20260811 16:37:57.688832 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/minicluster-data/ts-1/wal/instance
I20260811 16:37:57.688987 3074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:57.681068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:35605 (local address 127.24.175.194:34459)
0811 16:37:57.681225 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:57.681261 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:57.682124 (+ 863us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:57.682359 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:57.682363 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:57.682600 (+ 237us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:37:57.682789 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:57.682794 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:57.683410 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:57.683411 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:57.684199 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:57.684201 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:57.684509 (+ 308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:57.684509 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:57.684599 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:57.684981 (+ 382us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:37:57.684989 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:37:57.686328 (+ 1339us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:37:57.687672 (+ 1344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:57.687674 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:57.687676 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:57.687862 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:57.688001 (+ 139us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:57.688002 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:57.688002 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:57.688087 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:57.688281 (+ 194us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:37:57.688283 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:37:57.688388 (+ 105us) client_negotiation.cc:769] Sending connection context
0811 16:37:57.688461 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 16:37:57.688603 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":79,"threads_started":1}
I20260811 16:37:57.689016 25279 external_mini_cluster.cc:1428] Setting key 7fdca62a006dc489b9b68e8f814393ae
I20260811 16:37:57.689483 3072 heartbeater.cc:347] Connected to a master server at 127.24.175.254:35605
I20260811 16:37:57.689579 3072 heartbeater.cc:464] Registering TS with master...
I20260811 16:37:57.689754 3072 heartbeater.cc:511] Master 127.24.175.254:35605 requested a full tablet report, sending...
I20260811 16:37:57.690145 2494 ts_manager.cc:194] Registered new tserver with Master: 28d97a698d0640bfbc67f41ccb287694 (127.24.175.194:45491)
I20260811 16:37:57.690563 2494 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.175.194@KRBTEST.COM'} at 127.24.175.194:34459
WARNING: no policy specified for kudu/127.24.175.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab.
Entry for principal kudu/127.24.175.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab.
I20260811 16:37:57.713930 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.195:0
--local_ip_for_outbound_sockets=127.24.175.195
--webserver_interface=127.24.175.195
--webserver_port=0
--tserver_master_addrs=127.24.175.254:35605
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab
--principal=kudu/127.24.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:40001
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:37:57.796500 3079 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:37:57.796690 3079 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:37:57.796711 3079 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:37:57.797814 3079 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:37:57.797855 3079 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:37:57.797884 3079 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.195
I20260811 16:37:57.799363 3079 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:40001
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab
--principal=kudu/127.24.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.175.195
--webserver_port=0
--tserver_master_addrs=127.24.175.254:35605
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3079
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.195
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:37:57.799583 3079 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:37:57.799793 3079 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:37:57.804623 3091 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:37:57.804680 3079 server_base.cc:1034] running on GCE node
W20260811 16:37:57.804636 3090 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:57.804641 3093 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:37:57.804996 3079 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:37:57.805215 3079 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:37:57.806353 3079 hybrid_clock.cc:648] HybridClock initialized: now 1786466277806336 us; error 29 us; skew 500 ppm
Aug 11 16:37:57 dist-test-slave-zj8q krb5kdc[2398](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466277, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:37:57.808707 3079 init.cc:377] Logged in from keytab as kudu/127.24.175.195@KRBTEST.COM (short username kudu)
I20260811 16:37:57.809109 3079 webserver.cc:460] Webserver started at http://127.24.175.195:42137/ using document root <none> and password file <none>
I20260811 16:37:57.809329 3079 fs_manager.cc:359] Metadata directory not provided
I20260811 16:37:57.809376 3079 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:37:57.809499 3079 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:37:57.810506 3079 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/minicluster-data/ts-2/data/instance:
uuid: "3654da0bf44b456399649d5f5713d852"
format_stamp: "Formatted at 2026-08-11 16:37:57 on dist-test-slave-zj8q"
server_key: "2c58b7b904c3366bf5a3b8028ffdc6f8"
server_key_iv: "1bd76d85671fe53b9a2b937e0dccde51"
server_key_version: "encryptionkey@0"
I20260811 16:37:57.810832 3079 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/minicluster-data/ts-2/wal/instance:
uuid: "3654da0bf44b456399649d5f5713d852"
format_stamp: "Formatted at 2026-08-11 16:37:57 on dist-test-slave-zj8q"
server_key: "2c58b7b904c3366bf5a3b8028ffdc6f8"
server_key_iv: "1bd76d85671fe53b9a2b937e0dccde51"
server_key_version: "encryptionkey@0"
I20260811 16:37:57.812049 3079 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:37:57.812669 3105 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:57.812817 3079 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:37:57.812903 3079 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/minicluster-data/ts-2/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/minicluster-data/ts-2/wal
uuid: "3654da0bf44b456399649d5f5713d852"
format_stamp: "Formatted at 2026-08-11 16:37:57 on dist-test-slave-zj8q"
server_key: "2c58b7b904c3366bf5a3b8028ffdc6f8"
server_key_iv: "1bd76d85671fe53b9a2b937e0dccde51"
server_key_version: "encryptionkey@0"
I20260811 16:37:57.812959 3079 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:37:57.824190 3079 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:37:57.825971 3079 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:37:57.826097 3079 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:37:57.826329 3079 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:37:57.826663 3079 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:37:57.826699 3079 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:57.826720 3079 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:37:57.826743 3079 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:57.832233 3079 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.195:46375
I20260811 16:37:57.832291 3317 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.195:46375 every 8 connection(s)
I20260811 16:37:57.832557 3079 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
Aug 11 16:37:57 dist-test-slave-zj8q krb5kdc[2398](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466277, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.195@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:37:57.838660 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 3079
I20260811 16:37:57.838747 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/minicluster-data/ts-2/wal/instance
I20260811 16:37:57.838937 25279 external_mini_cluster.cc:1428] Setting key 06729d932ee91c41df899228a5d7ecd2
I20260811 16:37:57.840915 2595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:57.833188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.195:33571 (local address 127.24.175.254:35605)
0811 16:37:57.833240 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:57.833242 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:57.833458 (+ 216us) server_negotiation.cc:407] Connection header received
0811 16:37:57.834408 (+ 950us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:57.834410 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:57.834419 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:57.834463 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:57.835021 (+ 558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:57.835532 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:57.836473 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:57.836657 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:57.836697 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:57.838583 (+ 1886us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:57.838584 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:57.838584 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:37:57.838591 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:57.839907 (+ 1316us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:57.840248 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:57.840248 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:57.840248 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:57.840295 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:57.840451 (+ 156us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:57.840452 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:57.840452 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:57.840547 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:57.840597 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:57.840796 (+ 199us) server_negotiation.cc:299] Negotiation successful
0811 16:37:57.840853 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 16:37:57.841073 3325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:57.833172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:35605 (local address 127.24.175.195:33571)
0811 16:37:57.833335 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:57.833369 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:57.834324 (+ 955us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:57.834523 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:57.834526 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:57.834769 (+ 243us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:37:57.834951 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:57.834955 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:57.835596 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:57.835597 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:57.836410 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:57.836412 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:57.836712 (+ 300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:57.836713 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:57.836819 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:57.837188 (+ 369us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:37:57.837196 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:37:57.838478 (+ 1282us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:37:57.839969 (+ 1491us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:57.839974 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:57.839976 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:57.840190 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:57.840332 (+ 142us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:57.840333 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:57.840333 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:57.840413 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:57.840589 (+ 176us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:37:57.840592 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:37:57.840705 (+ 113us) client_negotiation.cc:769] Sending connection context
0811 16:37:57.840779 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 16:37:57.840891 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":89,"threads_started":1}
I20260811 16:37:57.841473 3319 heartbeater.cc:347] Connected to a master server at 127.24.175.254:35605
I20260811 16:37:57.841559 3319 heartbeater.cc:464] Registering TS with master...
I20260811 16:37:57.841727 3319 heartbeater.cc:511] Master 127.24.175.254:35605 requested a full tablet report, sending...
I20260811 16:37:57.842051 2494 ts_manager.cc:194] Registered new tserver with Master: 3654da0bf44b456399649d5f5713d852 (127.24.175.195:46375)
I20260811 16:37:57.842449 2494 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.175.195@KRBTEST.COM'} at 127.24.175.195:33571
I20260811 16:37:57.850517 25279 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/krb5kdc/test-admin.keytab.
Aug 11 16:37:57 dist-test-slave-zj8q krb5kdc[2398](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466277, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:37:57.865679 25279 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260811 16:37:57.867136 3334 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:37:57.866402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36270 (local address 127.24.175.193:32809)
0811 16:37:57.866576 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:57.866580 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:57.866591 (+ 11us) server_negotiation.cc:407] Connection header received
0811 16:37:57.866615 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:57.866617 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:57.866630 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:57.866691 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:57.867061 (+ 370us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36270: BlockingRecv error: recv got EOF from 127.0.0.1:36270 (error 108)
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":86,"threads_started":1}
W20260811 16:37:57.867228 25279 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/krb5kdc/krb5cc' of type FILE
Aug 11 16:37:57 dist-test-slave-zj8q krb5kdc[2398](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466277, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:37:57.868119 25279 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 16:37:57 dist-test-slave-zj8q krb5kdc[2398](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466277, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:37:57.868894 25279 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 16:37:57 dist-test-slave-zj8q krb5kdc[2398](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466277, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.175.193@KRBTEST.COM
I20260811 16:37:57.875896 3334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:57.869340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36286 (local address 127.24.175.193:32809)
0811 16:37:57.869396 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:57.869398 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:57.869407 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:37:57.869459 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:57.869460 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:57.869471 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:57.869514 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:57.869916 (+ 402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:57.870684 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:57.871362 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:57.871680 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:57.871737 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:57.873517 (+ 1780us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:57.873526 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:57.873527 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:37:57.873533 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:57.874881 (+ 1348us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:57.875179 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:57.875182 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:57.875183 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:57.875240 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:57.875401 (+ 161us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:57.875402 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:57.875402 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:57.875529 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:57.875672 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:57.875728 (+ 56us) server_negotiation.cc:299] Negotiation successful
0811 16:37:57.875805 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
W20260811 16:37:57.877501 3334 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:37:57.876986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36292 (local address 127.24.175.193:32809)
0811 16:37:57.877025 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:57.877028 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:57.877073 (+ 45us) server_negotiation.cc:407] Connection header received
0811 16:37:57.877139 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:57.877140 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:57.877150 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:57.877193 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:57.877460 (+ 267us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36292: BlockingRecv error: recv got EOF from 127.0.0.1:36292 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260811 16:37:57.877575 25279 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/krb5kdc/krb5cc' of type FILE
Aug 11 16:37:57 dist-test-slave-zj8q krb5kdc[2398](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466277, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:37:57.878433 25279 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 16:37:57 dist-test-slave-zj8q krb5kdc[2398](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466277, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:37:57.879158 25279 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 16:37:57 dist-test-slave-zj8q krb5kdc[2398](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466277, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.175.193@KRBTEST.COM
I20260811 16:37:57.884994 3334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:57.879590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36304 (local address 127.24.175.193:32809)
0811 16:37:57.879645 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:57.879647 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:57.879699 (+ 52us) server_negotiation.cc:407] Connection header received
0811 16:37:57.879755 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:57.879756 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:57.879766 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:57.879812 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:57.880120 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:57.880567 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:57.881188 (+ 621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:57.881386 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:57.881437 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:57.883121 (+ 1684us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:57.883122 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:57.883122 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:37:57.883129 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:57.884082 (+ 953us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:57.884359 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:57.884360 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:57.884360 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:57.884406 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:57.884558 (+ 152us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:57.884559 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:57.884559 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:57.884641 (+ 82us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:57.884714 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:57.884842 (+ 128us) server_negotiation.cc:299] Negotiation successful
0811 16:37:57.884911 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
W20260811 16:37:57.886304 3334 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:37:57.885830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36308 (local address 127.24.175.193:32809)
0811 16:37:57.885876 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:57.885878 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:57.885918 (+ 40us) server_negotiation.cc:407] Connection header received
0811 16:37:57.885973 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:57.885973 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:57.885981 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:57.886023 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:57.886265 (+ 242us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36308: BlockingRecv error: recv got EOF from 127.0.0.1:36308 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
W20260811 16:37:57.886375 25279 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466249441839-25279-0/krb5kdc/krb5cc' of type FILE
Aug 11 16:37:57 dist-test-slave-zj8q krb5kdc[2398](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466277, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:37:57.887187 25279 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 16:37:57 dist-test-slave-zj8q krb5kdc[2398](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466277, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:37:57.887883 25279 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 16:37:57 dist-test-slave-zj8q krb5kdc[2398](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466277, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.175.193@KRBTEST.COM
I20260811 16:37:57.893558 3334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:57.888312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36322 (local address 127.24.175.193:32809)
0811 16:37:57.888350 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:57.888351 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:57.888379 (+ 28us) server_negotiation.cc:407] Connection header received
0811 16:37:57.888440 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:57.888441 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:57.888448 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:57.888491 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:57.888791 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:57.889243 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:57.889856 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:57.890042 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:57.890092 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:57.891740 (+ 1648us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:57.891742 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:57.891742 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:37:57.891749 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:57.892682 (+ 933us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:57.892957 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:57.892957 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:57.892958 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:57.893003 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:57.893154 (+ 151us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:57.893155 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:57.893155 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:57.893239 (+ 84us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:57.893315 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:57.893417 (+ 102us) server_negotiation.cc:299] Negotiation successful
0811 16:37:57.893482 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 16:37:57.894089 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 2602
I20260811 16:37:57.906420 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 2835
I20260811 16:37:57.923828 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 3079
I20260811 16:37:57.951704 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 2420
2026-08-11T16:37:57Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2008 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:37:58 dist-test-slave-zj8q krb5kdc[3363](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:37:58 dist-test-slave-zj8q krb5kdc[3363](info): set up 2 sockets
Aug 11 16:37:58 dist-test-slave-zj8q krb5kdc[3363](info): commencing operation
krb5kdc: starting...
W20260811 16:37:59.124173 25279 mini_kdc.cc:121] Time spent starting KDC: real 1.146s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Aug 11 16:37:59 dist-test-slave-zj8q krb5kdc[3363](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466279, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:37:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:37:59Z Disabled control of system clock
WARNING: no policy specified for oryx/127.24.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.24.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.24.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/krb5kdc/oryx_127.24.175.254.keytab.
Entry for principal oryx/127.24.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/krb5kdc/oryx_127.24.175.254.keytab.
I20260811 16:37:59.242246 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:32869
--webserver_interface=127.24.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/krb5kdc/oryx_127.24.175.254.keytab
--principal=oryx/127.24.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:44883
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.175.254:32869
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:37:59.324692 3384 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:37:59.324883 3384 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:37:59.324904 3384 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:37:59.326061 3384 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:37:59.326105 3384 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:37:59.326119 3384 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:37:59.326131 3384 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:37:59.326170 3384 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:37:59.327719 3384 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:44883
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.175.254:32869
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/krb5kdc/oryx_127.24.175.254.keytab
--principal=oryx/127.24.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:32869
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3384
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:37:59.327952 3384 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:37:59.328173 3384 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:37:59.332981 3393 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:59.332986 3396 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:59.332994 3390 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:37:59.333269 3384 server_base.cc:1034] running on GCE node
I20260811 16:37:59.333492 3384 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:37:59.333760 3384 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:37:59.334895 3384 hybrid_clock.cc:648] HybridClock initialized: now 1786466279334883 us; error 30 us; skew 500 ppm
Aug 11 16:37:59 dist-test-slave-zj8q krb5kdc[3363](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466279, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:37:59.337303 3384 init.cc:377] Logged in from keytab as oryx/127.24.175.254@KRBTEST.COM (short username oryx)
I20260811 16:37:59.337715 3384 webserver.cc:460] Webserver started at http://127.24.175.254:45011/ using document root <none> and password file <none>
I20260811 16:37:59.337934 3384 fs_manager.cc:359] Metadata directory not provided
I20260811 16:37:59.337978 3384 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:37:59.338102 3384 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:37:59.339154 3384 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/master-0/data/instance:
uuid: "aa75a15571b74a698cb8903ef0fb78b7"
format_stamp: "Formatted at 2026-08-11 16:37:59 on dist-test-slave-zj8q"
server_key: "bef3763f6dd3b67d270c01a24cf6fcda"
server_key_iv: "1c4644ee3446450a571c3ade6caaad50"
server_key_version: "encryptionkey@0"
I20260811 16:37:59.339481 3384 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/master-0/wal/instance:
uuid: "aa75a15571b74a698cb8903ef0fb78b7"
format_stamp: "Formatted at 2026-08-11 16:37:59 on dist-test-slave-zj8q"
server_key: "bef3763f6dd3b67d270c01a24cf6fcda"
server_key_iv: "1c4644ee3446450a571c3ade6caaad50"
server_key_version: "encryptionkey@0"
I20260811 16:37:59.340764 3384 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:37:59.341404 3406 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:59.341536 3384 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:37:59.341621 3384 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/master-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/master-0/wal
uuid: "aa75a15571b74a698cb8903ef0fb78b7"
format_stamp: "Formatted at 2026-08-11 16:37:59 on dist-test-slave-zj8q"
server_key: "bef3763f6dd3b67d270c01a24cf6fcda"
server_key_iv: "1c4644ee3446450a571c3ade6caaad50"
server_key_version: "encryptionkey@0"
I20260811 16:37:59.341691 3384 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:37:59.356642 3384 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:37:59.358675 3384 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:37:59.358809 3384 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:37:59.362547 3384 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.254:32869
I20260811 16:37:59.362586 3502 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.254:32869 every 8 connection(s)
I20260811 16:37:59.362901 3384 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
I20260811 16:37:59.363857 3503 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:37:59.366070 3503 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa75a15571b74a698cb8903ef0fb78b7: Bootstrap starting.
I20260811 16:37:59.366607 3503 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aa75a15571b74a698cb8903ef0fb78b7: Neither blocks nor log segments found. Creating new log.
I20260811 16:37:59.366856 3503 log.cc:824] T 00000000000000000000000000000000 P aa75a15571b74a698cb8903ef0fb78b7: Log is configured to *not* fsync() on all Append() calls
I20260811 16:37:59.367250 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 3384
I20260811 16:37:59.367362 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/master-0/wal/instance
I20260811 16:37:59.367558 25279 external_mini_cluster.cc:1428] Setting key 94d95c1547f99c570d262b8866dcd6f0
I20260811 16:37:59.367597 3503 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa75a15571b74a698cb8903ef0fb78b7: No bootstrap required, opened a new log
I20260811 16:37:59.369722 3503 raft_consensus.cc:348] T 00000000000000000000000000000000 P aa75a15571b74a698cb8903ef0fb78b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa75a15571b74a698cb8903ef0fb78b7" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 32869 } }
I20260811 16:37:59.369863 3503 raft_consensus.cc:374] T 00000000000000000000000000000000 P aa75a15571b74a698cb8903ef0fb78b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:37:59.369884 3503 raft_consensus.cc:729] T 00000000000000000000000000000000 P aa75a15571b74a698cb8903ef0fb78b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa75a15571b74a698cb8903ef0fb78b7, State: Initialized, Role: FOLLOWER
I20260811 16:37:59.369984 3503 consensus_queue.cc:260] T 00000000000000000000000000000000 P aa75a15571b74a698cb8903ef0fb78b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa75a15571b74a698cb8903ef0fb78b7" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 32869 } }
I20260811 16:37:59.370050 3503 raft_consensus.cc:388] T 00000000000000000000000000000000 P aa75a15571b74a698cb8903ef0fb78b7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:37:59.370085 3503 raft_consensus.cc:482] T 00000000000000000000000000000000 P aa75a15571b74a698cb8903ef0fb78b7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:37:59.370128 3503 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aa75a15571b74a698cb8903ef0fb78b7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:37:59.370656 3503 raft_consensus.cc:504] T 00000000000000000000000000000000 P aa75a15571b74a698cb8903ef0fb78b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa75a15571b74a698cb8903ef0fb78b7" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 32869 } }
I20260811 16:37:59.370757 3503 leader_election.cc:302] T 00000000000000000000000000000000 P aa75a15571b74a698cb8903ef0fb78b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aa75a15571b74a698cb8903ef0fb78b7; no voters:
I20260811 16:37:59.370914 3503 leader_election.cc:288] T 00000000000000000000000000000000 P aa75a15571b74a698cb8903ef0fb78b7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:37:59.370949 3517 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aa75a15571b74a698cb8903ef0fb78b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:37:59.371063 3517 raft_consensus.cc:686] T 00000000000000000000000000000000 P aa75a15571b74a698cb8903ef0fb78b7 [term 1 LEADER]: Becoming Leader. State: Replica: aa75a15571b74a698cb8903ef0fb78b7, State: Running, Role: LEADER
I20260811 16:37:59.371161 3503 sys_catalog.cc:564] T 00000000000000000000000000000000 P aa75a15571b74a698cb8903ef0fb78b7 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:37:59.371140 3517 consensus_queue.cc:237] T 00000000000000000000000000000000 P aa75a15571b74a698cb8903ef0fb78b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa75a15571b74a698cb8903ef0fb78b7" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 32869 } }
I20260811 16:37:59.371460 3517 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa75a15571b74a698cb8903ef0fb78b7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "aa75a15571b74a698cb8903ef0fb78b7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa75a15571b74a698cb8903ef0fb78b7" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 32869 } } }
I20260811 16:37:59.371522 3517 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa75a15571b74a698cb8903ef0fb78b7 [sys.catalog]: This master's current role is: LEADER
I20260811 16:37:59.371639 3517 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa75a15571b74a698cb8903ef0fb78b7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader aa75a15571b74a698cb8903ef0fb78b7. Latest consensus state: current_term: 1 leader_uuid: "aa75a15571b74a698cb8903ef0fb78b7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa75a15571b74a698cb8903ef0fb78b7" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 32869 } } }
I20260811 16:37:59.371682 3517 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa75a15571b74a698cb8903ef0fb78b7 [sys.catalog]: This master's current role is: LEADER
I20260811 16:37:59.371944 3529 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:37:59.378602 3529 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:37:59.380090 3529 catalog_manager.cc:1347] Generated new cluster ID: 0e428c83b67d4dcea16df7d63a9479e8
I20260811 16:37:59.380133 3529 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 16:37:59 dist-test-slave-zj8q krb5kdc[3363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466279, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM
I20260811 16:37:59.383496 3516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:59.368021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35462 (local address 127.24.175.254:32869)
0811 16:37:59.368183 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:59.368193 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:59.368217 (+ 24us) server_negotiation.cc:407] Connection header received
0811 16:37:59.368831 (+ 614us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:59.368837 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:59.368884 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:59.368989 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:59.369720 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:59.371012 (+ 1292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:59.371883 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:59.378231 (+ 6348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:59.378371 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:59.380755 (+ 2384us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:59.380760 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:59.380760 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:37:59.380771 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:59.382128 (+ 1357us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:59.382463 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:59.382466 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:59.382467 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:59.382553 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:59.382737 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:59.382738 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:59.382738 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:59.382970 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:59.383085 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:59.383216 (+ 131us) server_negotiation.cc:299] Negotiation successful
0811 16:37:59.383346 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":74,"threads_started":1}
I20260811 16:37:59.393556 3529 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:37:59.394270 3529 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:37:59.397924 3529 catalog_manager.cc:5868] T 00000000000000000000000000000000 P aa75a15571b74a698cb8903ef0fb78b7: Generated new TSK 0
I20260811 16:37:59.398077 3529 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.24.175.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.24.175.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.24.175.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/krb5kdc/oryx_127.24.175.193.keytab.
Entry for principal oryx/127.24.175.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/krb5kdc/oryx_127.24.175.193.keytab.
I20260811 16:37:59.424832 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.193:0
--local_ip_for_outbound_sockets=127.24.175.193
--webserver_interface=127.24.175.193
--webserver_port=0
--tserver_master_addrs=127.24.175.254:32869
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/krb5kdc/oryx_127.24.175.193.keytab
--principal=oryx/127.24.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:44883
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:37:59.506182 3555 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:37:59.506393 3555 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:37:59.506423 3555 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:37:59.507544 3555 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:37:59.507584 3555 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:37:59.507619 3555 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.193
I20260811 16:37:59.509104 3555 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:44883
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/krb5kdc/oryx_127.24.175.193.keytab
--principal=oryx/127.24.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.175.193
--webserver_port=0
--tserver_master_addrs=127.24.175.254:32869
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3555
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.193
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:37:59.509339 3555 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:37:59.509544 3555 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:37:59.514429 3569 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:37:59.514472 3555 server_base.cc:1034] running on GCE node
W20260811 16:37:59.514477 3564 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:59.514441 3566 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:37:59.514842 3555 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:37:59.515072 3555 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:37:59.516209 3555 hybrid_clock.cc:648] HybridClock initialized: now 1786466279516190 us; error 37 us; skew 500 ppm
Aug 11 16:37:59 dist-test-slave-zj8q krb5kdc[3363](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466279, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:37:59.518720 3555 init.cc:377] Logged in from keytab as oryx/127.24.175.193@KRBTEST.COM (short username oryx)
I20260811 16:37:59.519119 3555 webserver.cc:460] Webserver started at http://127.24.175.193:39665/ using document root <none> and password file <none>
I20260811 16:37:59.519353 3555 fs_manager.cc:359] Metadata directory not provided
I20260811 16:37:59.519398 3555 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:37:59.519516 3555 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:37:59.520509 3555 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-0/data/instance:
uuid: "7cc554e49f17483b9143ff94990f2697"
format_stamp: "Formatted at 2026-08-11 16:37:59 on dist-test-slave-zj8q"
server_key: "d7a784d1b937b93edc324b619d8dc711"
server_key_iv: "2960e7c2aecda66ee05b6b47d2ed9b71"
server_key_version: "encryptionkey@0"
I20260811 16:37:59.520838 3555 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-0/wal/instance:
uuid: "7cc554e49f17483b9143ff94990f2697"
format_stamp: "Formatted at 2026-08-11 16:37:59 on dist-test-slave-zj8q"
server_key: "d7a784d1b937b93edc324b619d8dc711"
server_key_iv: "2960e7c2aecda66ee05b6b47d2ed9b71"
server_key_version: "encryptionkey@0"
I20260811 16:37:59.522045 3555 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:37:59.522724 3582 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:59.522878 3555 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:59.522964 3555 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-0/wal
uuid: "7cc554e49f17483b9143ff94990f2697"
format_stamp: "Formatted at 2026-08-11 16:37:59 on dist-test-slave-zj8q"
server_key: "d7a784d1b937b93edc324b619d8dc711"
server_key_iv: "2960e7c2aecda66ee05b6b47d2ed9b71"
server_key_version: "encryptionkey@0"
I20260811 16:37:59.523021 3555 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:37:59.550298 3555 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:37:59.552332 3555 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:37:59.552465 3555 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:37:59.552672 3555 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:37:59.552958 3555 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:37:59.552990 3555 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:59.553018 3555 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:37:59.553040 3555 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:59.558418 3555 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.193:39351
I20260811 16:37:59.558456 3766 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.193:39351 every 8 connection(s)
I20260811 16:37:59.558758 3555 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
I20260811 16:37:59.559947 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 3555
I20260811 16:37:59.560051 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-0/wal/instance
I20260811 16:37:59.560245 25279 external_mini_cluster.cc:1428] Setting key fd8daefb931d9314f618614bb7a7ed3b
Aug 11 16:37:59 dist-test-slave-zj8q krb5kdc[3363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466279, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.175.193@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM
I20260811 16:37:59.568485 3516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:59.559409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:57447 (local address 127.24.175.254:32869)
0811 16:37:59.559450 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:59.559452 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:59.559636 (+ 184us) server_negotiation.cc:407] Connection header received
0811 16:37:59.560365 (+ 729us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:59.560366 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:59.560379 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:59.560432 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:59.561565 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:59.562066 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:59.563279 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:59.563486 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:59.563544 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:59.565891 (+ 2347us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:59.565892 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:59.565893 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:37:59.565900 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:59.567160 (+ 1260us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:59.567616 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:59.567617 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:59.567617 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:59.567663 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:59.567910 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:59.567911 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:59.567911 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:59.568007 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:59.568051 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:59.568355 (+ 304us) server_negotiation.cc:299] Negotiation successful
0811 16:37:59.568421 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260811 16:37:59.568748 3771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:59.559383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:32869 (local address 127.24.175.193:57447)
0811 16:37:59.559519 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:59.559557 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:59.560231 (+ 674us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:59.560500 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:59.560504 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:59.561217 (+ 713us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:37:59.561482 (+ 265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:59.561489 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:59.562187 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:59.562188 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:59.563196 (+ 1008us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:59.563199 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:59.563559 (+ 360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:59.563560 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:59.563692 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:59.564151 (+ 459us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:37:59.564159 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:37:59.565801 (+ 1642us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:37:59.567237 (+ 1436us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:59.567246 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:59.567249 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:59.567546 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:59.567716 (+ 170us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:59.567716 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:59.567716 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:59.567853 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:59.568061 (+ 208us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:37:59.568068 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:37:59.568230 (+ 162us) client_negotiation.cc:769] Sending connection context
0811 16:37:59.568346 (+ 116us) client_negotiation.cc:240] Negotiation successful
0811 16:37:59.568512 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":66,"threads_started":1}
I20260811 16:37:59.569290 3769 heartbeater.cc:347] Connected to a master server at 127.24.175.254:32869
I20260811 16:37:59.569381 3769 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for oryx/127.24.175.194@KRBTEST.COM; defaulting to no policy
I20260811 16:37:59.569562 3769 heartbeater.cc:511] Master 127.24.175.254:32869 requested a full tablet report, sending...
I20260811 16:37:59.570083 3437 ts_manager.cc:194] Registered new tserver with Master: 7cc554e49f17483b9143ff94990f2697 (127.24.175.193:39351)
I20260811 16:37:59.570732 3437 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.24.175.193@KRBTEST.COM'} at 127.24.175.193:57447
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.24.175.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.24.175.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/krb5kdc/oryx_127.24.175.194.keytab.
Entry for principal oryx/127.24.175.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/krb5kdc/oryx_127.24.175.194.keytab.
I20260811 16:37:59.584650 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.194:0
--local_ip_for_outbound_sockets=127.24.175.194
--webserver_interface=127.24.175.194
--webserver_port=0
--tserver_master_addrs=127.24.175.254:32869
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/krb5kdc/oryx_127.24.175.194.keytab
--principal=oryx/127.24.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:44883
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:37:59.664928 3774 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:37:59.665113 3774 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:37:59.665136 3774 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:37:59.666276 3774 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:37:59.666317 3774 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:37:59.666342 3774 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.194
I20260811 16:37:59.667783 3774 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:44883
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/krb5kdc/oryx_127.24.175.194.keytab
--principal=oryx/127.24.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.175.194
--webserver_port=0
--tserver_master_addrs=127.24.175.254:32869
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3774
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.194
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:37:59.667961 3774 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:37:59.668154 3774 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:37:59.672976 3786 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:59.672976 3784 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:59.673177 3783 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:37:59.673174 3774 server_base.cc:1034] running on GCE node
I20260811 16:37:59.673413 3774 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:37:59.673619 3774 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:37:59.674757 3774 hybrid_clock.cc:648] HybridClock initialized: now 1786466279674741 us; error 28 us; skew 500 ppm
Aug 11 16:37:59 dist-test-slave-zj8q krb5kdc[3363](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466279, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:37:59.677111 3774 init.cc:377] Logged in from keytab as oryx/127.24.175.194@KRBTEST.COM (short username oryx)
I20260811 16:37:59.677523 3774 webserver.cc:460] Webserver started at http://127.24.175.194:40039/ using document root <none> and password file <none>
I20260811 16:37:59.677726 3774 fs_manager.cc:359] Metadata directory not provided
I20260811 16:37:59.677765 3774 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:37:59.677856 3774 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:37:59.678843 3774 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-1/data/instance:
uuid: "ac7de4f358864daa98d98cb042072912"
format_stamp: "Formatted at 2026-08-11 16:37:59 on dist-test-slave-zj8q"
server_key: "e9438d9d0e25198a1c5ed6d4ce078328"
server_key_iv: "6f6ed6b35c8cf6b9206f40c1967a0b95"
server_key_version: "encryptionkey@0"
I20260811 16:37:59.679140 3774 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-1/wal/instance:
uuid: "ac7de4f358864daa98d98cb042072912"
format_stamp: "Formatted at 2026-08-11 16:37:59 on dist-test-slave-zj8q"
server_key: "e9438d9d0e25198a1c5ed6d4ce078328"
server_key_iv: "6f6ed6b35c8cf6b9206f40c1967a0b95"
server_key_version: "encryptionkey@0"
I20260811 16:37:59.680289 3774 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:37:59.680922 3799 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:59.681073 3774 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:37:59.681173 3774 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-1/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-1/wal
uuid: "ac7de4f358864daa98d98cb042072912"
format_stamp: "Formatted at 2026-08-11 16:37:59 on dist-test-slave-zj8q"
server_key: "e9438d9d0e25198a1c5ed6d4ce078328"
server_key_iv: "6f6ed6b35c8cf6b9206f40c1967a0b95"
server_key_version: "encryptionkey@0"
I20260811 16:37:59.681237 3774 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:37:59.696995 3774 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:37:59.699038 3774 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:37:59.699178 3774 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:37:59.699383 3774 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:37:59.699681 3774 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:37:59.699716 3774 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:59.699743 3774 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:37:59.699769 3774 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:59.705092 3774 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.194:43771
I20260811 16:37:59.705149 4013 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.194:43771 every 8 connection(s)
I20260811 16:37:59.705425 3774 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
I20260811 16:37:59.709304 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 3774
I20260811 16:37:59.709415 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-1/wal/instance
I20260811 16:37:59.709609 25279 external_mini_cluster.cc:1428] Setting key c369a7b7240f33a03674fcfee42da902
Aug 11 16:37:59 dist-test-slave-zj8q krb5kdc[3363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466279, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.175.194@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM
I20260811 16:37:59.714259 3516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:59.706085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:41313 (local address 127.24.175.254:32869)
0811 16:37:59.706175 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:59.706178 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:59.706376 (+ 198us) server_negotiation.cc:407] Connection header received
0811 16:37:59.706846 (+ 470us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:59.706846 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:59.706857 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:59.706904 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:59.707792 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:59.708291 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:59.709220 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:59.709508 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:59.709577 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:59.711673 (+ 2096us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:59.711675 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:59.711675 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:37:59.711683 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:59.712889 (+ 1206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:59.713319 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:59.713320 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:59.713320 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:59.713375 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:59.713618 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:59.713618 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:59.713619 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:59.713719 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:59.713770 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:59.714051 (+ 281us) server_negotiation.cc:299] Negotiation successful
0811 16:37:59.714133 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 16:37:59.714418 4019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:59.706051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:32869 (local address 127.24.175.194:41313)
0811 16:37:59.706265 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:59.706299 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:59.706768 (+ 469us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:59.706958 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:59.706961 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:59.707532 (+ 571us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:37:59.707722 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:59.707727 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:59.708351 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:59.708351 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:59.709148 (+ 797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:59.709150 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:59.709585 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:59.709586 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:59.709748 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:59.710183 (+ 435us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:37:59.710193 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:37:59.711581 (+ 1388us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:37:59.712963 (+ 1382us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:59.712969 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:59.712971 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:59.713243 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:59.713435 (+ 192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:59.713435 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:59.713436 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:59.713561 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:59.713771 (+ 210us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:37:59.713777 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:37:59.713928 (+ 151us) client_negotiation.cc:769] Sending connection context
0811 16:37:59.714031 (+ 103us) client_negotiation.cc:240] Negotiation successful
0811 16:37:59.714202 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":133,"threads_started":1}
I20260811 16:37:59.714860 4016 heartbeater.cc:347] Connected to a master server at 127.24.175.254:32869
I20260811 16:37:59.714956 4016 heartbeater.cc:464] Registering TS with master...
I20260811 16:37:59.715131 4016 heartbeater.cc:511] Master 127.24.175.254:32869 requested a full tablet report, sending...
I20260811 16:37:59.715497 3437 ts_manager.cc:194] Registered new tserver with Master: ac7de4f358864daa98d98cb042072912 (127.24.175.194:43771)
I20260811 16:37:59.715847 3437 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.24.175.194@KRBTEST.COM'} at 127.24.175.194:41313
WARNING: no policy specified for oryx/127.24.175.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.24.175.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.24.175.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/krb5kdc/oryx_127.24.175.195.keytab.
Entry for principal oryx/127.24.175.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/krb5kdc/oryx_127.24.175.195.keytab.
I20260811 16:37:59.734100 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.195:0
--local_ip_for_outbound_sockets=127.24.175.195
--webserver_interface=127.24.175.195
--webserver_port=0
--tserver_master_addrs=127.24.175.254:32869
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/krb5kdc/oryx_127.24.175.195.keytab
--principal=oryx/127.24.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:44883
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:37:59.815692 4024 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:37:59.815881 4024 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:37:59.815902 4024 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:37:59.817003 4024 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:37:59.817041 4024 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:37:59.817070 4024 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.195
I20260811 16:37:59.818617 4024 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:44883
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/krb5kdc/oryx_127.24.175.195.keytab
--principal=oryx/127.24.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.175.195
--webserver_port=0
--tserver_master_addrs=127.24.175.254:32869
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4024
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.195
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:37:59.818840 4024 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:37:59.819037 4024 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:37:59.823848 4032 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:37:59.823856 4035 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:37:59.823935 4024 server_base.cc:1034] running on GCE node
W20260811 16:37:59.823905 4033 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:37:59.824252 4024 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:37:59.824469 4024 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:37:59.825654 4024 hybrid_clock.cc:648] HybridClock initialized: now 1786466279825642 us; error 28 us; skew 500 ppm
Aug 11 16:37:59 dist-test-slave-zj8q krb5kdc[3363](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466279, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:37:59.828356 4024 init.cc:377] Logged in from keytab as oryx/127.24.175.195@KRBTEST.COM (short username oryx)
I20260811 16:37:59.828768 4024 webserver.cc:460] Webserver started at http://127.24.175.195:44633/ using document root <none> and password file <none>
I20260811 16:37:59.828985 4024 fs_manager.cc:359] Metadata directory not provided
I20260811 16:37:59.829028 4024 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:37:59.829154 4024 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:37:59.830127 4024 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-2/data/instance:
uuid: "fd8823eeae954b089aaf278fc23441ec"
format_stamp: "Formatted at 2026-08-11 16:37:59 on dist-test-slave-zj8q"
server_key: "6624eb9f0c0f90bb9757a8b69fc36458"
server_key_iv: "fbdfa2b3e59e7db0c810eaebfd52e641"
server_key_version: "encryptionkey@0"
I20260811 16:37:59.830505 4024 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-2/wal/instance:
uuid: "fd8823eeae954b089aaf278fc23441ec"
format_stamp: "Formatted at 2026-08-11 16:37:59 on dist-test-slave-zj8q"
server_key: "6624eb9f0c0f90bb9757a8b69fc36458"
server_key_iv: "fbdfa2b3e59e7db0c810eaebfd52e641"
server_key_version: "encryptionkey@0"
I20260811 16:37:59.831761 4024 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:37:59.832393 4049 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:59.832532 4024 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:37:59.832614 4024 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-2/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-2/wal
uuid: "fd8823eeae954b089aaf278fc23441ec"
format_stamp: "Formatted at 2026-08-11 16:37:59 on dist-test-slave-zj8q"
server_key: "6624eb9f0c0f90bb9757a8b69fc36458"
server_key_iv: "fbdfa2b3e59e7db0c810eaebfd52e641"
server_key_version: "encryptionkey@0"
I20260811 16:37:59.832681 4024 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:37:59.862826 4024 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:37:59.864575 4024 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:37:59.864696 4024 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:37:59.864907 4024 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:37:59.865202 4024 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:37:59.865243 4024 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:59.865272 4024 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:37:59.865293 4024 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:37:59.870894 4024 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.195:36259
I20260811 16:37:59.870947 4255 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.195:36259 every 8 connection(s)
I20260811 16:37:59.871274 4024 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
Aug 11 16:37:59 dist-test-slave-zj8q krb5kdc[3363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466279, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.175.195@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM
I20260811 16:37:59.879019 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 4024
I20260811 16:37:59.879107 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-2/wal/instance
I20260811 16:37:59.879274 25279 external_mini_cluster.cc:1428] Setting key 4c0ec1b52625ba91bd7d829cb5e94e72
I20260811 16:37:59.879694 3516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:59.871932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.195:47183 (local address 127.24.175.254:32869)
0811 16:37:59.871981 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 16:37:59.871984 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:37:59.872224 (+ 240us) server_negotiation.cc:407] Connection header received
0811 16:37:59.872754 (+ 530us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:37:59.872755 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:37:59.872765 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:37:59.872811 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:37:59.873655 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:59.874174 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:59.875105 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:37:59.875299 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:37:59.875344 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:59.877195 (+ 1851us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:37:59.877196 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:37:59.877196 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:37:59.877203 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:37:59.878349 (+ 1146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:59.878680 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:59.878681 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:59.878681 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:59.878726 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:37:59.878957 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:37:59.878958 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:37:59.878959 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:37:59.879085 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:37:59.879169 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 16:37:59.879531 (+ 362us) server_negotiation.cc:299] Negotiation successful
0811 16:37:59.879609 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 16:37:59.879797 4258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:37:59.871939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:32869 (local address 127.24.175.195:47183)
0811 16:37:59.872094 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 16:37:59.872146 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 16:37:59.872668 (+ 522us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:37:59.872871 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:37:59.872874 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:37:59.873406 (+ 532us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:37:59.873589 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:59.873594 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:59.874251 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:59.874251 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:59.875044 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:37:59.875046 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:37:59.875353 (+ 307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:37:59.875353 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:37:59.875454 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:37:59.875822 (+ 368us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:37:59.875829 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:37:59.877113 (+ 1284us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:37:59.878422 (+ 1309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:59.878427 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:59.878429 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:59.878628 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:59.878769 (+ 141us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:37:59.878770 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:37:59.878770 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:37:59.878881 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:37:59.879172 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:37:59.879180 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:37:59.879310 (+ 130us) client_negotiation.cc:769] Sending connection context
0811 16:37:59.879412 (+ 102us) client_negotiation.cc:240] Negotiation successful
0811 16:37:59.879567 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":84,"threads_started":1}
I20260811 16:37:59.880182 4256 heartbeater.cc:347] Connected to a master server at 127.24.175.254:32869
I20260811 16:37:59.880278 4256 heartbeater.cc:464] Registering TS with master...
I20260811 16:37:59.880441 4256 heartbeater.cc:511] Master 127.24.175.254:32869 requested a full tablet report, sending...
I20260811 16:37:59.880787 3437 ts_manager.cc:194] Registered new tserver with Master: fd8823eeae954b089aaf278fc23441ec (127.24.175.195:36259)
I20260811 16:37:59.881130 3437 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.24.175.195@KRBTEST.COM'} at 127.24.175.195:47183
I20260811 16:37:59.890818 25279 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.24.175.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.24.175.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.24.175.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/krb5kdc/oryx_127.24.175.253.keytab.
Entry for principal oryx/127.24.175.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/krb5kdc/oryx_127.24.175.253.keytab.
I20260811 16:37:59.913736 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.253:46701
--webserver_interface=127.24.175.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/krb5kdc/oryx_127.24.175.253.keytab
--principal=oryx/127.24.175.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:44883
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.175.254:32869,127.24.175.253:46701
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:37:59.994481 4263 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:37:59.994688 4263 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:37:59.994709 4263 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:37:59.995816 4263 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:37:59.995854 4263 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:37:59.995867 4263 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:37:59.995878 4263 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:37:59.995891 4263 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:37:59.997311 4263 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:44883
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.24.175.254:32869,127.24.175.253:46701
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/krb5kdc/oryx_127.24.175.253.keytab
--principal=oryx/127.24.175.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.253:46701
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.24.175.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4263
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
W20260811 16:37:59.997414 4263 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.24.175.254:32869,127.24.175.253:46701'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260811 16:37:59.997534 4263 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:37:59.997697 4263 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:38:00.002308 4279 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:38:00.002307 4275 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:38:00.002323 4263 server_base.cc:1034] running on GCE node
W20260811 16:38:00.002321 4276 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:38:00.002799 4263 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:38:00.003065 4263 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:38:00.004209 4263 hybrid_clock.cc:648] HybridClock initialized: now 1786466280004191 us; error 32 us; skew 500 ppm
Aug 11 16:38:00 dist-test-slave-zj8q krb5kdc[3363](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466279, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.175.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:38:00.006628 4263 init.cc:377] Logged in from keytab as oryx/127.24.175.253@KRBTEST.COM (short username oryx)
I20260811 16:38:00.007020 4263 webserver.cc:460] Webserver started at http://127.24.175.253:32967/ using document root <none> and password file <none>
I20260811 16:38:00.007210 4263 fs_manager.cc:359] Metadata directory not provided
I20260811 16:38:00.007268 4263 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:38:00.007403 4263 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:38:00.008419 4263 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/master-1/data/instance:
uuid: "0c4b4b269a314fcbbe5d31a56cdcbd58"
format_stamp: "Formatted at 2026-08-11 16:38:00 on dist-test-slave-zj8q"
server_key: "8bd7715ca6d68e30ed4332638a8462e0"
server_key_iv: "03a5a387cde7c153b2f816169365b2d4"
server_key_version: "encryptionkey@0"
I20260811 16:38:00.008697 4263 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/master-1/wal/instance:
uuid: "0c4b4b269a314fcbbe5d31a56cdcbd58"
format_stamp: "Formatted at 2026-08-11 16:38:00 on dist-test-slave-zj8q"
server_key: "8bd7715ca6d68e30ed4332638a8462e0"
server_key_iv: "03a5a387cde7c153b2f816169365b2d4"
server_key_version: "encryptionkey@0"
I20260811 16:38:00.009857 4263 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 16:38:00.010514 4287 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:00.010651 4263 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:00.010731 4263 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/master-1/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/master-1/wal
uuid: "0c4b4b269a314fcbbe5d31a56cdcbd58"
format_stamp: "Formatted at 2026-08-11 16:38:00 on dist-test-slave-zj8q"
server_key: "8bd7715ca6d68e30ed4332638a8462e0"
server_key_iv: "03a5a387cde7c153b2f816169365b2d4"
server_key_version: "encryptionkey@0"
I20260811 16:38:00.010797 4263 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:38:00.024197 4263 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:38:00.026068 4263 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:38:00.026230 4263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:38:00.029929 4263 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.253:46701
I20260811 16:38:00.029968 4381 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.253:46701 every 8 connection(s)
I20260811 16:38:00.030309 4263 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/master-1/data/info.pb
I20260811 16:38:00.031247 4383 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:38:00.032794 4383 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.175.254" port: 32869 } has no permanent_uuid. Determining permanent_uuid...
I20260811 16:38:00.037957 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 4263
Aug 11 16:38:00 dist-test-slave-zj8q krb5kdc[3363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466279, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.175.253@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM
I20260811 16:38:00.041673 3516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:00.033433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35468 (local address 127.24.175.254:32869)
0811 16:38:00.033487 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:00.033490 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:00.033677 (+ 187us) server_negotiation.cc:407] Connection header received
0811 16:38:00.034178 (+ 501us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:00.034180 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:00.034193 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:00.034245 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:00.034845 (+ 600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.035613 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.036728 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.036930 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.036984 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:00.039137 (+ 2153us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:38:00.039139 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:38:00.039139 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:38:00.039147 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:38:00.040404 (+ 1257us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:00.040764 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:00.040765 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:00.040765 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:00.040820 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:00.041028 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:00.041029 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:00.041029 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:00.041176 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:38:00.041235 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:00.041489 (+ 254us) server_negotiation.cc:299] Negotiation successful
0811 16:38:00.041574 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 16:38:00.041796 4385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:00.033390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:32869 (local address 127.0.0.1:35468)
0811 16:38:00.033560 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:00.033595 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:00.034054 (+ 459us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:00.034320 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:00.034323 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:00.034552 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:00.034756 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:00.034761 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.035736 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.035737 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:00.036659 (+ 922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:00.036662 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.036995 (+ 333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.036995 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:00.037105 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:00.037497 (+ 392us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:00.037518 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:00.039053 (+ 1535us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:38:00.040478 (+ 1425us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:00.040484 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:00.040486 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:00.040698 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:00.040873 (+ 175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:00.040873 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:00.040874 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:00.040974 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:00.041236 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:38:00.041242 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:38:00.041371 (+ 129us) client_negotiation.cc:769] Sending connection context
0811 16:38:00.041456 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 16:38:00.041599 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":84,"threads_started":1}
I20260811 16:38:00.042382 4383 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.175.253" port: 46701 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 16:38:00 dist-test-slave-zj8q krb5kdc[3363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466279, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.24.175.253@KRBTEST.COM
Aug 11 16:38:00 dist-test-slave-zj8q krb5kdc[3363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466279, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.175.253@KRBTEST.COM for oryx/127.24.175.253@KRBTEST.COM
I20260811 16:38:00.047140 4386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:00.038663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42220 (local address 127.24.175.253:46701)
0811 16:38:00.038840 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:00.038845 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:00.038984 (+ 139us) server_negotiation.cc:407] Connection header received
0811 16:38:00.039009 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:00.039011 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:00.039032 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:00.039095 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:00.039638 (+ 543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.040270 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.040948 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.041233 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.041289 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:00.043923 (+ 2634us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:38:00.043931 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:38:00.043932 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:38:00.043939 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:38:00.045467 (+ 1528us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:00.045779 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:00.045783 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:00.045783 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:00.045838 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:00.046567 (+ 729us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:00.046568 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:00.046568 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:00.046695 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:38:00.046860 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:00.046908 (+ 48us) server_negotiation.cc:299] Negotiation successful
0811 16:38:00.046977 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":63,"threads_started":1}
I20260811 16:38:00.049400 4385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:00.042621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.253:46701 (local address 127.0.0.1:42234)
0811 16:38:00.042802 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:00.042811 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:00.042848 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:00.042979 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:00.042980 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:00.043079 (+ 99us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:00.043119 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:00.043119 (+ 0us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.043951 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.043952 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:00.044655 (+ 703us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:00.044657 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.045093 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.045094 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:00.045162 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:00.045515 (+ 353us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:00.045529 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:00.046652 (+ 1123us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:38:00.048562 (+ 1910us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:00.048563 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:00.048563 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:00.048712 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:00.048870 (+ 158us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:00.048871 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:00.048871 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:00.048922 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:00.049115 (+ 193us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:38:00.049116 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:38:00.049158 (+ 42us) client_negotiation.cc:769] Sending connection context
0811 16:38:00.049216 (+ 58us) client_negotiation.cc:240] Negotiation successful
0811 16:38:00.049305 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167}
I20260811 16:38:00.049484 4391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:00.042671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42234 (local address 127.24.175.253:46701)
0811 16:38:00.042823 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:00.042825 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:00.042836 (+ 11us) server_negotiation.cc:407] Connection header received
0811 16:38:00.042890 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:00.042891 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:00.042900 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:00.042977 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:00.043187 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.043871 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.044731 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.045025 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.045076 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:00.046718 (+ 1642us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:38:00.046719 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:38:00.046720 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:38:00.046725 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:38:00.048489 (+ 1764us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:00.048769 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:00.048770 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:00.048771 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:00.048822 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:00.048970 (+ 148us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:00.048970 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:00.048971 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:00.049065 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:38:00.049118 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:00.049241 (+ 123us) server_negotiation.cc:299] Negotiation successful
0811 16:38:00.049354 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":51,"server-negotiator.queue_time_us":132,"thread_start_us":99,"threads_started":1}
I20260811 16:38:00.050647 4383 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58: Bootstrap starting.
I20260811 16:38:00.051213 4383 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58: Neither blocks nor log segments found. Creating new log.
I20260811 16:38:00.051445 4383 log.cc:824] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58: Log is configured to *not* fsync() on all Append() calls
I20260811 16:38:00.052076 4383 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58: No bootstrap required, opened a new log
I20260811 16:38:00.053385 4383 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa75a15571b74a698cb8903ef0fb78b7" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 32869 } } peers { permanent_uuid: "0c4b4b269a314fcbbe5d31a56cdcbd58" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 46701 } }
I20260811 16:38:00.053501 4383 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:38:00.053534 4383 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c4b4b269a314fcbbe5d31a56cdcbd58, State: Initialized, Role: FOLLOWER
I20260811 16:38:00.053645 4383 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa75a15571b74a698cb8903ef0fb78b7" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 32869 } } peers { permanent_uuid: "0c4b4b269a314fcbbe5d31a56cdcbd58" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 46701 } }
I20260811 16:38:00.053952 4383 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:38:00.053905 4398 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa75a15571b74a698cb8903ef0fb78b7" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 32869 } } peers { permanent_uuid: "0c4b4b269a314fcbbe5d31a56cdcbd58" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 46701 } } }
I20260811 16:38:00.054014 4398 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58 [sys.catalog]: This master's current role is: FOLLOWER
W20260811 16:38:00.055500 4420 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 16:38:00.055557 4420 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 16:38:00.057180 4263 master_runner.cc:428] Detected that this master 0c4b4b269a314fcbbe5d31a56cdcbd58 is joining an existing cluster
I20260811 16:38:00.057256 4263 master_runner.cc:432] Initiating AddMaster RPC to add 127.24.175.253:46701
I20260811 16:38:00.063905 4391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:00.058339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42238 (local address 127.24.175.253:46701)
0811 16:38:00.058370 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:00.058371 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:00.058415 (+ 44us) server_negotiation.cc:407] Connection header received
0811 16:38:00.058470 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:00.058470 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:00.058478 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:00.058524 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:00.058897 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.059413 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.060066 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.060279 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.060330 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:00.061253 (+ 923us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:38:00.061255 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:38:00.061255 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:38:00.061261 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:38:00.062897 (+ 1636us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:00.063219 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:00.063220 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:00.063221 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:00.063273 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:00.063426 (+ 153us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:00.063426 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:00.063427 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:00.063525 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:38:00.063578 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:00.063703 (+ 125us) server_negotiation.cc:299] Negotiation successful
0811 16:38:00.063834 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":62,"server-negotiator.queue_time_us":18}
I20260811 16:38:00.064184 4433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:00.058112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.253:46701 (local address 127.0.0.1:42238)
0811 16:38:00.058356 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:00.058364 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:00.058422 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:00.058555 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:00.058556 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:00.058767 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:00.058830 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:00.058832 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.059471 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.059472 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:00.060001 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:00.060002 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.060333 (+ 331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.060334 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:00.060386 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:00.060762 (+ 376us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:00.060767 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:00.061157 (+ 390us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:38:00.062985 (+ 1828us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:00.062985 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:00.062986 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:00.063157 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:00.063323 (+ 166us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:00.063324 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:00.063325 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:00.063378 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:00.063574 (+ 196us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:38:00.063575 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:38:00.063619 (+ 44us) client_negotiation.cc:769] Sending connection context
0811 16:38:00.063678 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 16:38:00.063776 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":135,"threads_started":1}
I20260811 16:38:00.065191 3516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:00.058140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35470 (local address 127.24.175.254:32869)
0811 16:38:00.058198 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:00.058200 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:00.058347 (+ 147us) server_negotiation.cc:407] Connection header received
0811 16:38:00.058446 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:00.058447 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:00.058457 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:00.058510 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:00.058943 (+ 433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.059707 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.060781 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.061069 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.061144 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:00.062128 (+ 984us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:38:00.062129 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:38:00.062129 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:38:00.062137 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:38:00.063666 (+ 1529us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:00.064155 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:00.064156 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:00.064156 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:00.064215 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:00.064696 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:00.064697 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:00.064698 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:00.064832 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:38:00.064875 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:00.065062 (+ 187us) server_negotiation.cc:299] Negotiation successful
0811 16:38:00.065129 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 16:38:00.065416 4431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:00.058108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:32869 (local address 127.0.0.1:35470)
0811 16:38:00.058286 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:00.058296 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:00.058374 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:00.058524 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:00.058525 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:00.058785 (+ 260us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:00.058848 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:00.058850 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.059805 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.059805 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:00.060660 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:00.060663 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.061155 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.061156 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:00.061223 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:00.061599 (+ 376us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:00.061603 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:00.062015 (+ 412us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:38:00.063753 (+ 1738us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:00.063754 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:00.063755 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:00.064070 (+ 315us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:00.064551 (+ 481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:00.064551 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:00.064552 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:00.064615 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:00.064921 (+ 306us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:38:00.064921 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:38:00.064961 (+ 40us) client_negotiation.cc:769] Sending connection context
0811 16:38:00.065030 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 16:38:00.065125 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":130,"threads_started":1}
Aug 11 16:38:00 dist-test-slave-zj8q krb5kdc[3363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466279, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.175.254@KRBTEST.COM for oryx/127.24.175.253@KRBTEST.COM
I20260811 16:38:00.074301 4391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:00.067487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42242 (local address 127.24.175.253:46701)
0811 16:38:00.067569 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:00.067571 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:00.067634 (+ 63us) server_negotiation.cc:407] Connection header received
0811 16:38:00.067726 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:00.067727 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:00.067734 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:00.067775 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:00.068226 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.068657 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.069714 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.069931 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.069982 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:00.072011 (+ 2029us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:38:00.072012 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:38:00.072012 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:38:00.072018 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:38:00.073235 (+ 1217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:00.073639 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:00.073640 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:00.073641 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:00.073690 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:00.073859 (+ 169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:00.073859 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:00.073860 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:00.073941 (+ 81us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:38:00.073983 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:00.074188 (+ 205us) server_negotiation.cc:299] Negotiation successful
0811 16:38:00.074247 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 16:38:00.074374 4436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:00.067410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.253:46701 (local address 127.0.0.1:42242)
0811 16:38:00.067539 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:00.067587 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:00.067658 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:00.067782 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:00.067785 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:00.068110 (+ 325us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:00.068164 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:00.068166 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.068718 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.068719 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:00.069640 (+ 921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:00.069643 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.069995 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.069995 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:00.070084 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:00.070460 (+ 376us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:00.070465 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:00.071939 (+ 1474us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:38:00.073304 (+ 1365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:00.073311 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:00.073313 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:00.073566 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:00.073747 (+ 181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:00.073747 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:00.073748 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:00.073811 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:00.073988 (+ 177us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:38:00.073994 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:38:00.074044 (+ 50us) client_negotiation.cc:769] Sending connection context
0811 16:38:00.074121 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 16:38:00.074265 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":73,"threads_started":1}
I20260811 16:38:00.074928 3437 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.24.175.253:46701: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "0c4b4b269a314fcbbe5d31a56cdcbd58"
member_type: NON_VOTER
last_known_addr {
host: "127.24.175.253"
port: 46701
}
attrs {
promote: true
}
}
dest_uuid: "aa75a15571b74a698cb8903ef0fb78b7"
cas_config_opid_index: -1
I20260811 16:38:00.075277 3437 consensus_queue.cc:237] T 00000000000000000000000000000000 P aa75a15571b74a698cb8903ef0fb78b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "aa75a15571b74a698cb8903ef0fb78b7" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 32869 } } peers { permanent_uuid: "0c4b4b269a314fcbbe5d31a56cdcbd58" member_type: NON_VOTER last_known_addr { host: "127.24.175.253" port: 46701 } attrs { promote: true } }
I20260811 16:38:00.075721 4443 raft_consensus.cc:2932] T 00000000000000000000000000000000 P aa75a15571b74a698cb8903ef0fb78b7 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 0c4b4b269a314fcbbe5d31a56cdcbd58 (127.24.175.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "aa75a15571b74a698cb8903ef0fb78b7" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 32869 } } peers { permanent_uuid: "0c4b4b269a314fcbbe5d31a56cdcbd58" member_type: NON_VOTER last_known_addr { host: "127.24.175.253" port: 46701 } attrs { promote: true } } }
I20260811 16:38:00.076030 4342 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:38:00.076768 4443 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.24.175.253:46701
I20260811 16:38:00.076880 4442 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa75a15571b74a698cb8903ef0fb78b7 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "aa75a15571b74a698cb8903ef0fb78b7" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "aa75a15571b74a698cb8903ef0fb78b7" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 32869 } } peers { permanent_uuid: "0c4b4b269a314fcbbe5d31a56cdcbd58" member_type: NON_VOTER last_known_addr { host: "127.24.175.253" port: 46701 } attrs { promote: true } } }
I20260811 16:38:00.076926 4342 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58 [term 1 FOLLOWER]: Refusing update from remote peer aa75a15571b74a698cb8903ef0fb78b7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260811 16:38:00.076951 4442 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa75a15571b74a698cb8903ef0fb78b7 [sys.catalog]: This master's current role is: LEADER
I20260811 16:38:00.077095 4263 master.cc:537] Master@127.24.175.253:46701 shutting down...
I20260811 16:38:00.077277 4442 consensus_queue.cc:1035] T 00000000000000000000000000000000 P aa75a15571b74a698cb8903ef0fb78b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c4b4b269a314fcbbe5d31a56cdcbd58" member_type: NON_VOTER last_known_addr { host: "127.24.175.253" port: 46701 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 16:38:00.077937 3408 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260811 16:38:00.078392 3408 consensus_peers.cc:487] T 00000000000000000000000000000000 P aa75a15571b74a698cb8903ef0fb78b7 -> Peer 0c4b4b269a314fcbbe5d31a56cdcbd58 (127.24.175.253:46701): Couldn't send request to peer 0c4b4b269a314fcbbe5d31a56cdcbd58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:38:00.079896 4263 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:38:00.079983 4263 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:38:00.080031 4263 tablet_replica.cc:330] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58: stopping tablet replica
I20260811 16:38:00.092550 4263 master.cc:552] Master@127.24.175.253:46701 shutdown complete.
I20260811 16:38:00.092594 4263 master_runner.cc:305] Clearing existing system tablet
I20260811 16:38:00.092713 4263 fs_manager.cc:359] Metadata directory not provided
I20260811 16:38:00.092753 4263 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:38:00.093349 4263 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s
I20260811 16:38:00.093765 4450 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:00.093886 4263 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:38:00.093955 4263 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:00.093981 4263 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/master-1/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/master-1/wal
uuid: "0c4b4b269a314fcbbe5d31a56cdcbd58"
format_stamp: "Formatted at 2026-08-11 16:38:00 on dist-test-slave-zj8q"
server_key: "8bd7715ca6d68e30ed4332638a8462e0"
server_key_iv: "03a5a387cde7c153b2f816169365b2d4"
server_key_version: "encryptionkey@0"
I20260811 16:38:00.094821 4263 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:38:00.096220 4263 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260811 16:38:00.096294 4263 log.cc:1196] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58: Deleting WAL directory at /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260811 16:38:00.096477 4263 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58: Deleting consensus metadata
I20260811 16:38:00.096621 4263 master_runner.cc:315] Copying system tablet from 127.24.175.254:32869
I20260811 16:38:00.097180 4263 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58: tablet copy: Beginning tablet copy session from remote peer at address 127.24.175.254:32869
I20260811 16:38:00.103034 3516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:00.097559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35474 (local address 127.24.175.254:32869)
0811 16:38:00.097602 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:00.097603 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:00.097668 (+ 65us) server_negotiation.cc:407] Connection header received
0811 16:38:00.097729 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:00.097730 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:00.097738 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:00.097807 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:00.098137 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.098687 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.099698 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.099870 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.099909 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:00.100797 (+ 888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:38:00.100798 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:38:00.100798 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:38:00.100805 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:38:00.101989 (+ 1184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:00.102375 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:00.102376 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:00.102377 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:00.102435 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:00.102624 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:00.102624 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:00.102625 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:00.102720 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:38:00.102766 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:00.102913 (+ 147us) server_negotiation.cc:299] Negotiation successful
0811 16:38:00.102975 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 16:38:00.103096 4459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:00.097491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:32869 (local address 127.0.0.1:35474)
0811 16:38:00.097598 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:00.097609 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:00.097673 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:00.097818 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:00.097819 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:00.098005 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:00.098071 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:00.098072 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.098758 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.098759 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:00.099626 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:00.099629 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.099923 (+ 294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.099923 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:00.099988 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:00.100350 (+ 362us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:00.100355 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:00.100721 (+ 366us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:38:00.102061 (+ 1340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:00.102062 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:00.102062 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:00.102306 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:00.102495 (+ 189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:00.102495 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:00.102496 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:00.102557 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:00.102768 (+ 211us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:38:00.102769 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:38:00.102812 (+ 43us) client_negotiation.cc:769] Sending connection context
0811 16:38:00.102894 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 16:38:00.102989 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":85,"thread_start_us":65,"threads_started":1}
I20260811 16:38:00.103454 3474 tablet_copy_service.cc:140] P aa75a15571b74a698cb8903ef0fb78b7: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 0c4b4b269a314fcbbe5d31a56cdcbd58 ({username='oryx', principal='oryx/127.24.175.253@KRBTEST.COM'} at 127.0.0.1:35474)
I20260811 16:38:00.103587 3474 tablet_copy_service.cc:161] P aa75a15571b74a698cb8903ef0fb78b7: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 0c4b4b269a314fcbbe5d31a56cdcbd58 at {username='oryx', principal='oryx/127.24.175.253@KRBTEST.COM'} at 127.0.0.1:35474: session id = 0c4b4b269a314fcbbe5d31a56cdcbd58-00000000000000000000000000000000
I20260811 16:38:00.104491 3474 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P aa75a15571b74a698cb8903ef0fb78b7: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 16:38:00.105082 4263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260811 16:38:00.106310 4263 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58: tablet copy: Starting download of 0 data blocks...
I20260811 16:38:00.106460 4263 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58: tablet copy: Starting download of 1 WAL segments...
I20260811 16:38:00.107342 4263 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 16:38:00.108132 3474 tablet_copy_service.cc:342] P aa75a15571b74a698cb8903ef0fb78b7: Request end of tablet copy session 0c4b4b269a314fcbbe5d31a56cdcbd58-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.24.175.253@KRBTEST.COM'} at 127.0.0.1:35474
I20260811 16:38:00.108186 3474 tablet_copy_service.cc:433] P aa75a15571b74a698cb8903ef0fb78b7: ending tablet copy session 0c4b4b269a314fcbbe5d31a56cdcbd58-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 0c4b4b269a314fcbbe5d31a56cdcbd58
I20260811 16:38:00.110692 4263 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:38:00.111825 4460 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:38:00.111919 4461 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:38:00.112077 4263 server_base.cc:1034] running on GCE node
W20260811 16:38:00.112146 4463 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:38:00.112268 4263 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:38:00.112392 4263 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:38:00.113499 4263 hybrid_clock.cc:648] HybridClock initialized: now 1786466280113492 us; error 23 us; skew 500 ppm
Aug 11 16:38:00 dist-test-slave-zj8q krb5kdc[3363](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466280, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.175.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:38:00.114719 4263 init.cc:377] Logged in from keytab as oryx/127.24.175.253@KRBTEST.COM (short username oryx)
I20260811 16:38:00.114948 4263 webserver.cc:460] Webserver started at http://127.24.175.253:39157/ using document root <none> and password file <none>
I20260811 16:38:00.115057 4263 fs_manager.cc:359] Metadata directory not provided
I20260811 16:38:00.115088 4263 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:38:00.115610 4263 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:38:00.116068 4474 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:00.116200 4263 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:00.116240 4263 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/master-1/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/master-1/wal
uuid: "0c4b4b269a314fcbbe5d31a56cdcbd58"
format_stamp: "Formatted at 2026-08-11 16:38:00 on dist-test-slave-zj8q"
server_key: "8bd7715ca6d68e30ed4332638a8462e0"
server_key_iv: "03a5a387cde7c153b2f816169365b2d4"
server_key_version: "encryptionkey@0"
I20260811 16:38:00.116289 4263 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:38:00.124557 4263 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:38:00.126036 4263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:38:00.128916 4263 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.253:46701
I20260811 16:38:00.129201 4551 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.253:46701 every 8 connection(s)
I20260811 16:38:00.129282 4263 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/master-1/data/info.pb
I20260811 16:38:00.129904 4553 sys_catalog.cc:263] Verifying existing consensus state
I20260811 16:38:00.130483 4553 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58: Bootstrap starting.
I20260811 16:38:00.132606 4553 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:38:00.132805 4553 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58: Bootstrap complete.
I20260811 16:38:00.132985 4553 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "aa75a15571b74a698cb8903ef0fb78b7" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 32869 } } peers { permanent_uuid: "0c4b4b269a314fcbbe5d31a56cdcbd58" member_type: NON_VOTER last_known_addr { host: "127.24.175.253" port: 46701 } attrs { promote: true } }
I20260811 16:38:00.133064 4553 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0c4b4b269a314fcbbe5d31a56cdcbd58, State: Initialized, Role: LEARNER
I20260811 16:38:00.133090 4553 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "aa75a15571b74a698cb8903ef0fb78b7" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 32869 } } peers { permanent_uuid: "0c4b4b269a314fcbbe5d31a56cdcbd58" member_type: NON_VOTER last_known_addr { host: "127.24.175.253" port: 46701 } attrs { promote: true } }
I20260811 16:38:00.133250 4553 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:38:00.133257 4557 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "aa75a15571b74a698cb8903ef0fb78b7" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 32869 } } peers { permanent_uuid: "0c4b4b269a314fcbbe5d31a56cdcbd58" member_type: NON_VOTER last_known_addr { host: "127.24.175.253" port: 46701 } attrs { promote: true } } }
I20260811 16:38:00.133389 4557 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58 [sys.catalog]: This master's current role is: LEARNER
I20260811 16:38:00.134598 4574 catalog_manager.cc:1259] Loaded cluster ID: 0e428c83b67d4dcea16df7d63a9479e8
I20260811 16:38:00.134639 4574 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58: loading cluster ID for follower catalog manager: success
I20260811 16:38:00.135564 4574 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58: acquiring CA information for follower catalog manager: success
I20260811 16:38:00.135816 4574 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 16:38:00.154907 4577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:00.148413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42246 (local address 127.24.175.253:46701)
0811 16:38:00.148538 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:00.148540 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:00.148550 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:38:00.148574 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:00.148574 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:00.148585 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:00.148669 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:00.149158 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.150213 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.150926 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.151245 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.151320 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:00.152382 (+ 1062us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:38:00.152384 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:38:00.152384 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:38:00.152392 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:38:00.153846 (+ 1454us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:00.154138 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:00.154139 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:00.154139 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:00.154247 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:00.154421 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:00.154422 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:00.154422 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:00.154544 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:38:00.154641 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:00.154726 (+ 85us) server_negotiation.cc:299] Negotiation successful
0811 16:38:00.154806 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96,"thread_start_us":65,"threads_started":1}
WARNING: no policy specified for oryx/127.24.175.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.24.175.252@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.24.175.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/krb5kdc/oryx_127.24.175.252.keytab.
Entry for principal oryx/127.24.175.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/krb5kdc/oryx_127.24.175.252.keytab.
I20260811 16:38:00.178894 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.252:46357
--webserver_interface=127.24.175.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/krb5kdc/oryx_127.24.175.252.keytab
--principal=oryx/127.24.175.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:44883
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.175.254:32869,127.24.175.253:46701,127.24.175.252:46357
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:38:00.260737 4583 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:38:00.260934 4583 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:38:00.260965 4583 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:38:00.262076 4583 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:38:00.262117 4583 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:38:00.262136 4583 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:38:00.262171 4583 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:38:00.262187 4583 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:38:00.263700 4583 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:44883
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.24.175.254:32869,127.24.175.253:46701,127.24.175.252:46357
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/krb5kdc/oryx_127.24.175.252.keytab
--principal=oryx/127.24.175.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.252:46357
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.24.175.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4583
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:38:00.263939 4583 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:38:00.264148 4583 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:38:00.268677 4595 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:38:00.268683 4591 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:38:00.268811 4583 server_base.cc:1034] running on GCE node
W20260811 16:38:00.268675 4597 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:38:00.269151 4583 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:38:00.269402 4583 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:38:00.270568 4583 hybrid_clock.cc:648] HybridClock initialized: now 1786466280270551 us; error 32 us; skew 500 ppm
Aug 11 16:38:00 dist-test-slave-zj8q krb5kdc[3363](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466280, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.175.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:38:00.272979 4583 init.cc:377] Logged in from keytab as oryx/127.24.175.252@KRBTEST.COM (short username oryx)
I20260811 16:38:00.273373 4583 webserver.cc:460] Webserver started at http://127.24.175.252:34209/ using document root <none> and password file <none>
I20260811 16:38:00.273593 4583 fs_manager.cc:359] Metadata directory not provided
I20260811 16:38:00.273638 4583 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:38:00.273753 4583 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:38:00.274778 4583 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/master-2/data/instance:
uuid: "246f1e8e44c54e4588a89c771a803c2e"
format_stamp: "Formatted at 2026-08-11 16:38:00 on dist-test-slave-zj8q"
server_key: "c9c21f1399184c1c88aed9267581f958"
server_key_iv: "d2cc8ae58037baedd1196d5db1a8a70c"
server_key_version: "encryptionkey@0"
I20260811 16:38:00.275097 4583 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/master-2/wal/instance:
uuid: "246f1e8e44c54e4588a89c771a803c2e"
format_stamp: "Formatted at 2026-08-11 16:38:00 on dist-test-slave-zj8q"
server_key: "c9c21f1399184c1c88aed9267581f958"
server_key_iv: "d2cc8ae58037baedd1196d5db1a8a70c"
server_key_version: "encryptionkey@0"
I20260811 16:38:00.276278 4583 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:38:00.276980 4608 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:00.277139 4583 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:38:00.277222 4583 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/master-2/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/master-2/wal
uuid: "246f1e8e44c54e4588a89c771a803c2e"
format_stamp: "Formatted at 2026-08-11 16:38:00 on dist-test-slave-zj8q"
server_key: "c9c21f1399184c1c88aed9267581f958"
server_key_iv: "d2cc8ae58037baedd1196d5db1a8a70c"
server_key_version: "encryptionkey@0"
I20260811 16:38:00.277278 4583 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:38:00.301136 4583 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:38:00.303045 4583 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:38:00.303153 4583 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:38:00.306803 4583 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.252:46357
I20260811 16:38:00.306859 4699 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.252:46357 every 8 connection(s)
I20260811 16:38:00.307154 4583 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/master-2/data/info.pb
I20260811 16:38:00.308115 4700 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:38:00.309831 4700 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.175.254" port: 32869 } has no permanent_uuid. Determining permanent_uuid...
I20260811 16:38:00.314038 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 4583
Aug 11 16:38:00 dist-test-slave-zj8q krb5kdc[3363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466280, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.175.252@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM
I20260811 16:38:00.318720 3516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:00.310689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35480 (local address 127.24.175.254:32869)
0811 16:38:00.310752 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:00.310754 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:00.310820 (+ 66us) server_negotiation.cc:407] Connection header received
0811 16:38:00.311287 (+ 467us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:00.311288 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:00.311298 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:00.311348 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:00.311968 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.312459 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.313411 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.313585 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.313626 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:00.315841 (+ 2215us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:38:00.315843 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:38:00.315843 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:38:00.315851 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:38:00.317223 (+ 1372us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:00.317714 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:00.317716 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:00.317716 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:00.317787 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:00.318004 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:00.318005 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:00.318005 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:00.318182 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:38:00.318256 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:00.318558 (+ 302us) server_negotiation.cc:299] Negotiation successful
0811 16:38:00.318647 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 16:38:00.318972 4702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:00.310527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:32869 (local address 127.0.0.1:35480)
0811 16:38:00.310710 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:00.310750 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:00.311201 (+ 451us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:00.311408 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:00.311412 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:00.311713 (+ 301us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:00.311901 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:00.311905 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.312547 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.312548 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:00.313348 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:00.313350 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.313660 (+ 310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.313660 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:00.313774 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:00.314258 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:00.314268 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:00.315767 (+ 1499us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:38:00.317316 (+ 1549us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:00.317322 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:00.317324 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:00.317619 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:00.317854 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:00.317854 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:00.317855 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:00.317950 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:00.318253 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:38:00.318260 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:38:00.318420 (+ 160us) client_negotiation.cc:769] Sending connection context
0811 16:38:00.318530 (+ 110us) client_negotiation.cc:240] Negotiation successful
0811 16:38:00.318683 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":91,"threads_started":1}
I20260811 16:38:00.319492 4700 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.175.253" port: 46701 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 16:38:00 dist-test-slave-zj8q krb5kdc[3363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466279, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.24.175.252@KRBTEST.COM
I20260811 16:38:00.323554 4703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:00.314698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35030 (local address 127.24.175.252:46357)
0811 16:38:00.314846 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:00.314851 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:00.314919 (+ 68us) server_negotiation.cc:407] Connection header received
0811 16:38:00.314971 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:00.314974 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:00.314994 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:00.315054 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:00.315718 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.316703 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.317593 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.318033 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.318107 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:00.320768 (+ 2661us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:38:00.320776 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:38:00.320776 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:38:00.320783 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:38:00.322412 (+ 1629us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:00.322789 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:00.322792 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:00.322792 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:00.322852 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:00.323029 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:00.323030 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:00.323030 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:00.323186 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:38:00.323322 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:00.323382 (+ 60us) server_negotiation.cc:299] Negotiation successful
0811 16:38:00.323447 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":82,"threads_started":1}
Aug 11 16:38:00 dist-test-slave-zj8q krb5kdc[3363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466280, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.175.252@KRBTEST.COM for oryx/127.24.175.253@KRBTEST.COM
I20260811 16:38:00.326644 4702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:00.319708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.253:46701 (local address 127.0.0.1:42248)
0811 16:38:00.319745 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:00.319755 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:00.319795 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:00.320479 (+ 684us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:00.320480 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:00.320614 (+ 134us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:00.320666 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:00.320668 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.321565 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.321566 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:00.322394 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:00.322397 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.322865 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.322866 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:00.322941 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:00.323235 (+ 294us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:00.323240 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:00.324525 (+ 1285us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:38:00.325880 (+ 1355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:00.325881 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:00.325881 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:00.326049 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:00.326228 (+ 179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:00.326229 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:00.326229 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:00.326277 (+ 48us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:00.326453 (+ 176us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:38:00.326453 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:38:00.326484 (+ 31us) client_negotiation.cc:769] Sending connection context
0811 16:38:00.326526 (+ 42us) client_negotiation.cc:240] Negotiation successful
0811 16:38:00.326589 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20}
I20260811 16:38:00.326663 4577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:00.320322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42248 (local address 127.24.175.253:46701)
0811 16:38:00.320365 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:00.320367 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:00.320374 (+ 7us) server_negotiation.cc:407] Connection header received
0811 16:38:00.320397 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:00.320398 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:00.320409 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:00.320452 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:00.320763 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.321449 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.322477 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.322797 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.322850 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:00.324687 (+ 1837us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:38:00.324689 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:38:00.324694 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:38:00.324702 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:38:00.325789 (+ 1087us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:00.326104 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:00.326105 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:00.326105 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:00.326172 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:00.326317 (+ 145us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:00.326317 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:00.326318 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:00.326412 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:38:00.326458 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:00.326544 (+ 86us) server_negotiation.cc:299] Negotiation successful
0811 16:38:00.326606 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 16:38:00.327023 4700 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.175.252" port: 46357 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 16:38:00 dist-test-slave-zj8q krb5kdc[3363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466280, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.175.252@KRBTEST.COM for oryx/127.24.175.252@KRBTEST.COM
I20260811 16:38:00.332197 4702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:00.327236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.252:46357 (local address 127.0.0.1:35032)
0811 16:38:00.327273 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:00.327282 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:00.327315 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:00.327410 (+ 95us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:00.327411 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:00.327523 (+ 112us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:00.327546 (+ 23us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:00.327547 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.328114 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.328115 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:00.328560 (+ 445us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:00.328561 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.328883 (+ 322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.328883 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:00.328929 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:00.329201 (+ 272us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:00.329205 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:00.330202 (+ 997us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:38:00.331494 (+ 1292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:00.331495 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:00.331495 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:00.331641 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:00.331785 (+ 144us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:00.331786 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:00.331786 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:00.331829 (+ 43us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:00.331982 (+ 153us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:38:00.331983 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:38:00.332014 (+ 31us) client_negotiation.cc:769] Sending connection context
0811 16:38:00.332058 (+ 44us) client_negotiation.cc:240] Negotiation successful
0811 16:38:00.332125 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23}
I20260811 16:38:00.332252 4703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:00.327287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35032 (local address 127.24.175.252:46357)
0811 16:38:00.327328 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:00.327330 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:00.327336 (+ 6us) server_negotiation.cc:407] Connection header received
0811 16:38:00.327353 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:00.327353 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:00.327361 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:00.327399 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:00.327601 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.328050 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.328622 (+ 572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.328828 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.328878 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:00.330271 (+ 1393us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:38:00.330272 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:38:00.330272 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:38:00.330278 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:38:00.331424 (+ 1146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:00.331693 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:00.331693 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:00.331694 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:00.331744 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:00.331866 (+ 122us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:00.331866 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:00.331866 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:00.331945 (+ 79us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:38:00.331983 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:00.332073 (+ 90us) server_negotiation.cc:299] Negotiation successful
0811 16:38:00.332164 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":39,"server-negotiator.queue_time_us":28}
I20260811 16:38:00.333561 4700 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 246f1e8e44c54e4588a89c771a803c2e: Bootstrap starting.
I20260811 16:38:00.334391 4700 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 246f1e8e44c54e4588a89c771a803c2e: Neither blocks nor log segments found. Creating new log.
I20260811 16:38:00.334704 4700 log.cc:824] T 00000000000000000000000000000000 P 246f1e8e44c54e4588a89c771a803c2e: Log is configured to *not* fsync() on all Append() calls
I20260811 16:38:00.335376 4700 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 246f1e8e44c54e4588a89c771a803c2e: No bootstrap required, opened a new log
I20260811 16:38:00.336751 4700 raft_consensus.cc:348] T 00000000000000000000000000000000 P 246f1e8e44c54e4588a89c771a803c2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa75a15571b74a698cb8903ef0fb78b7" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 32869 } } peers { permanent_uuid: "0c4b4b269a314fcbbe5d31a56cdcbd58" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 46701 } } peers { permanent_uuid: "246f1e8e44c54e4588a89c771a803c2e" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 46357 } }
I20260811 16:38:00.336869 4700 raft_consensus.cc:374] T 00000000000000000000000000000000 P 246f1e8e44c54e4588a89c771a803c2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:38:00.336900 4700 raft_consensus.cc:729] T 00000000000000000000000000000000 P 246f1e8e44c54e4588a89c771a803c2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 246f1e8e44c54e4588a89c771a803c2e, State: Initialized, Role: FOLLOWER
I20260811 16:38:00.337013 4700 consensus_queue.cc:260] T 00000000000000000000000000000000 P 246f1e8e44c54e4588a89c771a803c2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa75a15571b74a698cb8903ef0fb78b7" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 32869 } } peers { permanent_uuid: "0c4b4b269a314fcbbe5d31a56cdcbd58" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 46701 } } peers { permanent_uuid: "246f1e8e44c54e4588a89c771a803c2e" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 46357 } }
I20260811 16:38:00.337302 4700 sys_catalog.cc:564] T 00000000000000000000000000000000 P 246f1e8e44c54e4588a89c771a803c2e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:38:00.337275 4706 sys_catalog.cc:455] T 00000000000000000000000000000000 P 246f1e8e44c54e4588a89c771a803c2e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa75a15571b74a698cb8903ef0fb78b7" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 32869 } } peers { permanent_uuid: "0c4b4b269a314fcbbe5d31a56cdcbd58" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 46701 } } peers { permanent_uuid: "246f1e8e44c54e4588a89c771a803c2e" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 46357 } } }
I20260811 16:38:00.337348 4706 sys_catalog.cc:458] T 00000000000000000000000000000000 P 246f1e8e44c54e4588a89c771a803c2e [sys.catalog]: This master's current role is: FOLLOWER
W20260811 16:38:00.338971 4731 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 246f1e8e44c54e4588a89c771a803c2e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 16:38:00.339025 4731 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 16:38:00.341113 4583 master_runner.cc:428] Detected that this master 246f1e8e44c54e4588a89c771a803c2e is joining an existing cluster
I20260811 16:38:00.341154 4583 master_runner.cc:432] Initiating AddMaster RPC to add 127.24.175.252:46357
I20260811 16:38:00.348305 4742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:00.342119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.252:46357 (local address 127.0.0.1:35034)
0811 16:38:00.342365 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:00.342374 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:00.342415 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:00.342660 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:00.342661 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:00.343070 (+ 409us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:00.343287 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:00.343290 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.344012 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.344013 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:00.344835 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:00.344838 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.345338 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.345339 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:00.345393 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:00.345763 (+ 370us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:00.345768 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:00.346050 (+ 282us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:38:00.347431 (+ 1381us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:00.347432 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:00.347432 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:00.347583 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:00.347743 (+ 160us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:00.347743 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:00.347743 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:00.347796 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:00.347987 (+ 191us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:38:00.347987 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:38:00.348040 (+ 53us) client_negotiation.cc:769] Sending connection context
0811 16:38:00.348096 (+ 56us) client_negotiation.cc:240] Negotiation successful
0811 16:38:00.348196 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":236,"mutex_wait_us":2,"thread_start_us":79,"threads_started":1}
I20260811 16:38:00.348348 4703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:00.342057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35034 (local address 127.24.175.252:46357)
0811 16:38:00.342091 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:00.342092 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:00.342418 (+ 326us) server_negotiation.cc:407] Connection header received
0811 16:38:00.342465 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:00.342466 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:00.342474 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:00.342519 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:00.343366 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.343950 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.344906 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.345191 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.345280 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:00.346131 (+ 851us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:38:00.346132 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:38:00.346132 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:38:00.346138 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:38:00.347364 (+ 1226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:00.347638 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:00.347639 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:00.347639 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:00.347689 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:00.347843 (+ 154us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:00.347843 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:00.347844 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:00.347939 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:38:00.347989 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:00.348122 (+ 133us) server_negotiation.cc:299] Negotiation successful
0811 16:38:00.348253 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":64,"server-negotiator.queue_time_us":17}
I20260811 16:38:00.367364 4739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:00.342073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.253:46701 (local address 127.0.0.1:42260)
0811 16:38:00.342272 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:00.342282 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:00.342475 (+ 193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:00.342620 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:00.342621 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:00.342812 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:00.342875 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:00.342877 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.343541 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.343542 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:00.344839 (+ 1297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:00.344842 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.345395 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.345396 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:00.345535 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:00.364197 (+ 18662us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:00.364202 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:00.364649 (+ 447us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:38:00.366265 (+ 1616us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:00.366266 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:00.366267 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:00.366480 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:00.366693 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:00.366694 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:00.366694 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:00.366758 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:00.367044 (+ 286us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:38:00.367045 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:38:00.367099 (+ 54us) client_negotiation.cc:769] Sending connection context
0811 16:38:00.367152 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 16:38:00.367251 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"mutex_wait_us":1,"thread_start_us":222,"threads_started":1}
I20260811 16:38:00.367517 4577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:00.342245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42260 (local address 127.24.175.253:46701)
0811 16:38:00.342282 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:00.342283 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:00.342329 (+ 46us) server_negotiation.cc:407] Connection header received
0811 16:38:00.342530 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:00.342531 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:00.342543 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:00.342606 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:00.342943 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.343465 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.344948 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.345240 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.345297 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:00.364777 (+ 19480us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:38:00.364779 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:38:00.364780 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:38:00.364787 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:38:00.366185 (+ 1398us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:00.366564 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:00.366566 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:00.366566 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:00.366624 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:00.366818 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:00.366818 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:00.366819 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:00.366980 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:38:00.367039 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:00.367357 (+ 318us) server_negotiation.cc:299] Negotiation successful
0811 16:38:00.367433 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 16:38:00.368234 3516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:00.342095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35488 (local address 127.24.175.254:32869)
0811 16:38:00.342137 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:00.342139 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:00.346400 (+ 4261us) server_negotiation.cc:407] Connection header received
0811 16:38:00.346495 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:00.346496 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:00.346507 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:00.346536 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:00.362523 (+ 15987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.363062 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.363736 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.364009 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.364072 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:00.365404 (+ 1332us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:38:00.365406 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:38:00.365406 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:38:00.365414 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:38:00.366849 (+ 1435us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:00.367173 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:00.367174 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:00.367174 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:00.367243 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:00.367760 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:00.367761 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:00.367761 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:00.367888 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:38:00.367952 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:00.368079 (+ 127us) server_negotiation.cc:299] Negotiation successful
0811 16:38:00.368144 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 16:38:00.368328 4743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:00.342311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:32869 (local address 127.0.0.1:35488)
0811 16:38:00.346331 (+ 4020us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:00.346342 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:00.346426 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:00.346592 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:00.346593 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:00.362340 (+ 15747us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:00.362408 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:00.362412 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.363144 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.363144 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:00.363662 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:00.363663 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.364135 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.364136 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:00.364288 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:00.364693 (+ 405us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:00.364698 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:00.365334 (+ 636us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:38:00.366914 (+ 1580us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:00.366914 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:00.366915 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:00.367104 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:00.367301 (+ 197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:00.367302 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:00.367302 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:00.367361 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:00.367946 (+ 585us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:38:00.367947 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:38:00.367986 (+ 39us) client_negotiation.cc:769] Sending connection context
0811 16:38:00.368048 (+ 62us) client_negotiation.cc:240] Negotiation successful
0811 16:38:00.368145 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3941,"thread_start_us":129,"threads_started":1}
Aug 11 16:38:00 dist-test-slave-zj8q krb5kdc[3363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466279, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.175.254@KRBTEST.COM for oryx/127.24.175.252@KRBTEST.COM
I20260811 16:38:00.374979 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 3555
I20260811 16:38:00.407853 4703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:00.370347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35048 (local address 127.24.175.252:46357)
0811 16:38:00.370390 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:00.370392 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:00.370398 (+ 6us) server_negotiation.cc:407] Connection header received
0811 16:38:00.370422 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:00.370423 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:00.370430 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:00.370472 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:00.370751 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.371323 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.372354 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.372646 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.372708 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:00.374363 (+ 1655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:38:00.374364 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:38:00.374365 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:38:00.374371 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:38:00.406458 (+ 32087us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:00.407002 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:00.407004 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:00.407004 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:00.407077 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:00.407300 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:00.407300 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:00.407300 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:00.407440 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:38:00.407502 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:00.407666 (+ 164us) server_negotiation.cc:299] Negotiation successful
0811 16:38:00.407754 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 16:38:00.407871 4436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:00.370176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.252:46357 (local address 127.0.0.1:35048)
0811 16:38:00.370212 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:00.370223 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:00.370264 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:00.370492 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:00.370492 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:00.370648 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:00.370690 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:00.370691 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.371383 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.371383 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:00.372247 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:00.372250 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.372709 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.372710 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:00.372788 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:00.373103 (+ 315us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:00.373107 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:00.374285 (+ 1178us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:38:00.406619 (+ 32334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:00.406621 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:00.406622 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:00.406916 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:00.407159 (+ 243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:00.407160 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:00.407160 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:00.407240 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:00.407501 (+ 261us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:38:00.407502 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:38:00.407561 (+ 59us) client_negotiation.cc:769] Sending connection context
0811 16:38:00.407630 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 16:38:00.407766 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20}
I20260811 16:38:00.410543 3437 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.24.175.252:46357: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "246f1e8e44c54e4588a89c771a803c2e"
member_type: NON_VOTER
last_known_addr {
host: "127.24.175.252"
port: 46357
}
attrs {
promote: true
}
}
dest_uuid: "aa75a15571b74a698cb8903ef0fb78b7"
cas_config_opid_index: 5
I20260811 16:38:00.410588 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.193:39351
--local_ip_for_outbound_sockets=127.24.175.193
--tserver_master_addrs=127.24.175.254:32869
--webserver_port=39665
--webserver_interface=127.24.175.193
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/krb5kdc/oryx_127.24.175.193.keytab
--principal=oryx/127.24.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:44883
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.24.175.254:32869,127.24.175.253:46701
--tserver_master_addrs=127.24.175.254:32869,127.24.175.253:46701,127.24.175.252:46357 with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 16:38:00.410809 3437 consensus_queue.cc:237] T 00000000000000000000000000000000 P aa75a15571b74a698cb8903ef0fb78b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "aa75a15571b74a698cb8903ef0fb78b7" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 32869 } } peers { permanent_uuid: "0c4b4b269a314fcbbe5d31a56cdcbd58" member_type: NON_VOTER last_known_addr { host: "127.24.175.253" port: 46701 } attrs { promote: true } } peers { permanent_uuid: "246f1e8e44c54e4588a89c771a803c2e" member_type: NON_VOTER last_known_addr { host: "127.24.175.252" port: 46357 } attrs { promote: true } }
I20260811 16:38:00.411291 4443 raft_consensus.cc:2932] T 00000000000000000000000000000000 P aa75a15571b74a698cb8903ef0fb78b7 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 246f1e8e44c54e4588a89c771a803c2e (127.24.175.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "aa75a15571b74a698cb8903ef0fb78b7" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 32869 } } peers { permanent_uuid: "0c4b4b269a314fcbbe5d31a56cdcbd58" member_type: NON_VOTER last_known_addr { host: "127.24.175.253" port: 46701 } attrs { promote: true } } peers { permanent_uuid: "246f1e8e44c54e4588a89c771a803c2e" member_type: NON_VOTER last_known_addr { host: "127.24.175.252" port: 46357 } attrs { promote: true } } }
I20260811 16:38:00.412114 4443 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.24.175.252:46357
I20260811 16:38:00.412191 4443 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa75a15571b74a698cb8903ef0fb78b7 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "aa75a15571b74a698cb8903ef0fb78b7" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "aa75a15571b74a698cb8903ef0fb78b7" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 32869 } } peers { permanent_uuid: "0c4b4b269a314fcbbe5d31a56cdcbd58" member_type: NON_VOTER last_known_addr { host: "127.24.175.253" port: 46701 } attrs { promote: true } } peers { permanent_uuid: "246f1e8e44c54e4588a89c771a803c2e" member_type: NON_VOTER last_known_addr { host: "127.24.175.252" port: 46357 } attrs { promote: true } } }
I20260811 16:38:00.412268 4443 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa75a15571b74a698cb8903ef0fb78b7 [sys.catalog]: This master's current role is: LEADER
I20260811 16:38:00.412674 4657 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 246f1e8e44c54e4588a89c771a803c2e [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:38:00.413560 4657 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 246f1e8e44c54e4588a89c771a803c2e [term 1 FOLLOWER]: Refusing update from remote peer aa75a15571b74a698cb8903ef0fb78b7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260811 16:38:00.413829 4442 consensus_queue.cc:1035] T 00000000000000000000000000000000 P aa75a15571b74a698cb8903ef0fb78b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "246f1e8e44c54e4588a89c771a803c2e" member_type: NON_VOTER last_known_addr { host: "127.24.175.252" port: 46357 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:38:00.413893 4583 master.cc:537] Master@127.24.175.252:46357 shutting down...
W20260811 16:38:00.414531 3413 consensus_peers.cc:487] T 00000000000000000000000000000000 P aa75a15571b74a698cb8903ef0fb78b7 -> Peer 246f1e8e44c54e4588a89c771a803c2e (127.24.175.252:46357): Couldn't send request to peer 246f1e8e44c54e4588a89c771a803c2e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:38:00.416742 4436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:00.411246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.253:46701 (local address 127.0.0.1:42262)
0811 16:38:00.412584 (+ 1338us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:00.412601 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:00.412667 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:00.412888 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:00.412889 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:00.412890 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:38:00.412935 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:00.412936 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.413683 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.413684 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:00.415584 (+ 1900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:00.415587 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.416463 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.416463 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:00.416522 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:00.416547 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 16:38:00.416629 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 16:38:00.416668 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1321}
I20260811 16:38:00.416742 4577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:00.411320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42262 (local address 127.24.175.253:46701)
0811 16:38:00.411361 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:00.411363 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:00.412638 (+ 1275us) server_negotiation.cc:407] Connection header received
0811 16:38:00.412744 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:00.412745 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:00.412772 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:00.412811 (+ 39us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:38:00.413001 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.413601 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.415687 (+ 2086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.416248 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.416297 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:00.416387 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:00.416639 (+ 252us) server_negotiation.cc:299] Negotiation successful
0811 16:38:00.416682 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 16:38:00.416985 4512 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58 [term 1 LEARNER]: Refusing update from remote peer aa75a15571b74a698cb8903ef0fb78b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260811 16:38:00.417191 4583 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 246f1e8e44c54e4588a89c771a803c2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:38:00.417179 4442 consensus_queue.cc:1035] T 00000000000000000000000000000000 P aa75a15571b74a698cb8903ef0fb78b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c4b4b269a314fcbbe5d31a56cdcbd58" member_type: NON_VOTER last_known_addr { host: "127.24.175.253" port: 46701 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260811 16:38:00.417284 4583 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 246f1e8e44c54e4588a89c771a803c2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:38:00.417340 4583 tablet_replica.cc:330] T 00000000000000000000000000000000 P 246f1e8e44c54e4588a89c771a803c2e: stopping tablet replica
I20260811 16:38:00.417704 4512 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 246f1e8e44c54e4588a89c771a803c2e (127.24.175.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "aa75a15571b74a698cb8903ef0fb78b7" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 32869 } } peers { permanent_uuid: "0c4b4b269a314fcbbe5d31a56cdcbd58" member_type: NON_VOTER last_known_addr { host: "127.24.175.253" port: 46701 } attrs { promote: true } } peers { permanent_uuid: "246f1e8e44c54e4588a89c771a803c2e" member_type: NON_VOTER last_known_addr { host: "127.24.175.252" port: 46357 } attrs { promote: true } } }
I20260811 16:38:00.418831 4557 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58 [sys.catalog]: SysCatalogTable state changed. Reason: New leader aa75a15571b74a698cb8903ef0fb78b7. Latest consensus state: current_term: 1 leader_uuid: "aa75a15571b74a698cb8903ef0fb78b7" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "aa75a15571b74a698cb8903ef0fb78b7" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 32869 } } peers { permanent_uuid: "0c4b4b269a314fcbbe5d31a56cdcbd58" member_type: NON_VOTER last_known_addr { host: "127.24.175.253" port: 46701 } attrs { promote: true } } peers { permanent_uuid: "246f1e8e44c54e4588a89c771a803c2e" member_type: NON_VOTER last_known_addr { host: "127.24.175.252" port: 46357 } attrs { promote: true } } }
I20260811 16:38:00.418922 4557 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58 [sys.catalog]: This master's current role is: LEARNER
I20260811 16:38:00.418957 4557 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "aa75a15571b74a698cb8903ef0fb78b7" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "aa75a15571b74a698cb8903ef0fb78b7" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 32869 } } peers { permanent_uuid: "0c4b4b269a314fcbbe5d31a56cdcbd58" member_type: NON_VOTER last_known_addr { host: "127.24.175.253" port: 46701 } attrs { promote: true } } peers { permanent_uuid: "246f1e8e44c54e4588a89c771a803c2e" member_type: NON_VOTER last_known_addr { host: "127.24.175.252" port: 46357 } attrs { promote: true } } }
I20260811 16:38:00.419005 4557 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58 [sys.catalog]: This master's current role is: LEARNER
I20260811 16:38:00.419631 4442 raft_consensus.cc:1050] T 00000000000000000000000000000000 P aa75a15571b74a698cb8903ef0fb78b7: attempting to promote NON_VOTER 0c4b4b269a314fcbbe5d31a56cdcbd58 to VOTER
I20260811 16:38:00.419816 4442 consensus_queue.cc:237] T 00000000000000000000000000000000 P aa75a15571b74a698cb8903ef0fb78b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "aa75a15571b74a698cb8903ef0fb78b7" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 32869 } } peers { permanent_uuid: "0c4b4b269a314fcbbe5d31a56cdcbd58" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 46701 } attrs { promote: false } } peers { permanent_uuid: "246f1e8e44c54e4588a89c771a803c2e" member_type: NON_VOTER last_known_addr { host: "127.24.175.252" port: 46357 } attrs { promote: true } }
I20260811 16:38:00.420222 4512 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58 [term 1 LEARNER]: Refusing update from remote peer aa75a15571b74a698cb8903ef0fb78b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260811 16:38:00.420403 4747 consensus_queue.cc:1035] T 00000000000000000000000000000000 P aa75a15571b74a698cb8903ef0fb78b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c4b4b269a314fcbbe5d31a56cdcbd58" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 46701 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260811 16:38:00.420463 4436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:00.420137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.252:46357 (local address 127.0.0.1:35062)
0811 16:38:00.420396 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:00.420442 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.252:46357: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":244}
I20260811 16:38:00.420786 4436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:00.420691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.252:46357 (local address 127.0.0.1:35064)
0811 16:38:00.420738 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:00.420763 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.252:46357: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260811 16:38:00.420873 3413 consensus_peers.cc:487] T 00000000000000000000000000000000 P aa75a15571b74a698cb8903ef0fb78b7 -> Peer 246f1e8e44c54e4588a89c771a803c2e (127.24.175.252:46357): Couldn't send request to peer 246f1e8e44c54e4588a89c771a803c2e. Status: Network error: Client connection negotiation failed: client connection to 127.24.175.252:46357: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:38:00.421241 4442 raft_consensus.cc:2932] T 00000000000000000000000000000000 P aa75a15571b74a698cb8903ef0fb78b7 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 0c4b4b269a314fcbbe5d31a56cdcbd58 (127.24.175.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "aa75a15571b74a698cb8903ef0fb78b7" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 32869 } } peers { permanent_uuid: "0c4b4b269a314fcbbe5d31a56cdcbd58" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 46701 } attrs { promote: false } } peers { permanent_uuid: "246f1e8e44c54e4588a89c771a803c2e" member_type: NON_VOTER last_known_addr { host: "127.24.175.252" port: 46357 } attrs { promote: true } } }
I20260811 16:38:00.421942 4442 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa75a15571b74a698cb8903ef0fb78b7 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "aa75a15571b74a698cb8903ef0fb78b7" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "aa75a15571b74a698cb8903ef0fb78b7" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 32869 } } peers { permanent_uuid: "0c4b4b269a314fcbbe5d31a56cdcbd58" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 46701 } attrs { promote: false } } peers { permanent_uuid: "246f1e8e44c54e4588a89c771a803c2e" member_type: NON_VOTER last_known_addr { host: "127.24.175.252" port: 46357 } attrs { promote: true } } }
I20260811 16:38:00.422017 4442 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa75a15571b74a698cb8903ef0fb78b7 [sys.catalog]: This master's current role is: LEADER
I20260811 16:38:00.422073 4442 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa75a15571b74a698cb8903ef0fb78b7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "aa75a15571b74a698cb8903ef0fb78b7" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "aa75a15571b74a698cb8903ef0fb78b7" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 32869 } } peers { permanent_uuid: "0c4b4b269a314fcbbe5d31a56cdcbd58" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 46701 } attrs { promote: false } } peers { permanent_uuid: "246f1e8e44c54e4588a89c771a803c2e" member_type: NON_VOTER last_known_addr { host: "127.24.175.252" port: 46357 } attrs { promote: true } } }
I20260811 16:38:00.422119 4442 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa75a15571b74a698cb8903ef0fb78b7 [sys.catalog]: This master's current role is: LEADER
I20260811 16:38:00.422406 4512 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 0c4b4b269a314fcbbe5d31a56cdcbd58 (127.24.175.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "aa75a15571b74a698cb8903ef0fb78b7" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 32869 } } peers { permanent_uuid: "0c4b4b269a314fcbbe5d31a56cdcbd58" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 46701 } attrs { promote: false } } peers { permanent_uuid: "246f1e8e44c54e4588a89c771a803c2e" member_type: NON_VOTER last_known_addr { host: "127.24.175.252" port: 46357 } attrs { promote: true } } }
I20260811 16:38:00.423144 4746 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "aa75a15571b74a698cb8903ef0fb78b7" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "aa75a15571b74a698cb8903ef0fb78b7" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 32869 } } peers { permanent_uuid: "0c4b4b269a314fcbbe5d31a56cdcbd58" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 46701 } attrs { promote: false } } peers { permanent_uuid: "246f1e8e44c54e4588a89c771a803c2e" member_type: NON_VOTER last_known_addr { host: "127.24.175.252" port: 46357 } attrs { promote: true } } }
I20260811 16:38:00.423239 4746 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:38:00.430275 4583 master.cc:552] Master@127.24.175.252:46357 shutdown complete.
I20260811 16:38:00.430313 4583 master_runner.cc:305] Clearing existing system tablet
I20260811 16:38:00.430441 4583 fs_manager.cc:359] Metadata directory not provided
I20260811 16:38:00.430480 4583 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:38:00.431041 4583 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:38:00.431486 4752 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:00.431581 4583 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:38:00.431624 4583 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:00.431648 4583 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/master-2/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/master-2/wal
uuid: "246f1e8e44c54e4588a89c771a803c2e"
format_stamp: "Formatted at 2026-08-11 16:38:00 on dist-test-slave-zj8q"
server_key: "c9c21f1399184c1c88aed9267581f958"
server_key_iv: "d2cc8ae58037baedd1196d5db1a8a70c"
server_key_version: "encryptionkey@0"
I20260811 16:38:00.432236 4583 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 246f1e8e44c54e4588a89c771a803c2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:38:00.433367 4583 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 246f1e8e44c54e4588a89c771a803c2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260811 16:38:00.433429 4583 log.cc:1196] T 00000000000000000000000000000000 P 246f1e8e44c54e4588a89c771a803c2e: Deleting WAL directory at /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260811 16:38:00.433627 4583 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 246f1e8e44c54e4588a89c771a803c2e: Deleting consensus metadata
I20260811 16:38:00.433750 4583 master_runner.cc:315] Copying system tablet from 127.24.175.254:32869
I20260811 16:38:00.434365 4583 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 246f1e8e44c54e4588a89c771a803c2e: tablet copy: Beginning tablet copy session from remote peer at address 127.24.175.254:32869
I20260811 16:38:00.443529 3516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:00.434669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35500 (local address 127.24.175.254:32869)
0811 16:38:00.434709 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:00.434711 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:00.438450 (+ 3739us) server_negotiation.cc:407] Connection header received
0811 16:38:00.438538 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:00.438539 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:00.438549 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:00.438594 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:00.438891 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.439376 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.440054 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.440243 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.440295 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:00.441197 (+ 902us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:38:00.441198 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:38:00.441199 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:38:00.441206 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:38:00.442559 (+ 1353us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:00.442859 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:00.442861 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:00.442861 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:00.442917 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:00.443072 (+ 155us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:00.443073 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:00.443074 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:00.443181 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:38:00.443242 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:00.443367 (+ 125us) server_negotiation.cc:299] Negotiation successful
0811 16:38:00.443439 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 16:38:00.443547 4761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:00.434622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:32869 (local address 127.0.0.1:35500)
0811 16:38:00.438369 (+ 3747us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:00.438380 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:00.438478 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:00.438603 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:00.438604 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:00.438782 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:00.438825 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:00.438827 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.439440 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.439441 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:00.439984 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:00.439985 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.440299 (+ 314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.440300 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:00.440364 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:00.440793 (+ 429us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:00.440798 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:00.441121 (+ 323us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:38:00.442627 (+ 1506us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:00.442628 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:00.442629 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:00.442799 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:00.442966 (+ 167us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:00.442967 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:00.442968 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:00.443024 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:00.443232 (+ 208us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:38:00.443233 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:38:00.443278 (+ 45us) client_negotiation.cc:769] Sending connection context
0811 16:38:00.443339 (+ 61us) client_negotiation.cc:240] Negotiation successful
0811 16:38:00.443439 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3724,"thread_start_us":85,"threads_started":1}
I20260811 16:38:00.444037 3474 tablet_copy_service.cc:140] P aa75a15571b74a698cb8903ef0fb78b7: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 246f1e8e44c54e4588a89c771a803c2e ({username='oryx', principal='oryx/127.24.175.252@KRBTEST.COM'} at 127.0.0.1:35500)
I20260811 16:38:00.444093 3474 tablet_copy_service.cc:161] P aa75a15571b74a698cb8903ef0fb78b7: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 246f1e8e44c54e4588a89c771a803c2e at {username='oryx', principal='oryx/127.24.175.252@KRBTEST.COM'} at 127.0.0.1:35500: session id = 246f1e8e44c54e4588a89c771a803c2e-00000000000000000000000000000000
I20260811 16:38:00.444542 3474 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P aa75a15571b74a698cb8903ef0fb78b7: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 16:38:00.444944 4583 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260811 16:38:00.445847 4583 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 246f1e8e44c54e4588a89c771a803c2e: tablet copy: Starting download of 0 data blocks...
I20260811 16:38:00.445971 4583 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 246f1e8e44c54e4588a89c771a803c2e: tablet copy: Starting download of 1 WAL segments...
I20260811 16:38:00.446563 4583 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 246f1e8e44c54e4588a89c771a803c2e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 16:38:00.447250 3474 tablet_copy_service.cc:342] P aa75a15571b74a698cb8903ef0fb78b7: Request end of tablet copy session 246f1e8e44c54e4588a89c771a803c2e-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.24.175.252@KRBTEST.COM'} at 127.0.0.1:35500
I20260811 16:38:00.447302 3474 tablet_copy_service.cc:433] P aa75a15571b74a698cb8903ef0fb78b7: ending tablet copy session 246f1e8e44c54e4588a89c771a803c2e-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 246f1e8e44c54e4588a89c771a803c2e
I20260811 16:38:00.449532 4583 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:38:00.450625 4762 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:38:00.450660 4768 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:38:00.450860 4763 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:38:00.454300 4583 server_base.cc:1034] running on GCE node
I20260811 16:38:00.454392 4583 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:38:00.454514 4583 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:38:00.455621 4583 hybrid_clock.cc:648] HybridClock initialized: now 1786466280455614 us; error 22 us; skew 500 ppm
Aug 11 16:38:00 dist-test-slave-zj8q krb5kdc[3363](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466280, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.175.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:38:00.456815 4583 init.cc:377] Logged in from keytab as oryx/127.24.175.252@KRBTEST.COM (short username oryx)
I20260811 16:38:00.457038 4583 webserver.cc:460] Webserver started at http://127.24.175.252:38331/ using document root <none> and password file <none>
I20260811 16:38:00.457150 4583 fs_manager.cc:359] Metadata directory not provided
I20260811 16:38:00.457183 4583 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:38:00.457723 4583 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:00.458248 4780 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:00.458349 4583 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:00.458384 4583 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/master-2/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/master-2/wal
uuid: "246f1e8e44c54e4588a89c771a803c2e"
format_stamp: "Formatted at 2026-08-11 16:38:00 on dist-test-slave-zj8q"
server_key: "c9c21f1399184c1c88aed9267581f958"
server_key_iv: "d2cc8ae58037baedd1196d5db1a8a70c"
server_key_version: "encryptionkey@0"
I20260811 16:38:00.458436 4583 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:38:00.474027 4583 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:38:00.475505 4583 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:38:00.478436 4583 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.252:46357
I20260811 16:38:00.478526 4877 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.252:46357 every 8 connection(s)
I20260811 16:38:00.478746 4583 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/master-2/data/info.pb
I20260811 16:38:00.479491 4878 sys_catalog.cc:263] Verifying existing consensus state
I20260811 16:38:00.479876 4878 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 246f1e8e44c54e4588a89c771a803c2e: Bootstrap starting.
I20260811 16:38:00.481956 4878 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 246f1e8e44c54e4588a89c771a803c2e: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:38:00.482189 4878 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 246f1e8e44c54e4588a89c771a803c2e: Bootstrap complete.
I20260811 16:38:00.482374 4878 raft_consensus.cc:348] T 00000000000000000000000000000000 P 246f1e8e44c54e4588a89c771a803c2e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "aa75a15571b74a698cb8903ef0fb78b7" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 32869 } } peers { permanent_uuid: "0c4b4b269a314fcbbe5d31a56cdcbd58" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 46701 } attrs { promote: false } } peers { permanent_uuid: "246f1e8e44c54e4588a89c771a803c2e" member_type: NON_VOTER last_known_addr { host: "127.24.175.252" port: 46357 } attrs { promote: true } }
I20260811 16:38:00.482443 4878 raft_consensus.cc:729] T 00000000000000000000000000000000 P 246f1e8e44c54e4588a89c771a803c2e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 246f1e8e44c54e4588a89c771a803c2e, State: Initialized, Role: LEARNER
I20260811 16:38:00.482479 4878 consensus_queue.cc:260] T 00000000000000000000000000000000 P 246f1e8e44c54e4588a89c771a803c2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "aa75a15571b74a698cb8903ef0fb78b7" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 32869 } } peers { permanent_uuid: "0c4b4b269a314fcbbe5d31a56cdcbd58" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 46701 } attrs { promote: false } } peers { permanent_uuid: "246f1e8e44c54e4588a89c771a803c2e" member_type: NON_VOTER last_known_addr { host: "127.24.175.252" port: 46357 } attrs { promote: true } }
I20260811 16:38:00.482654 4878 sys_catalog.cc:564] T 00000000000000000000000000000000 P 246f1e8e44c54e4588a89c771a803c2e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:38:00.482645 4883 sys_catalog.cc:455] T 00000000000000000000000000000000 P 246f1e8e44c54e4588a89c771a803c2e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "aa75a15571b74a698cb8903ef0fb78b7" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 32869 } } peers { permanent_uuid: "0c4b4b269a314fcbbe5d31a56cdcbd58" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 46701 } attrs { promote: false } } peers { permanent_uuid: "246f1e8e44c54e4588a89c771a803c2e" member_type: NON_VOTER last_known_addr { host: "127.24.175.252" port: 46357 } attrs { promote: true } } }
I20260811 16:38:00.482829 4883 sys_catalog.cc:458] T 00000000000000000000000000000000 P 246f1e8e44c54e4588a89c771a803c2e [sys.catalog]: This master's current role is: LEARNER
I20260811 16:38:00.484104 4901 catalog_manager.cc:1259] Loaded cluster ID: 0e428c83b67d4dcea16df7d63a9479e8
I20260811 16:38:00.484819 4901 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 246f1e8e44c54e4588a89c771a803c2e: loading cluster ID for follower catalog manager: success
I20260811 16:38:00.485548 4901 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 246f1e8e44c54e4588a89c771a803c2e: acquiring CA information for follower catalog manager: success
I20260811 16:38:00.485808 4901 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 246f1e8e44c54e4588a89c771a803c2e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260811 16:38:00.525976 4744 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:38:00.526196 4744 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:38:00.526217 4744 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:38:00.527351 4744 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:38:00.527388 4744 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:38:00.527412 4744 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.193
I20260811 16:38:00.528874 4744 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:44883
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/krb5kdc/oryx_127.24.175.193.keytab
--principal=oryx/127.24.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.193:39351
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.175.193
--webserver_port=39665
--tserver_master_addrs=127.24.175.254:32869,127.24.175.253:46701,127.24.175.252:46357
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4744
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.193
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:38:00.529065 4744 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:38:00.529241 4744 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:38:00.534298 4914 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:38:00.534334 4744 server_base.cc:1034] running on GCE node
W20260811 16:38:00.534412 4912 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:38:00.534309 4910 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:38:00.534657 4744 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:38:00.534875 4744 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:38:00.536010 4744 hybrid_clock.cc:648] HybridClock initialized: now 1786466280535995 us; error 31 us; skew 500 ppm
Aug 11 16:38:00 dist-test-slave-zj8q krb5kdc[3363](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466280, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:38:00.538403 4744 init.cc:377] Logged in from keytab as oryx/127.24.175.193@KRBTEST.COM (short username oryx)
I20260811 16:38:00.538812 4744 webserver.cc:460] Webserver started at http://127.24.175.193:39665/ using document root <none> and password file <none>
I20260811 16:38:00.538997 4744 fs_manager.cc:359] Metadata directory not provided
I20260811 16:38:00.539048 4744 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:38:00.540270 4744 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:38:00.540769 4929 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:00.540908 4744 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:00.540987 4744 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-0/wal
uuid: "7cc554e49f17483b9143ff94990f2697"
format_stamp: "Formatted at 2026-08-11 16:37:59 on dist-test-slave-zj8q"
server_key: "d7a784d1b937b93edc324b619d8dc711"
server_key_iv: "2960e7c2aecda66ee05b6b47d2ed9b71"
server_key_version: "encryptionkey@0"
I20260811 16:38:00.541307 4744 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:38:00.549458 4744 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:38:00.551436 4744 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:38:00.551555 4744 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:38:00.551748 4744 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:38:00.552026 4744 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:38:00.552066 4744 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:00.552086 4744 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:38:00.552111 4744 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:00.558444 4744 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.193:39351
I20260811 16:38:00.558483 5135 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.193:39351 every 8 connection(s)
I20260811 16:38:00.558812 4744 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
I20260811 16:38:00.559062 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 4744
I20260811 16:38:00.559217 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 3774
Aug 11 16:38:00 dist-test-slave-zj8q krb5kdc[3363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466280, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.175.193@KRBTEST.COM for oryx/127.24.175.252@KRBTEST.COM
Aug 11 16:38:00 dist-test-slave-zj8q krb5kdc[3363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466280, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.175.193@KRBTEST.COM for oryx/127.24.175.253@KRBTEST.COM
I20260811 16:38:00.571440 4577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:00.559783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:42665 (local address 127.24.175.253:46701)
0811 16:38:00.559827 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:00.559829 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:00.561086 (+ 1257us) server_negotiation.cc:407] Connection header received
0811 16:38:00.561162 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:00.561163 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:00.561173 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:00.561199 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:00.561958 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.562688 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.564288 (+ 1600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.564574 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.564611 (+ 37us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:00.567800 (+ 3189us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:38:00.567802 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:38:00.567802 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:38:00.567810 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:38:00.569576 (+ 1766us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:00.570275 (+ 699us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:00.570277 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:00.570277 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:00.570340 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:00.570673 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:00.570674 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:00.570675 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:00.570820 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:38:00.570862 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:00.571244 (+ 382us) server_negotiation.cc:299] Negotiation successful
0811 16:38:00.571347 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 16:38:00.572113 5155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:00.559497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.253:46701 (local address 127.24.175.193:42665)
0811 16:38:00.561037 (+ 1540us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:00.561045 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:00.561106 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:00.561331 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:00.561335 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:00.561631 (+ 296us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:00.561865 (+ 234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:00.561870 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.562938 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.562939 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:00.564180 (+ 1241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:00.564183 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.564692 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.564693 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:00.564827 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:00.565506 (+ 679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:00.565517 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:00.567527 (+ 2010us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:38:00.569662 (+ 2135us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:00.569670 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:00.569672 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:00.570178 (+ 506us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:00.570413 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:00.570414 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:00.570414 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:00.570592 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:00.570906 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:38:00.570913 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:38:00.571084 (+ 171us) client_negotiation.cc:769] Sending connection context
0811 16:38:00.571673 (+ 589us) client_negotiation.cc:240] Negotiation successful
0811 16:38:00.571942 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1516,"mutex_wait_us":133,"thread_start_us":85,"threads_started":1}
I20260811 16:38:00.572357 5157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:00.559745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:60565 (local address 127.24.175.252:46357)
0811 16:38:00.562019 (+ 2274us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:00.562022 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:00.562029 (+ 7us) server_negotiation.cc:407] Connection header received
0811 16:38:00.562051 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:00.562052 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:00.562065 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:00.562129 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:00.562543 (+ 414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.563491 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.564436 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.564744 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.564803 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:00.568178 (+ 3375us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:38:00.568180 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:38:00.568180 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:38:00.568188 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:38:00.570809 (+ 2621us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:00.571155 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:00.571157 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:00.571157 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:00.571217 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:00.571398 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:00.571399 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:00.571400 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:00.571524 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:38:00.571580 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:00.572172 (+ 592us) server_negotiation.cc:299] Negotiation successful
0811 16:38:00.572260 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2255,"thread_start_us":2210,"threads_started":1}
I20260811 16:38:00.572114 5153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:00.559496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.252:46357 (local address 127.24.175.193:60565)
0811 16:38:00.559897 (+ 401us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:00.559936 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:00.560905 (+ 969us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:00.562203 (+ 1298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:00.562204 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:00.562369 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:00.562445 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:00.562447 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.563587 (+ 1140us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.563588 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:00.564361 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:00.564363 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.564856 (+ 493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.564856 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:00.564917 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:00.565718 (+ 801us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:00.565723 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:00.567708 (+ 1985us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:38:00.570890 (+ 3182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:00.570890 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:00.570891 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:00.571079 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:00.571281 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:00.571281 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:00.571282 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:00.571338 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:00.571608 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:38:00.571608 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:38:00.571650 (+ 42us) client_negotiation.cc:769] Sending connection context
0811 16:38:00.571709 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 16:38:00.571869 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":366,"thread_start_us":74,"threads_started":1}
I20260811 16:38:00.572584 5149 heartbeater.cc:347] Connected to a master server at 127.24.175.253:46701
I20260811 16:38:00.572666 5149 heartbeater.cc:464] Registering TS with master...
I20260811 16:38:00.572865 5142 heartbeater.cc:347] Connected to a master server at 127.24.175.252:46357
I20260811 16:38:00.572901 5142 heartbeater.cc:464] Registering TS with master...
I20260811 16:38:00.572942 5149 heartbeater.cc:511] Master 127.24.175.253:46701 requested a full tablet report, sending...
I20260811 16:38:00.572943 5142 heartbeater.cc:511] Master 127.24.175.252:46357 requested a full tablet report, sending...
I20260811 16:38:00.573441 4813 ts_manager.cc:194] Registered new tserver with Master: 7cc554e49f17483b9143ff94990f2697 (127.24.175.193:39351)
I20260811 16:38:00.573441 4496 ts_manager.cc:194] Registered new tserver with Master: 7cc554e49f17483b9143ff94990f2697 (127.24.175.193:39351)
Aug 11 16:38:00 dist-test-slave-zj8q krb5kdc[3363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466280, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.175.193@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM
I20260811 16:38:00.582374 3516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:00.562815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:45415 (local address 127.24.175.254:32869)
0811 16:38:00.562853 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:00.562855 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:00.565125 (+ 2270us) server_negotiation.cc:407] Connection header received
0811 16:38:00.565222 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:00.565223 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:00.565234 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:00.565273 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:00.567389 (+ 2116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.568095 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.569771 (+ 1676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.570053 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.570097 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:00.580196 (+ 10099us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:38:00.580197 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:38:00.580198 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:38:00.580205 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:38:00.581356 (+ 1151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:00.581702 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:00.581702 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:00.581702 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:00.581748 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:00.581901 (+ 153us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:00.581902 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:00.581902 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:00.581998 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:38:00.582041 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:00.582219 (+ 178us) server_negotiation.cc:299] Negotiation successful
0811 16:38:00.582291 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 16:38:00.582479 5158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:00.562387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:32869 (local address 127.24.175.193:45415)
0811 16:38:00.565066 (+ 2679us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:00.565076 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:00.565152 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:00.565356 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:00.565357 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:00.565550 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:00.565608 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:00.565611 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.568486 (+ 2875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.568487 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:00.569300 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:00.569303 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.573880 (+ 4577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.573881 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:00.573994 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:00.578660 (+ 4666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:00.578666 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:00.580096 (+ 1430us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:38:00.581446 (+ 1350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:00.581447 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:00.581447 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:00.581639 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:00.581796 (+ 157us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:00.581796 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:00.581797 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:00.581855 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:00.582043 (+ 188us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:38:00.582044 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:38:00.582088 (+ 44us) client_negotiation.cc:769] Sending connection context
0811 16:38:00.582208 (+ 120us) client_negotiation.cc:240] Negotiation successful
0811 16:38:00.582316 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2663,"thread_start_us":71,"threads_started":1}
I20260811 16:38:00.582929 5147 heartbeater.cc:347] Connected to a master server at 127.24.175.254:32869
I20260811 16:38:00.582983 5147 heartbeater.cc:464] Registering TS with master...
I20260811 16:38:00.583053 5147 heartbeater.cc:511] Master 127.24.175.254:32869 requested a full tablet report, sending...
I20260811 16:38:00.583366 3437 ts_manager.cc:194] Re-registered known tserver with Master: 7cc554e49f17483b9143ff94990f2697 (127.24.175.193:39351)
I20260811 16:38:00.583824 3437 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.24.175.193@KRBTEST.COM'} at 127.24.175.193:45415
I20260811 16:38:00.584213 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.194:43771
--local_ip_for_outbound_sockets=127.24.175.194
--tserver_master_addrs=127.24.175.254:32869
--webserver_port=40039
--webserver_interface=127.24.175.194
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/krb5kdc/oryx_127.24.175.194.keytab
--principal=oryx/127.24.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:44883
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.24.175.254:32869,127.24.175.253:46701
--tserver_master_addrs=127.24.175.254:32869,127.24.175.253:46701,127.24.175.252:46357 with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:38:00.670269 5159 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:38:00.670457 5159 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:38:00.670478 5159 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:38:00.671612 5159 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:38:00.671653 5159 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:38:00.671679 5159 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.194
I20260811 16:38:00.673156 5159 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:44883
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/krb5kdc/oryx_127.24.175.194.keytab
--principal=oryx/127.24.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.194:43771
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.175.194
--webserver_port=40039
--tserver_master_addrs=127.24.175.254:32869,127.24.175.253:46701,127.24.175.252:46357
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5159
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.194
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:38:00.673336 5159 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:38:00.673509 5159 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:38:00.678406 5170 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:38:00.678423 5174 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:38:00.678436 5172 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:38:00.678603 5159 server_base.cc:1034] running on GCE node
I20260811 16:38:00.678849 5159 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:38:00.679076 5159 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:38:00.680220 5159 hybrid_clock.cc:648] HybridClock initialized: now 1786466280680209 us; error 28 us; skew 500 ppm
Aug 11 16:38:00 dist-test-slave-zj8q krb5kdc[3363](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466280, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:38:00.682624 5159 init.cc:377] Logged in from keytab as oryx/127.24.175.194@KRBTEST.COM (short username oryx)
I20260811 16:38:00.683076 5159 webserver.cc:460] Webserver started at http://127.24.175.194:40039/ using document root <none> and password file <none>
I20260811 16:38:00.683259 5159 fs_manager.cc:359] Metadata directory not provided
I20260811 16:38:00.683308 5159 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:38:00.684578 5159 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:38:00.685083 5184 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:00.685230 5159 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:00.685317 5159 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-1/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-1/wal
uuid: "ac7de4f358864daa98d98cb042072912"
format_stamp: "Formatted at 2026-08-11 16:37:59 on dist-test-slave-zj8q"
server_key: "e9438d9d0e25198a1c5ed6d4ce078328"
server_key_iv: "6f6ed6b35c8cf6b9206f40c1967a0b95"
server_key_version: "encryptionkey@0"
I20260811 16:38:00.685652 5159 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:38:00.708343 5159 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:38:00.710206 5159 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:38:00.710351 5159 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:38:00.710604 5159 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:38:00.710932 5159 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:38:00.710966 5159 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:00.710999 5159 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:38:00.711021 5159 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:00.716598 5159 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.194:43771
I20260811 16:38:00.716672 5364 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.194:43771 every 8 connection(s)
I20260811 16:38:00.717003 5159 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
I20260811 16:38:00.719687 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 5159
I20260811 16:38:00.719859 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 4024
Aug 11 16:38:00 dist-test-slave-zj8q krb5kdc[3363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466280, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.175.194@KRBTEST.COM for oryx/127.24.175.252@KRBTEST.COM
Aug 11 16:38:00 dist-test-slave-zj8q krb5kdc[3363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466280, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.175.194@KRBTEST.COM for oryx/127.24.175.253@KRBTEST.COM
I20260811 16:38:00.728353 5157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:00.718018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:49723 (local address 127.24.175.252:46357)
0811 16:38:00.718067 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:00.718068 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:00.718289 (+ 221us) server_negotiation.cc:407] Connection header received
0811 16:38:00.719460 (+ 1171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:00.719461 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:00.719473 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:00.719514 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:00.720261 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.720893 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.722202 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.722446 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.722479 (+ 33us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:00.725513 (+ 3034us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:38:00.725514 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:38:00.725514 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:38:00.725539 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:38:00.727111 (+ 1572us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:00.727497 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:00.727498 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:00.727498 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:00.727557 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:00.727764 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:00.727764 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:00.727765 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:00.727870 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:38:00.727903 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:00.728195 (+ 292us) server_negotiation.cc:299] Negotiation successful
0811 16:38:00.728274 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 16:38:00.728818 5373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:00.717713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.252:46357 (local address 127.24.175.194:49723)
0811 16:38:00.718140 (+ 427us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:00.718208 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:00.719176 (+ 968us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:00.719546 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:00.719547 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:00.719892 (+ 345us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:00.720159 (+ 267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:00.720165 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.720999 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.721000 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:00.722077 (+ 1077us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:00.722079 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.722559 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.722560 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:00.722678 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:00.723143 (+ 465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:00.723152 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:00.725195 (+ 2043us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:38:00.727191 (+ 1996us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:00.727198 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:00.727200 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:00.727432 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:00.727611 (+ 179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:00.727612 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:00.727612 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:00.727714 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:00.727934 (+ 220us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:38:00.727938 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:38:00.728079 (+ 141us) client_negotiation.cc:769] Sending connection context
0811 16:38:00.728463 (+ 384us) client_negotiation.cc:240] Negotiation successful
0811 16:38:00.728622 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":398,"thread_start_us":88,"threads_started":1}
I20260811 16:38:00.729000 4577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:00.717806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:35845 (local address 127.24.175.253:46701)
0811 16:38:00.718014 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:00.718016 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:00.718292 (+ 276us) server_negotiation.cc:407] Connection header received
0811 16:38:00.719346 (+ 1054us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:00.719348 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:00.719360 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:00.719411 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:00.720263 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.721209 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.722511 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.722889 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.722939 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:00.725511 (+ 2572us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:38:00.725512 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:38:00.725513 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:38:00.725532 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:38:00.727400 (+ 1868us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:00.727874 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:00.727876 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:00.727876 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:00.727947 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:00.728190 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:00.728191 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:00.728192 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:00.728349 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:38:00.728402 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:00.728796 (+ 394us) server_negotiation.cc:299] Negotiation successful
0811 16:38:00.728896 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":180}
I20260811 16:38:00.729444 5365 heartbeater.cc:347] Connected to a master server at 127.24.175.252:46357
I20260811 16:38:00.729559 5365 heartbeater.cc:464] Registering TS with master...
I20260811 16:38:00.729661 5376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:00.717713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.253:46701 (local address 127.24.175.194:35845)
0811 16:38:00.718231 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:00.718239 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:00.719165 (+ 926us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:00.719435 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:00.719440 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:00.719894 (+ 454us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:00.720160 (+ 266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:00.720165 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.721319 (+ 1154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.721320 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:00.722399 (+ 1079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:00.722402 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.723027 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.723028 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:00.723104 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:00.723476 (+ 372us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:00.723481 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:00.725429 (+ 1948us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:38:00.727509 (+ 2080us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:00.727510 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:00.727511 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:00.727772 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:00.728029 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:00.728030 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:00.728031 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:00.728102 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:00.728575 (+ 473us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:38:00.728576 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:38:00.728628 (+ 52us) client_negotiation.cc:769] Sending connection context
0811 16:38:00.729281 (+ 653us) client_negotiation.cc:240] Negotiation successful
0811 16:38:00.729398 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":485,"mutex_wait_us":44,"thread_start_us":73,"threads_started":1}
I20260811 16:38:00.729732 5365 heartbeater.cc:511] Master 127.24.175.252:46357 requested a full tablet report, sending...
I20260811 16:38:00.730225 4813 ts_manager.cc:194] Registered new tserver with Master: ac7de4f358864daa98d98cb042072912 (127.24.175.194:43771)
I20260811 16:38:00.735530 5367 heartbeater.cc:347] Connected to a master server at 127.24.175.253:46701
I20260811 16:38:00.735591 5367 heartbeater.cc:464] Registering TS with master...
I20260811 16:38:00.735666 5367 heartbeater.cc:511] Master 127.24.175.253:46701 requested a full tablet report, sending...
I20260811 16:38:00.735996 4496 ts_manager.cc:194] Registered new tserver with Master: ac7de4f358864daa98d98cb042072912 (127.24.175.194:43771)
Aug 11 16:38:00 dist-test-slave-zj8q krb5kdc[3363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466280, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.175.194@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM
I20260811 16:38:00.740049 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.195:36259
--local_ip_for_outbound_sockets=127.24.175.195
--tserver_master_addrs=127.24.175.254:32869
--webserver_port=44633
--webserver_interface=127.24.175.195
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/krb5kdc/oryx_127.24.175.195.keytab
--principal=oryx/127.24.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:44883
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.24.175.254:32869,127.24.175.253:46701
--tserver_master_addrs=127.24.175.254:32869,127.24.175.253:46701,127.24.175.252:46357 with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 16:38:00.741818 3516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:00.718023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:44633 (local address 127.24.175.254:32869)
0811 16:38:00.718065 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:00.718066 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:00.718292 (+ 226us) server_negotiation.cc:407] Connection header received
0811 16:38:00.719287 (+ 995us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:00.719289 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:00.719303 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:00.719352 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:00.735959 (+ 16607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.736545 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.737209 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.737497 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.737659 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:00.739465 (+ 1806us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:38:00.739466 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:38:00.739467 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:38:00.739474 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:38:00.740735 (+ 1261us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:00.741057 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:00.741058 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:00.741058 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:00.741109 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:00.741318 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:00.741319 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:00.741320 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:00.741474 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:38:00.741535 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:00.741689 (+ 154us) server_negotiation.cc:299] Negotiation successful
0811 16:38:00.741755 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 16:38:00.741869 5371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:00.717713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:32869 (local address 127.24.175.194:44633)
0811 16:38:00.718139 (+ 426us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:00.718211 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:00.719177 (+ 966us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:00.719435 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:00.719440 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:00.735790 (+ 16350us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:00.735854 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:00.735856 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.736626 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.736626 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:00.737123 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:00.737124 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.737653 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.737655 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:00.737742 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:00.738106 (+ 364us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:00.738111 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:00.739390 (+ 1279us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:38:00.740814 (+ 1424us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:00.740815 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:00.740816 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:00.740986 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:00.741162 (+ 176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:00.741162 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:00.741163 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:00.741220 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:00.741535 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:38:00.741536 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:38:00.741582 (+ 46us) client_negotiation.cc:769] Sending connection context
0811 16:38:00.741643 (+ 61us) client_negotiation.cc:240] Negotiation successful
0811 16:38:00.741745 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":389,"thread_start_us":81,"threads_started":1}
I20260811 16:38:00.742274 5366 heartbeater.cc:347] Connected to a master server at 127.24.175.254:32869
I20260811 16:38:00.742336 5366 heartbeater.cc:464] Registering TS with master...
I20260811 16:38:00.742413 5366 heartbeater.cc:511] Master 127.24.175.254:32869 requested a full tablet report, sending...
I20260811 16:38:00.742663 3437 ts_manager.cc:194] Re-registered known tserver with Master: ac7de4f358864daa98d98cb042072912 (127.24.175.194:43771)
I20260811 16:38:00.743104 3437 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.24.175.194@KRBTEST.COM'} at 127.24.175.194:44633
W20260811 16:38:00.822402 5379 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:38:00.822593 5379 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:38:00.822615 5379 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:38:00.823813 5379 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:38:00.823854 5379 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:38:00.823879 5379 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.195
I20260811 16:38:00.825289 5379 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:44883
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/krb5kdc/oryx_127.24.175.195.keytab
--principal=oryx/127.24.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.195:36259
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.175.195
--webserver_port=44633
--tserver_master_addrs=127.24.175.254:32869,127.24.175.253:46701,127.24.175.252:46357
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5379
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.195
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:38:00.825465 5379 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:38:00.825659 5379 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:38:00.830545 5390 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:38:00.830526 5388 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:38:00.830601 5379 server_base.cc:1034] running on GCE node
W20260811 16:38:00.830526 5398 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:38:00.830919 5379 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:38:00.831148 5379 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:38:00.832284 5379 hybrid_clock.cc:648] HybridClock initialized: now 1786466280832282 us; error 31 us; skew 500 ppm
Aug 11 16:38:00 dist-test-slave-zj8q krb5kdc[3363](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466280, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:38:00.834816 5379 init.cc:377] Logged in from keytab as oryx/127.24.175.195@KRBTEST.COM (short username oryx)
I20260811 16:38:00.835234 5379 webserver.cc:460] Webserver started at http://127.24.175.195:44633/ using document root <none> and password file <none>
I20260811 16:38:00.835438 5379 fs_manager.cc:359] Metadata directory not provided
I20260811 16:38:00.835500 5379 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:38:00.836730 5379 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:38:00.837266 5408 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:00.837406 5379 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:00.837488 5379 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-2/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-2/wal
uuid: "fd8823eeae954b089aaf278fc23441ec"
format_stamp: "Formatted at 2026-08-11 16:37:59 on dist-test-slave-zj8q"
server_key: "6624eb9f0c0f90bb9757a8b69fc36458"
server_key_iv: "fbdfa2b3e59e7db0c810eaebfd52e641"
server_key_version: "encryptionkey@0"
I20260811 16:38:00.837807 5379 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:38:00.849105 5379 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:38:00.850711 5379 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:38:00.850831 5379 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:38:00.851025 5379 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:38:00.851303 5379 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:38:00.851336 5379 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:00.851363 5379 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:38:00.851382 5379 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:00.856869 5379 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.195:36259
I20260811 16:38:00.856928 5601 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.195:36259 every 8 connection(s)
I20260811 16:38:00.857229 5379 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
Aug 11 16:38:00 dist-test-slave-zj8q krb5kdc[3363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466280, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.175.195@KRBTEST.COM for oryx/127.24.175.253@KRBTEST.COM
Aug 11 16:38:00 dist-test-slave-zj8q krb5kdc[3363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466280, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.175.195@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM
Aug 11 16:38:00 dist-test-slave-zj8q krb5kdc[3363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466280, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.175.195@KRBTEST.COM for oryx/127.24.175.252@KRBTEST.COM
I20260811 16:38:00.866227 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 5379
I20260811 16:38:00.867129 4577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:00.857917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.195:57167 (local address 127.24.175.253:46701)
0811 16:38:00.858017 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:00.858018 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:00.858228 (+ 210us) server_negotiation.cc:407] Connection header received
0811 16:38:00.858844 (+ 616us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:00.858846 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:00.858858 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:00.858908 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:00.859512 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.860290 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.861535 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.861730 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.861788 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:00.864097 (+ 2309us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:38:00.864098 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:38:00.864099 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:38:00.864106 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:38:00.865486 (+ 1380us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:00.866049 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:00.866050 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:00.866051 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:00.866111 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:00.866404 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:00.866405 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:00.866405 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:00.866532 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:38:00.866575 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:00.866967 (+ 392us) server_negotiation.cc:299] Negotiation successful
0811 16:38:00.867042 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 16:38:00.867280 5614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:00.857914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.253:46701 (local address 127.24.175.195:57167)
0811 16:38:00.858080 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:00.858121 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:00.858674 (+ 553us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:00.858929 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:00.858933 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:00.859237 (+ 304us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:00.859419 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:00.859424 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.860390 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.860391 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:00.861452 (+ 1061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:00.861454 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.861852 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.861853 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:00.861995 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:00.862468 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:00.862478 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:00.864013 (+ 1535us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:38:00.865586 (+ 1573us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:00.865592 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:00.865594 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:00.865983 (+ 389us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:00.866195 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:00.866196 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:00.866196 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:00.866322 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:00.866623 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:38:00.866629 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:38:00.866791 (+ 162us) client_negotiation.cc:769] Sending connection context
0811 16:38:00.866925 (+ 134us) client_negotiation.cc:240] Negotiation successful
0811 16:38:00.867075 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":97,"threads_started":1}
I20260811 16:38:00.867708 3516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:00.858232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.195:48135 (local address 127.24.175.254:32869)
0811 16:38:00.858286 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:00.858288 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:00.858355 (+ 67us) server_negotiation.cc:407] Connection header received
0811 16:38:00.858769 (+ 414us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:00.858770 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:00.858784 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:00.858835 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:00.860410 (+ 1575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.860874 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.861785 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.862061 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.862132 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:00.864989 (+ 2857us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:38:00.864991 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:38:00.864991 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:38:00.864998 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:38:00.866526 (+ 1528us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:00.866911 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:00.866912 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:00.866912 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:00.866971 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:00.867189 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:00.867190 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:00.867191 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:00.867319 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:38:00.867359 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:00.867552 (+ 193us) server_negotiation.cc:299] Negotiation successful
0811 16:38:00.867626 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 16:38:00.867865 5607 heartbeater.cc:347] Connected to a master server at 127.24.175.253:46701
I20260811 16:38:00.867952 5607 heartbeater.cc:464] Registering TS with master...
I20260811 16:38:00.868016 5617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:00.858173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:32869 (local address 127.24.175.195:48135)
0811 16:38:00.858301 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:00.858310 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:00.858675 (+ 365us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:00.859281 (+ 606us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:00.859283 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:00.859442 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:00.859490 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:00.859492 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.860947 (+ 1455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.860948 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:00.861713 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:00.861715 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.862135 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.862136 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:00.862437 (+ 301us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:00.862865 (+ 428us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:00.862869 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:00.864915 (+ 2046us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:38:00.866612 (+ 1697us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:00.866613 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:00.866613 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:00.866822 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:00.867045 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:00.867046 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:00.867046 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:00.867104 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:00.867403 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:38:00.867403 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:38:00.867443 (+ 40us) client_negotiation.cc:769] Sending connection context
0811 16:38:00.867791 (+ 348us) client_negotiation.cc:240] Negotiation successful
0811 16:38:00.867890 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":61,"threads_started":1}
I20260811 16:38:00.868145 5157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:00.857910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.195:40209 (local address 127.24.175.252:46357)
0811 16:38:00.857976 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:00.857979 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:00.858226 (+ 247us) server_negotiation.cc:407] Connection header received
0811 16:38:00.858971 (+ 745us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:00.858972 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:00.858983 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:00.859024 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:00.859542 (+ 518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.860321 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.862234 (+ 1913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.862462 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.862532 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:00.865247 (+ 2715us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:38:00.865249 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:38:00.865249 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:38:00.865257 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:38:00.866794 (+ 1537us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:00.867357 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:00.867358 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:00.867359 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:00.867416 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:00.867602 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:00.867603 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:00.867603 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:00.867737 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:38:00.867782 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:00.867976 (+ 194us) server_negotiation.cc:299] Negotiation successful
0811 16:38:00.868058 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 16:38:00.868147 5607 heartbeater.cc:511] Master 127.24.175.253:46701 requested a full tablet report, sending...
I20260811 16:38:00.868439 5605 heartbeater.cc:347] Connected to a master server at 127.24.175.254:32869
I20260811 16:38:00.868489 5605 heartbeater.cc:464] Registering TS with master...
I20260811 16:38:00.868556 5605 heartbeater.cc:511] Master 127.24.175.254:32869 requested a full tablet report, sending...
I20260811 16:38:00.868538 4496 ts_manager.cc:194] Registered new tserver with Master: fd8823eeae954b089aaf278fc23441ec (127.24.175.195:36259)
I20260811 16:38:00.868659 5615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:00.857914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.252:46357 (local address 127.24.175.195:40209)
0811 16:38:00.858135 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:00.858143 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:00.858677 (+ 534us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:00.859086 (+ 409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:00.859087 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:00.859346 (+ 259us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:00.859425 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:00.859427 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.861543 (+ 2116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.861543 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:00.862109 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:00.862112 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.862544 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.862545 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:00.862605 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:00.863027 (+ 422us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:00.863031 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:00.864915 (+ 1884us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:38:00.867095 (+ 2180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:00.867096 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:00.867096 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:00.867276 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:00.867483 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:00.867484 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:00.867484 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:00.867535 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:00.867830 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:38:00.867830 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:38:00.867867 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 16:38:00.868269 (+ 402us) client_negotiation.cc:240] Negotiation successful
0811 16:38:00.868366 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":84,"threads_started":1}
I20260811 16:38:00.868822 3437 ts_manager.cc:194] Re-registered known tserver with Master: fd8823eeae954b089aaf278fc23441ec (127.24.175.195:36259)
I20260811 16:38:00.869267 3437 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.24.175.195@KRBTEST.COM'} at 127.24.175.195:48135
I20260811 16:38:00.869520 5603 heartbeater.cc:347] Connected to a master server at 127.24.175.252:46357
I20260811 16:38:00.869565 5603 heartbeater.cc:464] Registering TS with master...
I20260811 16:38:00.869626 5603 heartbeater.cc:511] Master 127.24.175.252:46357 requested a full tablet report, sending...
I20260811 16:38:00.869917 4813 ts_manager.cc:194] Registered new tserver with Master: fd8823eeae954b089aaf278fc23441ec (127.24.175.195:36259)
I20260811 16:38:00.876665 3516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:00.869004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35516 (local address 127.24.175.254:32869)
0811 16:38:00.869042 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:00.869044 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:00.870085 (+ 1041us) server_negotiation.cc:407] Connection header received
0811 16:38:00.870179 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:00.870180 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:00.870190 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:00.870243 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:00.870856 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.871382 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.872421 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.872686 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.872717 (+ 31us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:00.874086 (+ 1369us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:38:00.874087 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:38:00.874087 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:38:00.874095 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:38:00.875532 (+ 1437us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:00.875944 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:00.875945 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:00.875945 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:00.876011 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:00.876217 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:00.876218 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:00.876219 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:00.876319 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:38:00.876401 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:00.876498 (+ 97us) server_negotiation.cc:299] Negotiation successful
0811 16:38:00.876568 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 16:38:00.876801 4577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:00.869350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42276 (local address 127.24.175.253:46701)
0811 16:38:00.869384 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:00.869386 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:00.870272 (+ 886us) server_negotiation.cc:407] Connection header received
0811 16:38:00.870348 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:00.870349 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:00.870359 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:00.870402 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:00.870884 (+ 482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.871616 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.872441 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.872714 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.872781 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:00.874063 (+ 1282us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:38:00.874064 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:38:00.874065 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:38:00.874071 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:38:00.875513 (+ 1442us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:00.876022 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:00.876023 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:00.876023 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:00.876076 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:00.876267 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:00.876268 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:00.876268 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:00.876373 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:38:00.876438 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:00.876659 (+ 221us) server_negotiation.cc:299] Negotiation successful
0811 16:38:00.876720 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 16:38:00.876996 5157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:00.867723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35074 (local address 127.24.175.252:46357)
0811 16:38:00.868213 (+ 490us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:00.868215 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:00.869141 (+ 926us) server_negotiation.cc:407] Connection header received
0811 16:38:00.869221 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:00.869222 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:00.869242 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:00.869268 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:00.870004 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.870705 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.871823 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.872111 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.872178 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:00.873523 (+ 1345us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:38:00.873524 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:38:00.873524 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:38:00.873532 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:38:00.874938 (+ 1406us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:00.875992 (+ 1054us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:00.875993 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:00.875994 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:00.876046 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:00.876246 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:00.876247 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:00.876247 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:00.876384 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:38:00.876461 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:00.876849 (+ 388us) server_negotiation.cc:299] Negotiation successful
0811 16:38:00.876916 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":477,"thread_start_us":51,"threads_started":1}
I20260811 16:38:00.878075 3437 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35516:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:38:00.879693 3437 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:38:00.886294 5649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:00.883196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.195:36259 (local address 127.0.0.1:37090)
0811 16:38:00.883529 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:00.883538 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:00.883589 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:00.883735 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:00.883735 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:00.883737 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:38:00.883781 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:00.883782 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.884553 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.884554 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:00.885296 (+ 742us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:00.885299 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.886022 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.886023 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:00.886086 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:00.886091 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 16:38:00.886168 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 16:38:00.886216 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":315,"mutex_wait_us":13,"thread_start_us":105,"threads_started":1}
I20260811 16:38:00.886289 5650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:00.883296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37090 (local address 127.24.175.195:36259)
0811 16:38:00.883443 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:00.883448 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:00.883607 (+ 159us) server_negotiation.cc:407] Connection header received
0811 16:38:00.883647 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:00.883649 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:00.883663 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:00.883732 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:38:00.883829 (+ 97us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.884485 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.885443 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.885942 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.886031 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:00.886091 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:00.886178 (+ 87us) server_negotiation.cc:299] Negotiation successful
0811 16:38:00.886215 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":73,"threads_started":1}
I20260811 16:38:00.887034 5482 tablet_service.cc:1467] Processing CreateTablet for tablet 3c04f3e71a104fe8ac91f8edd569256a (DEFAULT_TABLE table=test-table [id=08d67e276fa646c9910cca6ad5fcdfa3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:38:00.887343 4436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:00.882994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.193:39351 (local address 127.0.0.1:59582)
0811 16:38:00.883035 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:00.883043 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:00.883077 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:00.883650 (+ 573us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:00.883651 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:00.883653 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:38:00.883688 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:00.883690 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.884929 (+ 1239us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.884930 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:00.886019 (+ 1089us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:00.886021 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.887144 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.887145 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:00.887202 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:00.887206 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:38:00.887245 (+ 39us) client_negotiation.cc:240] Negotiation successful
0811 16:38:00.887281 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26}
I20260811 16:38:00.887364 5482 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c04f3e71a104fe8ac91f8edd569256a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:38:00.887707 5648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:00.883140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59582 (local address 127.24.175.193:39351)
0811 16:38:00.883508 (+ 368us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:00.883512 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:00.883521 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:38:00.883561 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:00.883563 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:00.883580 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:00.883654 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:38:00.883769 (+ 115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.884837 (+ 1068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.886197 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.887052 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.887504 (+ 452us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:00.887559 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:00.887584 (+ 25us) server_negotiation.cc:299] Negotiation successful
0811 16:38:00.887624 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":327,"thread_start_us":84,"threads_started":1}
I20260811 16:38:00.887758 5646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:00.883038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.194:43771 (local address 127.0.0.1:35296)
0811 16:38:00.883374 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:00.883384 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:00.883429 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:00.884281 (+ 852us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:00.884282 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:00.884285 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:38:00.884322 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:00.884323 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.885536 (+ 1213us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.885537 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:00.886574 (+ 1037us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:00.886577 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.887542 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.887543 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:00.887602 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:00.887606 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:38:00.887649 (+ 43us) client_negotiation.cc:240] Negotiation successful
0811 16:38:00.887682 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":316,"thread_start_us":75,"threads_started":1}
I20260811 16:38:00.887957 5647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:00.883125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35296 (local address 127.24.175.194:43771)
0811 16:38:00.883823 (+ 698us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:00.883827 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:00.883836 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:38:00.883870 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:00.883872 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:00.883887 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:00.883954 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:38:00.884402 (+ 448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.885441 (+ 1039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.886662 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.887371 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.887452 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:00.887507 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:00.887844 (+ 337us) server_negotiation.cc:299] Negotiation successful
0811 16:38:00.887885 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":655,"thread_start_us":102,"threads_started":1}
I20260811 16:38:00.888471 5016 tablet_service.cc:1467] Processing CreateTablet for tablet 3c04f3e71a104fe8ac91f8edd569256a (DEFAULT_TABLE table=test-table [id=08d67e276fa646c9910cca6ad5fcdfa3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:38:00.888774 5016 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c04f3e71a104fe8ac91f8edd569256a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:38:00.890236 5653 tablet_bootstrap.cc:492] T 3c04f3e71a104fe8ac91f8edd569256a P fd8823eeae954b089aaf278fc23441ec: Bootstrap starting.
I20260811 16:38:00.890897 5653 tablet_bootstrap.cc:654] T 3c04f3e71a104fe8ac91f8edd569256a P fd8823eeae954b089aaf278fc23441ec: Neither blocks nor log segments found. Creating new log.
I20260811 16:38:00.890836 5258 tablet_service.cc:1467] Processing CreateTablet for tablet 3c04f3e71a104fe8ac91f8edd569256a (DEFAULT_TABLE table=test-table [id=08d67e276fa646c9910cca6ad5fcdfa3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:38:00.891112 5258 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c04f3e71a104fe8ac91f8edd569256a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:38:00.891220 5653 log.cc:824] T 3c04f3e71a104fe8ac91f8edd569256a P fd8823eeae954b089aaf278fc23441ec: Log is configured to *not* fsync() on all Append() calls
I20260811 16:38:00.891808 5655 tablet_bootstrap.cc:492] T 3c04f3e71a104fe8ac91f8edd569256a P 7cc554e49f17483b9143ff94990f2697: Bootstrap starting.
I20260811 16:38:00.892097 5653 tablet_bootstrap.cc:492] T 3c04f3e71a104fe8ac91f8edd569256a P fd8823eeae954b089aaf278fc23441ec: No bootstrap required, opened a new log
I20260811 16:38:00.892236 5653 ts_tablet_manager.cc:1397] T 3c04f3e71a104fe8ac91f8edd569256a P fd8823eeae954b089aaf278fc23441ec: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:38:00.892570 5655 tablet_bootstrap.cc:654] T 3c04f3e71a104fe8ac91f8edd569256a P 7cc554e49f17483b9143ff94990f2697: Neither blocks nor log segments found. Creating new log.
I20260811 16:38:00.892813 5655 log.cc:824] T 3c04f3e71a104fe8ac91f8edd569256a P 7cc554e49f17483b9143ff94990f2697: Log is configured to *not* fsync() on all Append() calls
I20260811 16:38:00.893463 5655 tablet_bootstrap.cc:492] T 3c04f3e71a104fe8ac91f8edd569256a P 7cc554e49f17483b9143ff94990f2697: No bootstrap required, opened a new log
I20260811 16:38:00.893522 5655 ts_tablet_manager.cc:1397] T 3c04f3e71a104fe8ac91f8edd569256a P 7cc554e49f17483b9143ff94990f2697: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 16:38:00.894960 5653 raft_consensus.cc:348] T 3c04f3e71a104fe8ac91f8edd569256a P fd8823eeae954b089aaf278fc23441ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cc554e49f17483b9143ff94990f2697" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39351 } } peers { permanent_uuid: "ac7de4f358864daa98d98cb042072912" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 43771 } } peers { permanent_uuid: "fd8823eeae954b089aaf278fc23441ec" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 36259 } }
I20260811 16:38:00.895044 5655 raft_consensus.cc:348] T 3c04f3e71a104fe8ac91f8edd569256a P 7cc554e49f17483b9143ff94990f2697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cc554e49f17483b9143ff94990f2697" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39351 } } peers { permanent_uuid: "ac7de4f358864daa98d98cb042072912" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 43771 } } peers { permanent_uuid: "fd8823eeae954b089aaf278fc23441ec" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 36259 } }
I20260811 16:38:00.895138 5653 raft_consensus.cc:374] T 3c04f3e71a104fe8ac91f8edd569256a P fd8823eeae954b089aaf278fc23441ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:38:00.895184 5653 raft_consensus.cc:729] T 3c04f3e71a104fe8ac91f8edd569256a P fd8823eeae954b089aaf278fc23441ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd8823eeae954b089aaf278fc23441ec, State: Initialized, Role: FOLLOWER
I20260811 16:38:00.895186 5655 raft_consensus.cc:374] T 3c04f3e71a104fe8ac91f8edd569256a P 7cc554e49f17483b9143ff94990f2697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:38:00.895218 5655 raft_consensus.cc:729] T 3c04f3e71a104fe8ac91f8edd569256a P 7cc554e49f17483b9143ff94990f2697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cc554e49f17483b9143ff94990f2697, State: Initialized, Role: FOLLOWER
I20260811 16:38:00.895318 5653 consensus_queue.cc:260] T 3c04f3e71a104fe8ac91f8edd569256a P fd8823eeae954b089aaf278fc23441ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cc554e49f17483b9143ff94990f2697" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39351 } } peers { permanent_uuid: "ac7de4f358864daa98d98cb042072912" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 43771 } } peers { permanent_uuid: "fd8823eeae954b089aaf278fc23441ec" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 36259 } }
I20260811 16:38:00.895332 5655 consensus_queue.cc:260] T 3c04f3e71a104fe8ac91f8edd569256a P 7cc554e49f17483b9143ff94990f2697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cc554e49f17483b9143ff94990f2697" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39351 } } peers { permanent_uuid: "ac7de4f358864daa98d98cb042072912" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 43771 } } peers { permanent_uuid: "fd8823eeae954b089aaf278fc23441ec" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 36259 } }
I20260811 16:38:00.895583 5655 ts_tablet_manager.cc:1428] T 3c04f3e71a104fe8ac91f8edd569256a P 7cc554e49f17483b9143ff94990f2697: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 16:38:00.895574 5653 ts_tablet_manager.cc:1428] T 3c04f3e71a104fe8ac91f8edd569256a P fd8823eeae954b089aaf278fc23441ec: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 16:38:00.895717 5147 heartbeater.cc:503] Master 127.24.175.254:32869 was elected leader, sending a full tablet report...
I20260811 16:38:00.895823 5605 heartbeater.cc:503] Master 127.24.175.254:32869 was elected leader, sending a full tablet report...
I20260811 16:38:00.895634 5661 tablet_bootstrap.cc:492] T 3c04f3e71a104fe8ac91f8edd569256a P ac7de4f358864daa98d98cb042072912: Bootstrap starting.
I20260811 16:38:00.897840 5661 tablet_bootstrap.cc:654] T 3c04f3e71a104fe8ac91f8edd569256a P ac7de4f358864daa98d98cb042072912: Neither blocks nor log segments found. Creating new log.
I20260811 16:38:00.898087 5661 log.cc:824] T 3c04f3e71a104fe8ac91f8edd569256a P ac7de4f358864daa98d98cb042072912: Log is configured to *not* fsync() on all Append() calls
I20260811 16:38:00.898715 5661 tablet_bootstrap.cc:492] T 3c04f3e71a104fe8ac91f8edd569256a P ac7de4f358864daa98d98cb042072912: No bootstrap required, opened a new log
I20260811 16:38:00.898779 5661 ts_tablet_manager.cc:1397] T 3c04f3e71a104fe8ac91f8edd569256a P ac7de4f358864daa98d98cb042072912: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260811 16:38:00.900429 5661 raft_consensus.cc:348] T 3c04f3e71a104fe8ac91f8edd569256a P ac7de4f358864daa98d98cb042072912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cc554e49f17483b9143ff94990f2697" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39351 } } peers { permanent_uuid: "ac7de4f358864daa98d98cb042072912" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 43771 } } peers { permanent_uuid: "fd8823eeae954b089aaf278fc23441ec" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 36259 } }
I20260811 16:38:00.900545 5661 raft_consensus.cc:374] T 3c04f3e71a104fe8ac91f8edd569256a P ac7de4f358864daa98d98cb042072912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:38:00.900576 5661 raft_consensus.cc:729] T 3c04f3e71a104fe8ac91f8edd569256a P ac7de4f358864daa98d98cb042072912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac7de4f358864daa98d98cb042072912, State: Initialized, Role: FOLLOWER
I20260811 16:38:00.900682 5661 consensus_queue.cc:260] T 3c04f3e71a104fe8ac91f8edd569256a P ac7de4f358864daa98d98cb042072912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cc554e49f17483b9143ff94990f2697" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39351 } } peers { permanent_uuid: "ac7de4f358864daa98d98cb042072912" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 43771 } } peers { permanent_uuid: "fd8823eeae954b089aaf278fc23441ec" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 36259 } }
I20260811 16:38:00.900913 5661 ts_tablet_manager.cc:1428] T 3c04f3e71a104fe8ac91f8edd569256a P ac7de4f358864daa98d98cb042072912: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:38:00.900962 5366 heartbeater.cc:503] Master 127.24.175.254:32869 was elected leader, sending a full tablet report...
W20260811 16:38:00.967814 5370 tablet.cc:2369] T 3c04f3e71a104fe8ac91f8edd569256a P ac7de4f358864daa98d98cb042072912: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:38:00.987802 5157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:00.985381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35082 (local address 127.24.175.252:46357)
0811 16:38:00.985432 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:00.985434 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:00.985442 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:38:00.985489 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:00.985490 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:00.985514 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:00.985579 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:38:00.985700 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.986210 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.987082 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.987473 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.987536 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:00.987623 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:00.987676 (+ 53us) server_negotiation.cc:299] Negotiation successful
0811 16:38:00.987709 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 16:38:00.987802 5646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:00.985313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.252:46357 (local address 127.0.0.1:35082)
0811 16:38:00.985370 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:00.985381 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:00.985432 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:00.985590 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:00.985591 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:00.985593 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:38:00.985647 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:00.985649 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.986282 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.986283 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:00.987004 (+ 721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:00.987007 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:00.987545 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:00.987547 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:00.987609 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:00.987613 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:38:00.987669 (+ 56us) client_negotiation.cc:240] Negotiation successful
0811 16:38:00.987719 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260811 16:38:00.988220 4834 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 246f1e8e44c54e4588a89c771a803c2e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.9] Dedup: 1.7->[1.8-1.9]
I20260811 16:38:00.989126 5670 sys_catalog.cc:455] T 00000000000000000000000000000000 P 246f1e8e44c54e4588a89c771a803c2e [sys.catalog]: SysCatalogTable state changed. Reason: New leader aa75a15571b74a698cb8903ef0fb78b7. Latest consensus state: current_term: 1 leader_uuid: "aa75a15571b74a698cb8903ef0fb78b7" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "aa75a15571b74a698cb8903ef0fb78b7" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 32869 } } peers { permanent_uuid: "0c4b4b269a314fcbbe5d31a56cdcbd58" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 46701 } attrs { promote: false } } peers { permanent_uuid: "246f1e8e44c54e4588a89c771a803c2e" member_type: NON_VOTER last_known_addr { host: "127.24.175.252" port: 46357 } attrs { promote: true } } }
I20260811 16:38:00.989245 5670 sys_catalog.cc:458] T 00000000000000000000000000000000 P 246f1e8e44c54e4588a89c771a803c2e [sys.catalog]: This master's current role is: LEARNER
I20260811 16:38:01.002285 5669 raft_consensus.cc:482] T 3c04f3e71a104fe8ac91f8edd569256a P ac7de4f358864daa98d98cb042072912 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:38:01.002381 5669 raft_consensus.cc:504] T 3c04f3e71a104fe8ac91f8edd569256a P ac7de4f358864daa98d98cb042072912 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cc554e49f17483b9143ff94990f2697" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39351 } } peers { permanent_uuid: "ac7de4f358864daa98d98cb042072912" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 43771 } } peers { permanent_uuid: "fd8823eeae954b089aaf278fc23441ec" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 36259 } }
I20260811 16:38:01.002673 5669 leader_election.cc:288] T 3c04f3e71a104fe8ac91f8edd569256a P ac7de4f358864daa98d98cb042072912 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cc554e49f17483b9143ff94990f2697 (127.24.175.193:39351), fd8823eeae954b089aaf278fc23441ec (127.24.175.195:36259)
I20260811 16:38:01.005244 5650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:01.002944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:43707 (local address 127.24.175.195:36259)
0811 16:38:01.002996 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:01.002998 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:01.003004 (+ 6us) server_negotiation.cc:407] Connection header received
0811 16:38:01.003025 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:01.003026 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:01.003033 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:01.003083 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:38:01.003232 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:01.003681 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:01.004600 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:01.004945 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:01.005005 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:01.005015 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:01.005139 (+ 124us) server_negotiation.cc:299] Negotiation successful
0811 16:38:01.005172 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 16:38:01.005281 5376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:01.002857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.195:36259 (local address 127.24.175.194:43707)
0811 16:38:01.002903 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:01.002914 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:01.002957 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:01.003091 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:01.003092 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:01.003093 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:38:01.003169 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:01.003171 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:01.003754 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:01.003755 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:01.004520 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:01.004522 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:01.005008 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:01.005009 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:01.005083 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:01.005086 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:38:01.005129 (+ 43us) client_negotiation.cc:240] Negotiation successful
0811 16:38:01.005168 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27,"mutex_wait_us":20}
I20260811 16:38:01.005286 5648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:01.002928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:41273 (local address 127.24.175.193:39351)
0811 16:38:01.002969 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:01.002971 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:01.002979 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:38:01.003004 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:01.003005 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:01.003013 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:01.003062 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:38:01.003217 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:01.003679 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:01.004611 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:01.004960 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:01.005020 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:01.005030 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:01.005184 (+ 154us) server_negotiation.cc:299] Negotiation successful
0811 16:38:01.005222 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 16:38:01.005306 5371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:01.002809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.193:39351 (local address 127.24.175.194:41273)
0811 16:38:01.002866 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:01.002878 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:01.002922 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:01.003081 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:01.003082 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:01.003083 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:38:01.003160 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:01.003162 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:01.003751 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:01.003752 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:01.004523 (+ 771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:01.004525 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:01.005031 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:01.005032 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:01.005118 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:01.005121 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:38:01.005165 (+ 44us) client_negotiation.cc:240] Negotiation successful
0811 16:38:01.005205 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37,"mutex_wait_us":32}
I20260811 16:38:01.005646 5521 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c04f3e71a104fe8ac91f8edd569256a" candidate_uuid: "ac7de4f358864daa98d98cb042072912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd8823eeae954b089aaf278fc23441ec" is_pre_election: true
I20260811 16:38:01.005815 5521 raft_consensus.cc:2454] T 3c04f3e71a104fe8ac91f8edd569256a P fd8823eeae954b089aaf278fc23441ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac7de4f358864daa98d98cb042072912 in term 0.
I20260811 16:38:01.005770 5055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c04f3e71a104fe8ac91f8edd569256a" candidate_uuid: "ac7de4f358864daa98d98cb042072912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cc554e49f17483b9143ff94990f2697" is_pre_election: true
I20260811 16:38:01.005908 5055 raft_consensus.cc:2454] T 3c04f3e71a104fe8ac91f8edd569256a P 7cc554e49f17483b9143ff94990f2697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac7de4f358864daa98d98cb042072912 in term 0.
I20260811 16:38:01.006049 5188 leader_election.cc:302] T 3c04f3e71a104fe8ac91f8edd569256a P ac7de4f358864daa98d98cb042072912 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac7de4f358864daa98d98cb042072912, fd8823eeae954b089aaf278fc23441ec; no voters:
I20260811 16:38:01.006222 5669 raft_consensus.cc:2781] T 3c04f3e71a104fe8ac91f8edd569256a P ac7de4f358864daa98d98cb042072912 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:38:01.006286 5669 raft_consensus.cc:482] T 3c04f3e71a104fe8ac91f8edd569256a P ac7de4f358864daa98d98cb042072912 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:38:01.006302 5669 raft_consensus.cc:3037] T 3c04f3e71a104fe8ac91f8edd569256a P ac7de4f358864daa98d98cb042072912 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:38:01.006994 5669 raft_consensus.cc:504] T 3c04f3e71a104fe8ac91f8edd569256a P ac7de4f358864daa98d98cb042072912 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cc554e49f17483b9143ff94990f2697" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39351 } } peers { permanent_uuid: "ac7de4f358864daa98d98cb042072912" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 43771 } } peers { permanent_uuid: "fd8823eeae954b089aaf278fc23441ec" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 36259 } }
I20260811 16:38:01.007113 5669 leader_election.cc:288] T 3c04f3e71a104fe8ac91f8edd569256a P ac7de4f358864daa98d98cb042072912 [CANDIDATE]: Term 1 election: Requested vote from peers 7cc554e49f17483b9143ff94990f2697 (127.24.175.193:39351), fd8823eeae954b089aaf278fc23441ec (127.24.175.195:36259)
I20260811 16:38:01.007248 5055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c04f3e71a104fe8ac91f8edd569256a" candidate_uuid: "ac7de4f358864daa98d98cb042072912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cc554e49f17483b9143ff94990f2697"
I20260811 16:38:01.007263 5521 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c04f3e71a104fe8ac91f8edd569256a" candidate_uuid: "ac7de4f358864daa98d98cb042072912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd8823eeae954b089aaf278fc23441ec"
I20260811 16:38:01.007340 5055 raft_consensus.cc:3037] T 3c04f3e71a104fe8ac91f8edd569256a P 7cc554e49f17483b9143ff94990f2697 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:38:01.007340 5521 raft_consensus.cc:3037] T 3c04f3e71a104fe8ac91f8edd569256a P fd8823eeae954b089aaf278fc23441ec [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:38:01.008226 5521 raft_consensus.cc:2454] T 3c04f3e71a104fe8ac91f8edd569256a P fd8823eeae954b089aaf278fc23441ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac7de4f358864daa98d98cb042072912 in term 1.
I20260811 16:38:01.008225 5055 raft_consensus.cc:2454] T 3c04f3e71a104fe8ac91f8edd569256a P 7cc554e49f17483b9143ff94990f2697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac7de4f358864daa98d98cb042072912 in term 1.
I20260811 16:38:01.008395 5185 leader_election.cc:302] T 3c04f3e71a104fe8ac91f8edd569256a P ac7de4f358864daa98d98cb042072912 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7cc554e49f17483b9143ff94990f2697, ac7de4f358864daa98d98cb042072912; no voters:
I20260811 16:38:01.008486 5669 raft_consensus.cc:2781] T 3c04f3e71a104fe8ac91f8edd569256a P ac7de4f358864daa98d98cb042072912 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:38:01.008617 5669 raft_consensus.cc:686] T 3c04f3e71a104fe8ac91f8edd569256a P ac7de4f358864daa98d98cb042072912 [term 1 LEADER]: Becoming Leader. State: Replica: ac7de4f358864daa98d98cb042072912, State: Running, Role: LEADER
I20260811 16:38:01.008710 5669 consensus_queue.cc:237] T 3c04f3e71a104fe8ac91f8edd569256a P ac7de4f358864daa98d98cb042072912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cc554e49f17483b9143ff94990f2697" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39351 } } peers { permanent_uuid: "ac7de4f358864daa98d98cb042072912" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 43771 } } peers { permanent_uuid: "fd8823eeae954b089aaf278fc23441ec" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 36259 } }
I20260811 16:38:01.009797 3437 catalog_manager.cc:5495] T 3c04f3e71a104fe8ac91f8edd569256a P ac7de4f358864daa98d98cb042072912 reported cstate change: term changed from 0 to 1, leader changed from <none> to ac7de4f358864daa98d98cb042072912 (127.24.175.194). New cstate: current_term: 1 leader_uuid: "ac7de4f358864daa98d98cb042072912" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cc554e49f17483b9143ff94990f2697" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac7de4f358864daa98d98cb042072912" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 43771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd8823eeae954b089aaf278fc23441ec" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 36259 } health_report { overall_health: UNKNOWN } } }
I20260811 16:38:01.010375 4747 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa75a15571b74a698cb8903ef0fb78b7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "aa75a15571b74a698cb8903ef0fb78b7" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "aa75a15571b74a698cb8903ef0fb78b7" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 32869 } } peers { permanent_uuid: "0c4b4b269a314fcbbe5d31a56cdcbd58" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 46701 } attrs { promote: false } } peers { permanent_uuid: "246f1e8e44c54e4588a89c771a803c2e" member_type: NON_VOTER last_known_addr { host: "127.24.175.252" port: 46357 } attrs { promote: true } } }
I20260811 16:38:01.010465 4747 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa75a15571b74a698cb8903ef0fb78b7 [sys.catalog]: This master's current role is: LEADER
I20260811 16:38:01.011086 5682 raft_consensus.cc:1050] T 00000000000000000000000000000000 P aa75a15571b74a698cb8903ef0fb78b7: attempting to promote NON_VOTER 246f1e8e44c54e4588a89c771a803c2e to VOTER
I20260811 16:38:01.011209 5682 consensus_queue.cc:237] T 00000000000000000000000000000000 P aa75a15571b74a698cb8903ef0fb78b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "aa75a15571b74a698cb8903ef0fb78b7" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 32869 } } peers { permanent_uuid: "0c4b4b269a314fcbbe5d31a56cdcbd58" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 46701 } attrs { promote: false } } peers { permanent_uuid: "246f1e8e44c54e4588a89c771a803c2e" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 46357 } attrs { promote: false } }
I20260811 16:38:01.011595 4834 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 246f1e8e44c54e4588a89c771a803c2e [term 1 LEARNER]: Refusing update from remote peer aa75a15571b74a698cb8903ef0fb78b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260811 16:38:01.011689 4512 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58 [term 1 FOLLOWER]: Refusing update from remote peer aa75a15571b74a698cb8903ef0fb78b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260811 16:38:01.011770 5682 consensus_queue.cc:1035] T 00000000000000000000000000000000 P aa75a15571b74a698cb8903ef0fb78b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "246f1e8e44c54e4588a89c771a803c2e" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 46357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260811 16:38:01.011869 5681 consensus_queue.cc:1035] T 00000000000000000000000000000000 P aa75a15571b74a698cb8903ef0fb78b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c4b4b269a314fcbbe5d31a56cdcbd58" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 46701 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260811 16:38:01.012419 4443 raft_consensus.cc:2932] T 00000000000000000000000000000000 P aa75a15571b74a698cb8903ef0fb78b7 [term 1 LEADER]: Committing config change with OpId 1.11: config changed from index 7 to 11, 246f1e8e44c54e4588a89c771a803c2e (127.24.175.252) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "aa75a15571b74a698cb8903ef0fb78b7" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 32869 } } peers { permanent_uuid: "0c4b4b269a314fcbbe5d31a56cdcbd58" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 46701 } attrs { promote: false } } peers { permanent_uuid: "246f1e8e44c54e4588a89c771a803c2e" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 46357 } attrs { promote: false } } }
I20260811 16:38:01.012642 4834 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 246f1e8e44c54e4588a89c771a803c2e [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 7 to 11, 246f1e8e44c54e4588a89c771a803c2e (127.24.175.252) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "aa75a15571b74a698cb8903ef0fb78b7" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 32869 } } peers { permanent_uuid: "0c4b4b269a314fcbbe5d31a56cdcbd58" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 46701 } attrs { promote: false } } peers { permanent_uuid: "246f1e8e44c54e4588a89c771a803c2e" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 46357 } attrs { promote: false } } }
I20260811 16:38:01.012707 4512 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 7 to 11, 246f1e8e44c54e4588a89c771a803c2e (127.24.175.252) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "aa75a15571b74a698cb8903ef0fb78b7" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 32869 } } peers { permanent_uuid: "0c4b4b269a314fcbbe5d31a56cdcbd58" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 46701 } attrs { promote: false } } peers { permanent_uuid: "246f1e8e44c54e4588a89c771a803c2e" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 46357 } attrs { promote: false } } }
I20260811 16:38:01.013159 4443 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa75a15571b74a698cb8903ef0fb78b7 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "aa75a15571b74a698cb8903ef0fb78b7" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "aa75a15571b74a698cb8903ef0fb78b7" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 32869 } } peers { permanent_uuid: "0c4b4b269a314fcbbe5d31a56cdcbd58" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 46701 } attrs { promote: false } } peers { permanent_uuid: "246f1e8e44c54e4588a89c771a803c2e" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 46357 } attrs { promote: false } } }
I20260811 16:38:01.013238 4443 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa75a15571b74a698cb8903ef0fb78b7 [sys.catalog]: This master's current role is: LEADER
I20260811 16:38:01.013283 4443 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa75a15571b74a698cb8903ef0fb78b7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "aa75a15571b74a698cb8903ef0fb78b7" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "aa75a15571b74a698cb8903ef0fb78b7" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 32869 } } peers { permanent_uuid: "0c4b4b269a314fcbbe5d31a56cdcbd58" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 46701 } attrs { promote: false } } peers { permanent_uuid: "246f1e8e44c54e4588a89c771a803c2e" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 46357 } attrs { promote: false } } }
I20260811 16:38:01.013309 4443 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa75a15571b74a698cb8903ef0fb78b7 [sys.catalog]: This master's current role is: LEADER
I20260811 16:38:01.013339 4443 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa75a15571b74a698cb8903ef0fb78b7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "aa75a15571b74a698cb8903ef0fb78b7" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "aa75a15571b74a698cb8903ef0fb78b7" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 32869 } } peers { permanent_uuid: "0c4b4b269a314fcbbe5d31a56cdcbd58" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 46701 } attrs { promote: false } } peers { permanent_uuid: "246f1e8e44c54e4588a89c771a803c2e" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 46357 } attrs { promote: false } } }
I20260811 16:38:01.013379 4443 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa75a15571b74a698cb8903ef0fb78b7 [sys.catalog]: This master's current role is: LEADER
I20260811 16:38:01.013569 5670 sys_catalog.cc:455] T 00000000000000000000000000000000 P 246f1e8e44c54e4588a89c771a803c2e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "aa75a15571b74a698cb8903ef0fb78b7" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "aa75a15571b74a698cb8903ef0fb78b7" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 32869 } } peers { permanent_uuid: "0c4b4b269a314fcbbe5d31a56cdcbd58" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 46701 } attrs { promote: false } } peers { permanent_uuid: "246f1e8e44c54e4588a89c771a803c2e" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 46357 } attrs { promote: false } } }
I20260811 16:38:01.013669 5670 sys_catalog.cc:458] T 00000000000000000000000000000000 P 246f1e8e44c54e4588a89c771a803c2e [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:38:01.013654 5684 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "aa75a15571b74a698cb8903ef0fb78b7" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "aa75a15571b74a698cb8903ef0fb78b7" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 32869 } } peers { permanent_uuid: "0c4b4b269a314fcbbe5d31a56cdcbd58" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 46701 } attrs { promote: false } } peers { permanent_uuid: "246f1e8e44c54e4588a89c771a803c2e" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 46357 } attrs { promote: false } } }
I20260811 16:38:01.013746 5684 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:38:01.031448 5647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:01.029170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35308 (local address 127.24.175.194:43771)
0811 16:38:01.029217 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:01.029219 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:01.029226 (+ 7us) server_negotiation.cc:407] Connection header received
0811 16:38:01.029302 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:01.029303 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:01.029319 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:01.029375 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:38:01.029500 (+ 125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:01.030001 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:01.030770 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:01.030954 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:01.031006 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:01.031152 (+ 146us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:38:01.031253 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:38:01.031323 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:01.031354 (+ 31us) server_negotiation.cc:299] Negotiation successful
0811 16:38:01.031375 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 16:38:01.033126 5521 raft_consensus.cc:1261] T 3c04f3e71a104fe8ac91f8edd569256a P fd8823eeae954b089aaf278fc23441ec [term 1 FOLLOWER]: Refusing update from remote peer ac7de4f358864daa98d98cb042072912: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:38:01.033155 5055 raft_consensus.cc:1261] T 3c04f3e71a104fe8ac91f8edd569256a P 7cc554e49f17483b9143ff94990f2697 [term 1 FOLLOWER]: Refusing update from remote peer ac7de4f358864daa98d98cb042072912: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:38:01.033480 5677 consensus_queue.cc:1035] T 3c04f3e71a104fe8ac91f8edd569256a P ac7de4f358864daa98d98cb042072912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd8823eeae954b089aaf278fc23441ec" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:38:01.033605 5669 consensus_queue.cc:1035] T 3c04f3e71a104fe8ac91f8edd569256a P ac7de4f358864daa98d98cb042072912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cc554e49f17483b9143ff94990f2697" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:38:01.036005 5686 mvcc.cc:205] Tried to move back new op lower bound from 7317365887109263360 to 7317365887012212736. Current Snapshot: MvccSnapshot[applied={T|T < 7317365887109263360}]
I20260811 16:38:01.037356 5693 mvcc.cc:205] Tried to move back new op lower bound from 7317365887109263360 to 7317365887012212736. Current Snapshot: MvccSnapshot[applied={T|T < 7317365887109263360}]
I20260811 16:38:01.038988 3436 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35516:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:38:01.039083 3436 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35516:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:38:01.040640 3436 catalog_manager.cc:5782] T 00000000000000000000000000000000 P aa75a15571b74a698cb8903ef0fb78b7: Sending DeleteTablet for 3 replicas of tablet 3c04f3e71a104fe8ac91f8edd569256a
I20260811 16:38:01.040997 5258 tablet_service.cc:1514] Processing DeleteTablet for tablet 3c04f3e71a104fe8ac91f8edd569256a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:38:01 UTC) from {username='oryx', principal='oryx/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:35296
I20260811 16:38:01.040987 5016 tablet_service.cc:1514] Processing DeleteTablet for tablet 3c04f3e71a104fe8ac91f8edd569256a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:38:01 UTC) from {username='oryx', principal='oryx/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:59582
I20260811 16:38:01.041201 5482 tablet_service.cc:1514] Processing DeleteTablet for tablet 3c04f3e71a104fe8ac91f8edd569256a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:38:01 UTC) from {username='oryx', principal='oryx/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:37090
I20260811 16:38:01.041414 5711 tablet_replica.cc:330] T 3c04f3e71a104fe8ac91f8edd569256a P fd8823eeae954b089aaf278fc23441ec: stopping tablet replica
I20260811 16:38:01.041515 5711 raft_consensus.cc:2229] T 3c04f3e71a104fe8ac91f8edd569256a P fd8823eeae954b089aaf278fc23441ec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:38:01.041622 5711 raft_consensus.cc:2258] T 3c04f3e71a104fe8ac91f8edd569256a P fd8823eeae954b089aaf278fc23441ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:38:01.042043 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 3384
I20260811 16:38:01.042058 5707 tablet_replica.cc:330] T 3c04f3e71a104fe8ac91f8edd569256a P 7cc554e49f17483b9143ff94990f2697: stopping tablet replica
I20260811 16:38:01.042181 5707 raft_consensus.cc:2229] T 3c04f3e71a104fe8ac91f8edd569256a P 7cc554e49f17483b9143ff94990f2697 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:38:01.047884 5708 tablet_replica.cc:330] T 3c04f3e71a104fe8ac91f8edd569256a P ac7de4f358864daa98d98cb042072912: stopping tablet replica
I20260811 16:38:01.048018 5708 raft_consensus.cc:2229] T 3c04f3e71a104fe8ac91f8edd569256a P ac7de4f358864daa98d98cb042072912 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:38:01.048144 5708 raft_consensus.cc:2258] T 3c04f3e71a104fe8ac91f8edd569256a P ac7de4f358864daa98d98cb042072912 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:38:01.048240 5707 raft_consensus.cc:2258] T 3c04f3e71a104fe8ac91f8edd569256a P 7cc554e49f17483b9143ff94990f2697 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:38:01.052349 5707 ts_tablet_manager.cc:1905] T 3c04f3e71a104fe8ac91f8edd569256a P 7cc554e49f17483b9143ff94990f2697: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:38:01.054250 5707 ts_tablet_manager.cc:1918] T 3c04f3e71a104fe8ac91f8edd569256a P 7cc554e49f17483b9143ff94990f2697: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:38:01.054457 5707 log.cc:1196] T 3c04f3e71a104fe8ac91f8edd569256a P 7cc554e49f17483b9143ff94990f2697: Deleting WAL directory at /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-0/wal/wals/3c04f3e71a104fe8ac91f8edd569256a
I20260811 16:38:01.054899 5707 ts_tablet_manager.cc:1939] T 3c04f3e71a104fe8ac91f8edd569256a P 7cc554e49f17483b9143ff94990f2697: Deleting consensus metadata
I20260811 16:38:01.055119 5708 ts_tablet_manager.cc:1905] T 3c04f3e71a104fe8ac91f8edd569256a P ac7de4f358864daa98d98cb042072912: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:38:01.056823 5708 ts_tablet_manager.cc:1918] T 3c04f3e71a104fe8ac91f8edd569256a P ac7de4f358864daa98d98cb042072912: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:38:01.056905 5708 log.cc:1196] T 3c04f3e71a104fe8ac91f8edd569256a P ac7de4f358864daa98d98cb042072912: Deleting WAL directory at /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-1/wal/wals/3c04f3e71a104fe8ac91f8edd569256a
I20260811 16:38:01.057158 5708 ts_tablet_manager.cc:1939] T 3c04f3e71a104fe8ac91f8edd569256a P ac7de4f358864daa98d98cb042072912: Deleting consensus metadata
I20260811 16:38:01.062729 5711 ts_tablet_manager.cc:1905] T 3c04f3e71a104fe8ac91f8edd569256a P fd8823eeae954b089aaf278fc23441ec: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:38:01.064380 5711 ts_tablet_manager.cc:1918] T 3c04f3e71a104fe8ac91f8edd569256a P fd8823eeae954b089aaf278fc23441ec: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:38:01.064469 5711 log.cc:1196] T 3c04f3e71a104fe8ac91f8edd569256a P fd8823eeae954b089aaf278fc23441ec: Deleting WAL directory at /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-2/wal/wals/3c04f3e71a104fe8ac91f8edd569256a
I20260811 16:38:01.064741 5711 ts_tablet_manager.cc:1939] T 3c04f3e71a104fe8ac91f8edd569256a P fd8823eeae954b089aaf278fc23441ec: Deleting consensus metadata
W20260811 16:38:01.066222 5410 connection.cc:535] server connection from 127.0.0.1:37090 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260811 16:38:01.066246 5191 connection.cc:535] server connection from 127.0.0.1:35296 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260811 16:38:01.066545 4930 connection.cc:535] server connection from 127.0.0.1:59582 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 16:38:01.070619 5157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:01.041437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35092 (local address 127.24.175.252:46357)
0811 16:38:01.041489 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:01.041491 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:01.041847 (+ 356us) server_negotiation.cc:407] Connection header received
0811 16:38:01.041901 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:01.041902 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:01.041914 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:01.041962 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:01.063610 (+ 21648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:01.064383 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:01.065393 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:01.065734 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:01.065808 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:01.067469 (+ 1661us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:38:01.067471 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:38:01.067471 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:38:01.067479 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:38:01.069033 (+ 1554us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:01.069459 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:01.069460 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:01.069461 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:01.069522 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:01.069726 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:01.069727 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:01.069727 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:01.069860 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:38:01.069955 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:01.070447 (+ 492us) server_negotiation.cc:299] Negotiation successful
0811 16:38:01.070524 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 16:38:01.076479 5629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:01.068592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35108 (local address 127.24.175.252:46357)
0811 16:38:01.069125 (+ 533us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:01.069127 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:01.069133 (+ 6us) server_negotiation.cc:407] Connection header received
0811 16:38:01.069151 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:01.069151 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:01.069162 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:01.069213 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:01.069852 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:01.070694 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:01.072291 (+ 1597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:01.072613 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:01.072683 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:01.073687 (+ 1004us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:38:01.073688 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:38:01.073688 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:38:01.073695 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:38:01.075239 (+ 1544us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:01.075641 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:01.075643 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:01.075643 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:01.075696 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:01.075870 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:01.075871 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:01.075871 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:01.075978 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:38:01.076065 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:01.076312 (+ 247us) server_negotiation.cc:299] Negotiation successful
0811 16:38:01.076391 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":512}
I20260811 16:38:01.077023 4577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:01.068559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42286 (local address 127.24.175.253:46701)
0811 16:38:01.068602 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:01.068604 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:01.068852 (+ 248us) server_negotiation.cc:407] Connection header received
0811 16:38:01.068956 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:01.068957 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:01.068970 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:01.068998 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:01.070216 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:01.070875 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:01.071562 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:01.071844 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:01.071907 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:01.073667 (+ 1760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:38:01.073668 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:38:01.073668 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:38:01.073676 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:38:01.075388 (+ 1712us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:01.075727 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:01.075728 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:01.075729 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:01.075799 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:01.076211 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:01.076211 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:01.076212 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:01.076347 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:38:01.076442 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:01.076843 (+ 401us) server_negotiation.cc:299] Negotiation successful
0811 16:38:01.076928 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 16:38:02.037528 5727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:02.037144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:32869 (local address 127.24.175.194:47343)
0811 16:38:02.037296 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:02.037408 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:32869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":70,"threads_started":1}
I20260811 16:38:02.037706 5730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:02.037494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:32869 (local address 127.24.175.193:58817)
0811 16:38:02.037584 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:02.037658 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:32869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75,"thread_start_us":63,"threads_started":1}
W20260811 16:38:02.037940 5366 heartbeater.cc:644] Failed to heartbeat to 127.24.175.254:32869 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.24.175.254:32869: connect: Connection refused (error 111)
W20260811 16:38:02.038329 5147 heartbeater.cc:644] Failed to heartbeat to 127.24.175.254:32869 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.24.175.254:32869: connect: Connection refused (error 111)
I20260811 16:38:02.038571 5732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:02.038253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:32869 (local address 127.24.175.195:47991)
0811 16:38:02.038466 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:02.038531 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:32869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":47,"threads_started":1}
W20260811 16:38:02.038760 5605 heartbeater.cc:644] Failed to heartbeat to 127.24.175.254:32869 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.24.175.254:32869: connect: Connection refused (error 111)
I20260811 16:38:02.541119 5733 raft_consensus.cc:482] T 00000000000000000000000000000000 P 246f1e8e44c54e4588a89c771a803c2e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aa75a15571b74a698cb8903ef0fb78b7)
I20260811 16:38:02.541257 5733 raft_consensus.cc:504] T 00000000000000000000000000000000 P 246f1e8e44c54e4588a89c771a803c2e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "aa75a15571b74a698cb8903ef0fb78b7" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 32869 } } peers { permanent_uuid: "0c4b4b269a314fcbbe5d31a56cdcbd58" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 46701 } attrs { promote: false } } peers { permanent_uuid: "246f1e8e44c54e4588a89c771a803c2e" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 46357 } attrs { promote: false } }
I20260811 16:38:02.541447 5737 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aa75a15571b74a698cb8903ef0fb78b7)
I20260811 16:38:02.541580 5733 leader_election.cc:288] T 00000000000000000000000000000000 P 246f1e8e44c54e4588a89c771a803c2e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aa75a15571b74a698cb8903ef0fb78b7 (127.24.175.254:32869), 0c4b4b269a314fcbbe5d31a56cdcbd58 (127.24.175.253:46701)
I20260811 16:38:02.541554 5737 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "aa75a15571b74a698cb8903ef0fb78b7" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 32869 } } peers { permanent_uuid: "0c4b4b269a314fcbbe5d31a56cdcbd58" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 46701 } attrs { promote: false } } peers { permanent_uuid: "246f1e8e44c54e4588a89c771a803c2e" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 46357 } attrs { promote: false } }
I20260811 16:38:02.542425 5739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:02.541705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:32869 (local address 127.0.0.1:35960)
0811 16:38:02.541821 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:02.542379 (+ 558us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:32869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":69,"threads_started":1}
I20260811 16:38:02.542428 5737 leader_election.cc:288] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aa75a15571b74a698cb8903ef0fb78b7 (127.24.175.254:32869), 246f1e8e44c54e4588a89c771a803c2e (127.24.175.252:46357)
I20260811 16:38:02.542537 5742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:02.542182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:32869 (local address 127.0.0.1:35964)
0811 16:38:02.542398 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:02.542437 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:32869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":45,"threads_started":1}
W20260811 16:38:02.542637 4476 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.24.175.254:32869: connect: Connection refused (error 111)
W20260811 16:38:02.542665 4783 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.24.175.254:32869: connect: Connection refused (error 111)
I20260811 16:38:02.542994 5742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:02.542921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:32869 (local address 127.0.0.1:35976)
0811 16:38:02.542950 (+ 29us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:02.542971 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:32869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
W20260811 16:38:02.543072 4476 leader_election.cc:334] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer aa75a15571b74a698cb8903ef0fb78b7 (127.24.175.254:32869): Network error: Client connection negotiation failed: client connection to 127.24.175.254:32869: connect: Connection refused (error 111)
I20260811 16:38:02.543254 5739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:02.543079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:32869 (local address 127.0.0.1:35988)
0811 16:38:02.543200 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:02.543229 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:32869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105}
W20260811 16:38:02.543326 4783 leader_election.cc:334] T 00000000000000000000000000000000 P 246f1e8e44c54e4588a89c771a803c2e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer aa75a15571b74a698cb8903ef0fb78b7 (127.24.175.254:32869): Network error: Client connection negotiation failed: client connection to 127.24.175.254:32869: connect: Connection refused (error 111)
I20260811 16:38:02.545238 5740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:02.541774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42302 (local address 127.24.175.253:46701)
0811 16:38:02.541893 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:02.541895 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:02.541940 (+ 45us) server_negotiation.cc:407] Connection header received
0811 16:38:02.541969 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:02.541970 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:02.541980 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:02.542038 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:38:02.542239 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:02.542971 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:02.544443 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:02.544955 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:02.545014 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:02.545023 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:02.545142 (+ 119us) server_negotiation.cc:299] Negotiation successful
0811 16:38:02.545180 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98,"thread_start_us":54,"threads_started":1}
I20260811 16:38:02.545249 5738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:02.541717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.253:46701 (local address 127.0.0.1:42302)
0811 16:38:02.541825 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:02.541836 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:02.541891 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:02.542057 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:02.542059 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:02.542061 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:38:02.542126 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:02.542129 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:02.543058 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:02.543059 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:02.544357 (+ 1298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:02.544360 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:02.545026 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:02.545027 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:02.545084 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:02.545088 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:38:02.545131 (+ 43us) client_negotiation.cc:240] Negotiation successful
0811 16:38:02.545176 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":44,"threads_started":1}
I20260811 16:38:02.545514 5741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:02.542144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.252:46357 (local address 127.0.0.1:35116)
0811 16:38:02.542288 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:02.542297 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:02.542340 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:02.542632 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:02.542633 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:02.542635 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:38:02.542705 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:02.542707 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:02.543592 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:02.543593 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:02.544775 (+ 1182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:02.544777 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:02.545275 (+ 498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:02.545276 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:02.545353 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:02.545357 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:38:02.545404 (+ 47us) client_negotiation.cc:240] Negotiation successful
0811 16:38:02.545447 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":69,"threads_started":1}
I20260811 16:38:02.545536 5743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:02.542358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35116 (local address 127.24.175.252:46357)
0811 16:38:02.542492 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:02.542494 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:02.542502 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:38:02.542524 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:02.542525 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:02.542534 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:02.542776 (+ 242us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:38:02.542814 (+ 38us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:02.543523 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:02.544842 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:02.545201 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:02.545266 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:02.545273 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:02.545416 (+ 143us) server_negotiation.cc:299] Negotiation successful
0811 16:38:02.545455 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":49,"threads_started":1}
I20260811 16:38:02.545768 4834 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0c4b4b269a314fcbbe5d31a56cdcbd58" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "246f1e8e44c54e4588a89c771a803c2e" is_pre_election: true
I20260811 16:38:02.545768 4512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "246f1e8e44c54e4588a89c771a803c2e" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "0c4b4b269a314fcbbe5d31a56cdcbd58" is_pre_election: true
I20260811 16:38:02.545869 4834 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 246f1e8e44c54e4588a89c771a803c2e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c4b4b269a314fcbbe5d31a56cdcbd58 in term 1.
I20260811 16:38:02.545869 4512 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 246f1e8e44c54e4588a89c771a803c2e in term 1.
I20260811 16:38:02.546003 4479 leader_election.cc:302] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c4b4b269a314fcbbe5d31a56cdcbd58, 246f1e8e44c54e4588a89c771a803c2e; no voters: aa75a15571b74a698cb8903ef0fb78b7
I20260811 16:38:02.546010 4782 leader_election.cc:302] T 00000000000000000000000000000000 P 246f1e8e44c54e4588a89c771a803c2e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c4b4b269a314fcbbe5d31a56cdcbd58, 246f1e8e44c54e4588a89c771a803c2e; no voters: aa75a15571b74a698cb8903ef0fb78b7
I20260811 16:38:02.546110 5733 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 246f1e8e44c54e4588a89c771a803c2e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 16:38:02.546169 5733 raft_consensus.cc:482] T 00000000000000000000000000000000 P 246f1e8e44c54e4588a89c771a803c2e [term 1 FOLLOWER]: Starting leader election (detected failure of leader aa75a15571b74a698cb8903ef0fb78b7)
I20260811 16:38:02.546187 5737 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 16:38:02.546197 5733 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 246f1e8e44c54e4588a89c771a803c2e [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:38:02.546221 5737 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58 [term 1 FOLLOWER]: Starting leader election (detected failure of leader aa75a15571b74a698cb8903ef0fb78b7)
I20260811 16:38:02.546239 5737 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:38:02.547060 5733 raft_consensus.cc:504] T 00000000000000000000000000000000 P 246f1e8e44c54e4588a89c771a803c2e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "aa75a15571b74a698cb8903ef0fb78b7" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 32869 } } peers { permanent_uuid: "0c4b4b269a314fcbbe5d31a56cdcbd58" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 46701 } attrs { promote: false } } peers { permanent_uuid: "246f1e8e44c54e4588a89c771a803c2e" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 46357 } attrs { promote: false } }
I20260811 16:38:02.547060 5737 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "aa75a15571b74a698cb8903ef0fb78b7" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 32869 } } peers { permanent_uuid: "0c4b4b269a314fcbbe5d31a56cdcbd58" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 46701 } attrs { promote: false } } peers { permanent_uuid: "246f1e8e44c54e4588a89c771a803c2e" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 46357 } attrs { promote: false } }
I20260811 16:38:02.547199 5737 leader_election.cc:288] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58 [CANDIDATE]: Term 2 election: Requested vote from peers aa75a15571b74a698cb8903ef0fb78b7 (127.24.175.254:32869), 246f1e8e44c54e4588a89c771a803c2e (127.24.175.252:46357)
I20260811 16:38:02.547197 5733 leader_election.cc:288] T 00000000000000000000000000000000 P 246f1e8e44c54e4588a89c771a803c2e [CANDIDATE]: Term 2 election: Requested vote from peers aa75a15571b74a698cb8903ef0fb78b7 (127.24.175.254:32869), 0c4b4b269a314fcbbe5d31a56cdcbd58 (127.24.175.253:46701)
I20260811 16:38:02.547363 5741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:02.547278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:32869 (local address 127.0.0.1:36000)
0811 16:38:02.547313 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:02.547342 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:32869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
I20260811 16:38:02.547364 4834 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0c4b4b269a314fcbbe5d31a56cdcbd58" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "246f1e8e44c54e4588a89c771a803c2e"
I20260811 16:38:02.547369 4512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "246f1e8e44c54e4588a89c771a803c2e" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "0c4b4b269a314fcbbe5d31a56cdcbd58"
I20260811 16:38:02.547458 4512 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 246f1e8e44c54e4588a89c771a803c2e in current term 2: Already voted for candidate 0c4b4b269a314fcbbe5d31a56cdcbd58 in this term.
I20260811 16:38:02.547458 4834 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 246f1e8e44c54e4588a89c771a803c2e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c4b4b269a314fcbbe5d31a56cdcbd58 in current term 2: Already voted for candidate 246f1e8e44c54e4588a89c771a803c2e in this term.
I20260811 16:38:02.547629 5741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:02.547552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:32869 (local address 127.0.0.1:36016)
0811 16:38:02.547583 (+ 31us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:02.547610 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:32869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
I20260811 16:38:02.547657 5738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:02.547365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:32869 (local address 127.0.0.1:36010)
0811 16:38:02.547605 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:02.547632 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:32869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":226}
W20260811 16:38:02.547695 4476 leader_election.cc:334] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer aa75a15571b74a698cb8903ef0fb78b7 (127.24.175.254:32869): Network error: Client connection negotiation failed: client connection to 127.24.175.254:32869: connect: Connection refused (error 111)
I20260811 16:38:02.547744 4476 leader_election.cc:302] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c4b4b269a314fcbbe5d31a56cdcbd58; no voters: 246f1e8e44c54e4588a89c771a803c2e, aa75a15571b74a698cb8903ef0fb78b7
I20260811 16:38:02.547832 5737 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260811 16:38:02.547919 5738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:02.547835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:32869 (local address 127.0.0.1:36028)
0811 16:38:02.547867 (+ 32us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:02.547895 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:32869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
W20260811 16:38:02.547976 4783 leader_election.cc:334] T 00000000000000000000000000000000 P 246f1e8e44c54e4588a89c771a803c2e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer aa75a15571b74a698cb8903ef0fb78b7 (127.24.175.254:32869): Network error: Client connection negotiation failed: client connection to 127.24.175.254:32869: connect: Connection refused (error 111)
I20260811 16:38:02.548012 4783 leader_election.cc:302] T 00000000000000000000000000000000 P 246f1e8e44c54e4588a89c771a803c2e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 246f1e8e44c54e4588a89c771a803c2e; no voters: 0c4b4b269a314fcbbe5d31a56cdcbd58, aa75a15571b74a698cb8903ef0fb78b7
I20260811 16:38:02.548071 5733 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 246f1e8e44c54e4588a89c771a803c2e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260811 16:38:03.039048 5753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:03.038611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:32869 (local address 127.24.175.193:49537)
0811 16:38:03.038949 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:03.038985 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:32869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":321,"thread_start_us":69,"threads_started":1}
I20260811 16:38:03.039106 5750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:03.038326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:32869 (local address 127.24.175.194:33829)
0811 16:38:03.038761 (+ 435us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:03.038804 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:32869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":412,"thread_start_us":110,"threads_started":1}
I20260811 16:38:03.039271 5755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:03.038986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:32869 (local address 127.24.175.195:47811)
0811 16:38:03.039154 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:03.039203 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:32869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":66,"threads_started":1}
I20260811 16:38:04.039728 5759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:04.039519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:32869 (local address 127.24.175.193:57369)
0811 16:38:04.039634 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:04.039672 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:32869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":67,"threads_started":1}
I20260811 16:38:04.039826 5764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:04.039645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:32869 (local address 127.24.175.195:45051)
0811 16:38:04.039746 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:04.039780 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:32869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85,"thread_start_us":42,"threads_started":1}
I20260811 16:38:04.039826 5763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:04.039610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:32869 (local address 127.24.175.194:41193)
0811 16:38:04.039746 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:04.039780 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:32869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":76,"threads_started":1}
I20260811 16:38:04.364274 5766 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:38:04.364374 5766 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "aa75a15571b74a698cb8903ef0fb78b7" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 32869 } } peers { permanent_uuid: "0c4b4b269a314fcbbe5d31a56cdcbd58" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 46701 } attrs { promote: false } } peers { permanent_uuid: "246f1e8e44c54e4588a89c771a803c2e" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 46357 } attrs { promote: false } }
I20260811 16:38:04.364550 5766 leader_election.cc:288] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aa75a15571b74a698cb8903ef0fb78b7 (127.24.175.254:32869), 246f1e8e44c54e4588a89c771a803c2e (127.24.175.252:46357)
I20260811 16:38:04.364805 4834 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0c4b4b269a314fcbbe5d31a56cdcbd58" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "246f1e8e44c54e4588a89c771a803c2e" is_pre_election: true
I20260811 16:38:04.364888 5769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:04.364688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:32869 (local address 127.0.0.1:59422)
0811 16:38:04.364809 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:04.364846 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:32869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":66,"threads_started":1}
I20260811 16:38:04.364907 4834 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 246f1e8e44c54e4588a89c771a803c2e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c4b4b269a314fcbbe5d31a56cdcbd58 in term 2.
I20260811 16:38:04.365083 4479 leader_election.cc:302] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c4b4b269a314fcbbe5d31a56cdcbd58, 246f1e8e44c54e4588a89c771a803c2e; no voters:
I20260811 16:38:04.365192 5766 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:38:04.365231 5766 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:38:04.365252 5766 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:38:04.365373 5769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:04.365259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:32869 (local address 127.0.0.1:59436)
0811 16:38:04.365311 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:04.365347 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:32869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260811 16:38:04.365450 4476 leader_election.cc:334] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer aa75a15571b74a698cb8903ef0fb78b7 (127.24.175.254:32869): Network error: Client connection negotiation failed: client connection to 127.24.175.254:32869: connect: Connection refused (error 111)
I20260811 16:38:04.366071 5766 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "aa75a15571b74a698cb8903ef0fb78b7" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 32869 } } peers { permanent_uuid: "0c4b4b269a314fcbbe5d31a56cdcbd58" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 46701 } attrs { promote: false } } peers { permanent_uuid: "246f1e8e44c54e4588a89c771a803c2e" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 46357 } attrs { promote: false } }
I20260811 16:38:04.366233 5766 leader_election.cc:288] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58 [CANDIDATE]: Term 3 election: Requested vote from peers aa75a15571b74a698cb8903ef0fb78b7 (127.24.175.254:32869), 246f1e8e44c54e4588a89c771a803c2e (127.24.175.252:46357)
I20260811 16:38:04.366403 5769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:04.366311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:32869 (local address 127.0.0.1:59440)
0811 16:38:04.366347 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:04.366378 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:32869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
I20260811 16:38:04.366427 4834 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0c4b4b269a314fcbbe5d31a56cdcbd58" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "246f1e8e44c54e4588a89c771a803c2e"
I20260811 16:38:04.366528 4834 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 246f1e8e44c54e4588a89c771a803c2e [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:38:04.366726 5769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:04.366650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:32869 (local address 127.0.0.1:59446)
0811 16:38:04.366690 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:04.366711 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:32869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260811 16:38:04.366801 4476 leader_election.cc:334] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer aa75a15571b74a698cb8903ef0fb78b7 (127.24.175.254:32869): Network error: Client connection negotiation failed: client connection to 127.24.175.254:32869: connect: Connection refused (error 111)
I20260811 16:38:04.367275 4834 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 246f1e8e44c54e4588a89c771a803c2e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c4b4b269a314fcbbe5d31a56cdcbd58 in term 3.
I20260811 16:38:04.367442 4479 leader_election.cc:302] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c4b4b269a314fcbbe5d31a56cdcbd58, 246f1e8e44c54e4588a89c771a803c2e; no voters: aa75a15571b74a698cb8903ef0fb78b7
I20260811 16:38:04.367545 5766 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:38:04.367666 5766 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58 [term 3 LEADER]: Becoming Leader. State: Replica: 0c4b4b269a314fcbbe5d31a56cdcbd58, State: Running, Role: LEADER
I20260811 16:38:04.367741 5766 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "aa75a15571b74a698cb8903ef0fb78b7" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 32869 } } peers { permanent_uuid: "0c4b4b269a314fcbbe5d31a56cdcbd58" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 46701 } attrs { promote: false } } peers { permanent_uuid: "246f1e8e44c54e4588a89c771a803c2e" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 46357 } attrs { promote: false } }
I20260811 16:38:04.368081 5771 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0c4b4b269a314fcbbe5d31a56cdcbd58. Latest consensus state: current_term: 3 leader_uuid: "0c4b4b269a314fcbbe5d31a56cdcbd58" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "aa75a15571b74a698cb8903ef0fb78b7" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 32869 } } peers { permanent_uuid: "0c4b4b269a314fcbbe5d31a56cdcbd58" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 46701 } attrs { promote: false } } peers { permanent_uuid: "246f1e8e44c54e4588a89c771a803c2e" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 46357 } attrs { promote: false } } }
I20260811 16:38:04.368206 5771 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58 [sys.catalog]: This master's current role is: LEADER
I20260811 16:38:04.368381 5776 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:38:04.368893 5776 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:38:04.368973 5776 catalog_manager.cc:1259] Loaded cluster ID: 0e428c83b67d4dcea16df7d63a9479e8
I20260811 16:38:04.369005 5776 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:38:04.369195 5776 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:38:04.369266 5776 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58: Loaded TSK: 0
I20260811 16:38:04.369405 5776 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:38:04.387393 4495 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42286:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:38:04.388991 4495 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:38:04.389873 5769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:04.389775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:32869 (local address 127.0.0.1:59460)
0811 16:38:04.389817 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:04.389843 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:32869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
I20260811 16:38:04.389878 4834 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 246f1e8e44c54e4588a89c771a803c2e [term 3 FOLLOWER]: Refusing update from remote peer 0c4b4b269a314fcbbe5d31a56cdcbd58: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260811 16:38:04.390077 5771 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "246f1e8e44c54e4588a89c771a803c2e" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 46357 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260811 16:38:04.390225 5769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:04.390119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:32869 (local address 127.0.0.1:59472)
0811 16:38:04.390178 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:04.390203 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:32869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260811 16:38:04.390357 4476 consensus_peers.cc:487] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58 -> Peer aa75a15571b74a698cb8903ef0fb78b7 (127.24.175.254:32869): Couldn't send request to peer aa75a15571b74a698cb8903ef0fb78b7. Status: Network error: Client connection negotiation failed: client connection to 127.24.175.254:32869: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:38:04.390677 5780 sys_catalog.cc:455] T 00000000000000000000000000000000 P 246f1e8e44c54e4588a89c771a803c2e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0c4b4b269a314fcbbe5d31a56cdcbd58. Latest consensus state: current_term: 3 leader_uuid: "0c4b4b269a314fcbbe5d31a56cdcbd58" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "aa75a15571b74a698cb8903ef0fb78b7" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 32869 } } peers { permanent_uuid: "0c4b4b269a314fcbbe5d31a56cdcbd58" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 46701 } attrs { promote: false } } peers { permanent_uuid: "246f1e8e44c54e4588a89c771a803c2e" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 46357 } attrs { promote: false } } }
I20260811 16:38:04.390762 5780 sys_catalog.cc:458] T 00000000000000000000000000000000 P 246f1e8e44c54e4588a89c771a803c2e [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:38:04.391021 5778 mvcc.cc:205] Tried to move back new op lower bound from 7317365900859305984 to 7317365900770824192. Current Snapshot: MvccSnapshot[applied={T|T < 7317365900859305984}]
I20260811 16:38:04.391108 5766 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "0c4b4b269a314fcbbe5d31a56cdcbd58" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "aa75a15571b74a698cb8903ef0fb78b7" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 32869 } } peers { permanent_uuid: "0c4b4b269a314fcbbe5d31a56cdcbd58" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 46701 } attrs { promote: false } } peers { permanent_uuid: "246f1e8e44c54e4588a89c771a803c2e" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 46357 } attrs { promote: false } } }
I20260811 16:38:04.391185 5766 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58 [sys.catalog]: This master's current role is: LEADER
I20260811 16:38:04.391386 5780 sys_catalog.cc:455] T 00000000000000000000000000000000 P 246f1e8e44c54e4588a89c771a803c2e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "0c4b4b269a314fcbbe5d31a56cdcbd58" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "aa75a15571b74a698cb8903ef0fb78b7" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 32869 } } peers { permanent_uuid: "0c4b4b269a314fcbbe5d31a56cdcbd58" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 46701 } attrs { promote: false } } peers { permanent_uuid: "246f1e8e44c54e4588a89c771a803c2e" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 46357 } attrs { promote: false } } }
I20260811 16:38:04.391475 5780 sys_catalog.cc:458] T 00000000000000000000000000000000 P 246f1e8e44c54e4588a89c771a803c2e [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:38:04.396109 5792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:04.392935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.194:43771 (local address 127.0.0.1:43050)
0811 16:38:04.393214 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:04.393223 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:04.393283 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:04.393425 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:04.393426 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:04.393428 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:38:04.393478 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:04.393480 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:04.394119 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:04.394120 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:04.395128 (+ 1008us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:04.395130 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:04.395872 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:04.395873 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:04.395941 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:04.395946 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 16:38:04.396004 (+ 58us) client_negotiation.cc:240] Negotiation successful
0811 16:38:04.396047 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":97,"threads_started":1}
I20260811 16:38:04.396136 5794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:04.393095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43050 (local address 127.24.175.194:43771)
0811 16:38:04.393238 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:04.393240 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:04.393273 (+ 33us) server_negotiation.cc:407] Connection header received
0811 16:38:04.393338 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:04.393338 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:04.393349 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:04.393416 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:38:04.393551 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:04.394045 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:04.395252 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:04.395800 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:04.395869 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:04.395879 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:04.396015 (+ 136us) server_negotiation.cc:299] Negotiation successful
0811 16:38:04.396062 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":69,"threads_started":1}
I20260811 16:38:04.396373 5769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:04.392858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.195:36259 (local address 127.0.0.1:44276)
0811 16:38:04.392933 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:04.392944 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:04.392991 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:04.393516 (+ 525us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:04.393517 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:04.393518 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:38:04.393559 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:04.393561 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:04.394542 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:04.394543 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:04.395552 (+ 1009us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:04.395554 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:04.396177 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:04.396177 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:04.396244 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:04.396249 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 16:38:04.396279 (+ 30us) client_negotiation.cc:240] Negotiation successful
0811 16:38:04.396319 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260811 16:38:04.396656 5786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:04.392938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44276 (local address 127.24.175.195:36259)
0811 16:38:04.393197 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:04.393199 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:04.393207 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:38:04.393233 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:04.393234 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:04.393246 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:04.393620 (+ 374us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:38:04.393660 (+ 40us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:04.394464 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:04.395621 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:04.396089 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:04.396517 (+ 428us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:04.396528 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:04.396547 (+ 19us) server_negotiation.cc:299] Negotiation successful
0811 16:38:04.396588 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":237,"thread_start_us":63,"threads_started":1}
I20260811 16:38:04.396692 5258 tablet_service.cc:1467] Processing CreateTablet for tablet 93f1ca18be734e9da77484f13d2f0f41 (DEFAULT_TABLE table=test-table [id=ed8fbf34055e47f3b3cfa83a8e788ec9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:38:04.396847 5258 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 93f1ca18be734e9da77484f13d2f0f41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:38:04.396847 5482 tablet_service.cc:1467] Processing CreateTablet for tablet 93f1ca18be734e9da77484f13d2f0f41 (DEFAULT_TABLE table=test-table [id=ed8fbf34055e47f3b3cfa83a8e788ec9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:38:04.396955 5482 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 93f1ca18be734e9da77484f13d2f0f41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:38:04.398109 5799 tablet_bootstrap.cc:492] T 93f1ca18be734e9da77484f13d2f0f41 P ac7de4f358864daa98d98cb042072912: Bootstrap starting.
I20260811 16:38:04.398655 5800 tablet_bootstrap.cc:492] T 93f1ca18be734e9da77484f13d2f0f41 P fd8823eeae954b089aaf278fc23441ec: Bootstrap starting.
I20260811 16:38:04.398726 5799 tablet_bootstrap.cc:654] T 93f1ca18be734e9da77484f13d2f0f41 P ac7de4f358864daa98d98cb042072912: Neither blocks nor log segments found. Creating new log.
I20260811 16:38:04.399055 5800 tablet_bootstrap.cc:654] T 93f1ca18be734e9da77484f13d2f0f41 P fd8823eeae954b089aaf278fc23441ec: Neither blocks nor log segments found. Creating new log.
I20260811 16:38:04.399183 5790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:04.392925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.193:39351 (local address 127.0.0.1:60796)
0811 16:38:04.393054 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:04.393064 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:04.393113 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:04.393542 (+ 429us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:04.393543 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:04.393545 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:38:04.393584 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:04.393585 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:04.395635 (+ 2050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:04.395636 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:04.396568 (+ 932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:04.396570 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:04.398965 (+ 2395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:04.398966 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:04.399032 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:04.399037 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 16:38:04.399087 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 16:38:04.399123 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":79,"threads_started":1}
I20260811 16:38:04.399238 5798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:04.393108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60796 (local address 127.24.175.193:39351)
0811 16:38:04.393387 (+ 279us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:04.393389 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:04.393396 (+ 7us) server_negotiation.cc:407] Connection header received
0811 16:38:04.393420 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:04.393420 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:04.393430 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:04.393493 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:38:04.393652 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:04.394464 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:04.398316 (+ 3852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:04.398883 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:04.398962 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:04.398970 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:04.399108 (+ 138us) server_negotiation.cc:299] Negotiation successful
0811 16:38:04.399157 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":255,"thread_start_us":79,"threads_started":1}
I20260811 16:38:04.399472 5799 tablet_bootstrap.cc:492] T 93f1ca18be734e9da77484f13d2f0f41 P ac7de4f358864daa98d98cb042072912: No bootstrap required, opened a new log
I20260811 16:38:04.399554 5799 ts_tablet_manager.cc:1397] T 93f1ca18be734e9da77484f13d2f0f41 P ac7de4f358864daa98d98cb042072912: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 16:38:04.399657 5800 tablet_bootstrap.cc:492] T 93f1ca18be734e9da77484f13d2f0f41 P fd8823eeae954b089aaf278fc23441ec: No bootstrap required, opened a new log
I20260811 16:38:04.399708 5800 ts_tablet_manager.cc:1397] T 93f1ca18be734e9da77484f13d2f0f41 P fd8823eeae954b089aaf278fc23441ec: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 16:38:04.399686 5016 tablet_service.cc:1467] Processing CreateTablet for tablet 93f1ca18be734e9da77484f13d2f0f41 (DEFAULT_TABLE table=test-table [id=ed8fbf34055e47f3b3cfa83a8e788ec9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:38:04.399688 5799 raft_consensus.cc:348] T 93f1ca18be734e9da77484f13d2f0f41 P ac7de4f358864daa98d98cb042072912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd8823eeae954b089aaf278fc23441ec" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 36259 } } peers { permanent_uuid: "ac7de4f358864daa98d98cb042072912" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 43771 } } peers { permanent_uuid: "7cc554e49f17483b9143ff94990f2697" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39351 } }
I20260811 16:38:04.399753 5799 raft_consensus.cc:374] T 93f1ca18be734e9da77484f13d2f0f41 P ac7de4f358864daa98d98cb042072912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:38:04.399775 5799 raft_consensus.cc:729] T 93f1ca18be734e9da77484f13d2f0f41 P ac7de4f358864daa98d98cb042072912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac7de4f358864daa98d98cb042072912, State: Initialized, Role: FOLLOWER
I20260811 16:38:04.399807 5016 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 93f1ca18be734e9da77484f13d2f0f41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:38:04.399850 5799 consensus_queue.cc:260] T 93f1ca18be734e9da77484f13d2f0f41 P ac7de4f358864daa98d98cb042072912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd8823eeae954b089aaf278fc23441ec" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 36259 } } peers { permanent_uuid: "ac7de4f358864daa98d98cb042072912" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 43771 } } peers { permanent_uuid: "7cc554e49f17483b9143ff94990f2697" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39351 } }
I20260811 16:38:04.399870 5800 raft_consensus.cc:348] T 93f1ca18be734e9da77484f13d2f0f41 P fd8823eeae954b089aaf278fc23441ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd8823eeae954b089aaf278fc23441ec" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 36259 } } peers { permanent_uuid: "ac7de4f358864daa98d98cb042072912" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 43771 } } peers { permanent_uuid: "7cc554e49f17483b9143ff94990f2697" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39351 } }
I20260811 16:38:04.399967 5800 raft_consensus.cc:374] T 93f1ca18be734e9da77484f13d2f0f41 P fd8823eeae954b089aaf278fc23441ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:38:04.400025 5800 raft_consensus.cc:729] T 93f1ca18be734e9da77484f13d2f0f41 P fd8823eeae954b089aaf278fc23441ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd8823eeae954b089aaf278fc23441ec, State: Initialized, Role: FOLLOWER
I20260811 16:38:04.400159 5800 consensus_queue.cc:260] T 93f1ca18be734e9da77484f13d2f0f41 P fd8823eeae954b089aaf278fc23441ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd8823eeae954b089aaf278fc23441ec" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 36259 } } peers { permanent_uuid: "ac7de4f358864daa98d98cb042072912" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 43771 } } peers { permanent_uuid: "7cc554e49f17483b9143ff94990f2697" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39351 } }
I20260811 16:38:04.400486 5800 ts_tablet_manager.cc:1428] T 93f1ca18be734e9da77484f13d2f0f41 P fd8823eeae954b089aaf278fc23441ec: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260811 16:38:04.400514 5763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:04.400173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:32869 (local address 127.24.175.194:47535)
0811 16:38:04.400211 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:04.400390 (+ 179us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:32869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260811 16:38:04.400024 5799 ts_tablet_manager.cc:1428] T 93f1ca18be734e9da77484f13d2f0f41 P ac7de4f358864daa98d98cb042072912: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:04.401017 5764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:04.400911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:32869 (local address 127.24.175.195:48391)
0811 16:38:04.400954 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:04.400988 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:32869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260811 16:38:04.401305 5807 tablet_bootstrap.cc:492] T 93f1ca18be734e9da77484f13d2f0f41 P 7cc554e49f17483b9143ff94990f2697: Bootstrap starting.
I20260811 16:38:04.401487 5367 heartbeater.cc:503] Master 127.24.175.253:46701 was elected leader, sending a full tablet report...
I20260811 16:38:04.401551 5607 heartbeater.cc:503] Master 127.24.175.253:46701 was elected leader, sending a full tablet report...
I20260811 16:38:04.401676 5763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:04.401581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:32869 (local address 127.24.175.194:58689)
0811 16:38:04.401618 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:04.401640 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:32869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260811 16:38:04.401757 5764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:04.401667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:32869 (local address 127.24.175.195:33649)
0811 16:38:04.401700 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:04.401723 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:32869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
I20260811 16:38:04.401888 5807 tablet_bootstrap.cc:654] T 93f1ca18be734e9da77484f13d2f0f41 P 7cc554e49f17483b9143ff94990f2697: Neither blocks nor log segments found. Creating new log.
I20260811 16:38:04.402482 5807 tablet_bootstrap.cc:492] T 93f1ca18be734e9da77484f13d2f0f41 P 7cc554e49f17483b9143ff94990f2697: No bootstrap required, opened a new log
I20260811 16:38:04.402527 5807 ts_tablet_manager.cc:1397] T 93f1ca18be734e9da77484f13d2f0f41 P 7cc554e49f17483b9143ff94990f2697: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 16:38:04.402657 5807 raft_consensus.cc:348] T 93f1ca18be734e9da77484f13d2f0f41 P 7cc554e49f17483b9143ff94990f2697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd8823eeae954b089aaf278fc23441ec" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 36259 } } peers { permanent_uuid: "ac7de4f358864daa98d98cb042072912" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 43771 } } peers { permanent_uuid: "7cc554e49f17483b9143ff94990f2697" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39351 } }
I20260811 16:38:04.402715 5807 raft_consensus.cc:374] T 93f1ca18be734e9da77484f13d2f0f41 P 7cc554e49f17483b9143ff94990f2697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:38:04.402727 5807 raft_consensus.cc:729] T 93f1ca18be734e9da77484f13d2f0f41 P 7cc554e49f17483b9143ff94990f2697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cc554e49f17483b9143ff94990f2697, State: Initialized, Role: FOLLOWER
I20260811 16:38:04.402763 5807 consensus_queue.cc:260] T 93f1ca18be734e9da77484f13d2f0f41 P 7cc554e49f17483b9143ff94990f2697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd8823eeae954b089aaf278fc23441ec" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 36259 } } peers { permanent_uuid: "ac7de4f358864daa98d98cb042072912" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 43771 } } peers { permanent_uuid: "7cc554e49f17483b9143ff94990f2697" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39351 } }
I20260811 16:38:04.402928 5807 ts_tablet_manager.cc:1428] T 93f1ca18be734e9da77484f13d2f0f41 P 7cc554e49f17483b9143ff94990f2697: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 16:38:04.403159 5759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:04.403070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:32869 (local address 127.24.175.193:32983)
0811 16:38:04.403111 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:04.403133 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:32869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260811 16:38:04.403466 5149 heartbeater.cc:503] Master 127.24.175.253:46701 was elected leader, sending a full tablet report...
I20260811 16:38:04.403515 5759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:04.403417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:32869 (local address 127.24.175.193:39699)
0811 16:38:04.403449 (+ 32us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:04.403477 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:32869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
I20260811 16:38:04.535873 5804 raft_consensus.cc:482] T 93f1ca18be734e9da77484f13d2f0f41 P ac7de4f358864daa98d98cb042072912 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:38:04.535965 5804 raft_consensus.cc:504] T 93f1ca18be734e9da77484f13d2f0f41 P ac7de4f358864daa98d98cb042072912 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd8823eeae954b089aaf278fc23441ec" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 36259 } } peers { permanent_uuid: "ac7de4f358864daa98d98cb042072912" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 43771 } } peers { permanent_uuid: "7cc554e49f17483b9143ff94990f2697" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39351 } }
I20260811 16:38:04.536139 5804 leader_election.cc:288] T 93f1ca18be734e9da77484f13d2f0f41 P ac7de4f358864daa98d98cb042072912 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd8823eeae954b089aaf278fc23441ec (127.24.175.195:36259), 7cc554e49f17483b9143ff94990f2697 (127.24.175.193:39351)
I20260811 16:38:04.536320 5521 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93f1ca18be734e9da77484f13d2f0f41" candidate_uuid: "ac7de4f358864daa98d98cb042072912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd8823eeae954b089aaf278fc23441ec" is_pre_election: true
I20260811 16:38:04.536347 5055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93f1ca18be734e9da77484f13d2f0f41" candidate_uuid: "ac7de4f358864daa98d98cb042072912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cc554e49f17483b9143ff94990f2697" is_pre_election: true
I20260811 16:38:04.536412 5521 raft_consensus.cc:2454] T 93f1ca18be734e9da77484f13d2f0f41 P fd8823eeae954b089aaf278fc23441ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac7de4f358864daa98d98cb042072912 in term 0.
I20260811 16:38:04.536459 5055 raft_consensus.cc:2454] T 93f1ca18be734e9da77484f13d2f0f41 P 7cc554e49f17483b9143ff94990f2697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac7de4f358864daa98d98cb042072912 in term 0.
I20260811 16:38:04.536573 5188 leader_election.cc:302] T 93f1ca18be734e9da77484f13d2f0f41 P ac7de4f358864daa98d98cb042072912 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac7de4f358864daa98d98cb042072912, fd8823eeae954b089aaf278fc23441ec; no voters:
I20260811 16:38:04.536686 5804 raft_consensus.cc:2781] T 93f1ca18be734e9da77484f13d2f0f41 P ac7de4f358864daa98d98cb042072912 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:38:04.536731 5804 raft_consensus.cc:482] T 93f1ca18be734e9da77484f13d2f0f41 P ac7de4f358864daa98d98cb042072912 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:38:04.536748 5804 raft_consensus.cc:3037] T 93f1ca18be734e9da77484f13d2f0f41 P ac7de4f358864daa98d98cb042072912 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:38:04.537410 5804 raft_consensus.cc:504] T 93f1ca18be734e9da77484f13d2f0f41 P ac7de4f358864daa98d98cb042072912 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd8823eeae954b089aaf278fc23441ec" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 36259 } } peers { permanent_uuid: "ac7de4f358864daa98d98cb042072912" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 43771 } } peers { permanent_uuid: "7cc554e49f17483b9143ff94990f2697" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39351 } }
I20260811 16:38:04.537528 5804 leader_election.cc:288] T 93f1ca18be734e9da77484f13d2f0f41 P ac7de4f358864daa98d98cb042072912 [CANDIDATE]: Term 1 election: Requested vote from peers fd8823eeae954b089aaf278fc23441ec (127.24.175.195:36259), 7cc554e49f17483b9143ff94990f2697 (127.24.175.193:39351)
I20260811 16:38:04.537688 5521 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93f1ca18be734e9da77484f13d2f0f41" candidate_uuid: "ac7de4f358864daa98d98cb042072912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd8823eeae954b089aaf278fc23441ec"
I20260811 16:38:04.537757 5521 raft_consensus.cc:3037] T 93f1ca18be734e9da77484f13d2f0f41 P fd8823eeae954b089aaf278fc23441ec [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:38:04.537720 5055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93f1ca18be734e9da77484f13d2f0f41" candidate_uuid: "ac7de4f358864daa98d98cb042072912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cc554e49f17483b9143ff94990f2697"
I20260811 16:38:04.537789 5055 raft_consensus.cc:3037] T 93f1ca18be734e9da77484f13d2f0f41 P 7cc554e49f17483b9143ff94990f2697 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:38:04.538390 5521 raft_consensus.cc:2454] T 93f1ca18be734e9da77484f13d2f0f41 P fd8823eeae954b089aaf278fc23441ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac7de4f358864daa98d98cb042072912 in term 1.
I20260811 16:38:04.538470 5055 raft_consensus.cc:2454] T 93f1ca18be734e9da77484f13d2f0f41 P 7cc554e49f17483b9143ff94990f2697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac7de4f358864daa98d98cb042072912 in term 1.
I20260811 16:38:04.538584 5188 leader_election.cc:302] T 93f1ca18be734e9da77484f13d2f0f41 P ac7de4f358864daa98d98cb042072912 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac7de4f358864daa98d98cb042072912, fd8823eeae954b089aaf278fc23441ec; no voters:
I20260811 16:38:04.538683 5804 raft_consensus.cc:2781] T 93f1ca18be734e9da77484f13d2f0f41 P ac7de4f358864daa98d98cb042072912 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:38:04.538853 5804 raft_consensus.cc:686] T 93f1ca18be734e9da77484f13d2f0f41 P ac7de4f358864daa98d98cb042072912 [term 1 LEADER]: Becoming Leader. State: Replica: ac7de4f358864daa98d98cb042072912, State: Running, Role: LEADER
I20260811 16:38:04.538908 5804 consensus_queue.cc:237] T 93f1ca18be734e9da77484f13d2f0f41 P ac7de4f358864daa98d98cb042072912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd8823eeae954b089aaf278fc23441ec" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 36259 } } peers { permanent_uuid: "ac7de4f358864daa98d98cb042072912" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 43771 } } peers { permanent_uuid: "7cc554e49f17483b9143ff94990f2697" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39351 } }
I20260811 16:38:04.539161 5763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:04.539065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:32869 (local address 127.24.175.194:47011)
0811 16:38:04.539099 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:04.539130 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:32869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":14}
I20260811 16:38:04.539520 4496 catalog_manager.cc:5495] T 93f1ca18be734e9da77484f13d2f0f41 P ac7de4f358864daa98d98cb042072912 reported cstate change: term changed from 0 to 1, leader changed from <none> to ac7de4f358864daa98d98cb042072912 (127.24.175.194). New cstate: current_term: 1 leader_uuid: "ac7de4f358864daa98d98cb042072912" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd8823eeae954b089aaf278fc23441ec" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 36259 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac7de4f358864daa98d98cb042072912" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 43771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7cc554e49f17483b9143ff94990f2697" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39351 } health_report { overall_health: UNKNOWN } } }
W20260811 16:38:04.561897 5152 tablet.cc:2369] T 93f1ca18be734e9da77484f13d2f0f41 P 7cc554e49f17483b9143ff94990f2697: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:38:04.575556 5794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:04.573631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43058 (local address 127.24.175.194:43771)
0811 16:38:04.573681 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:04.573682 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:04.573690 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:38:04.573740 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:04.573741 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:04.573751 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:04.573796 (+ 45us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:38:04.573890 (+ 94us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:04.574373 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:04.575074 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:04.575257 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:04.575304 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:04.575392 (+ 88us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:38:04.575415 (+ 23us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:38:04.575446 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:04.575483 (+ 37us) server_negotiation.cc:299] Negotiation successful
0811 16:38:04.575500 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 16:38:04.576447 5055 raft_consensus.cc:1261] T 93f1ca18be734e9da77484f13d2f0f41 P 7cc554e49f17483b9143ff94990f2697 [term 1 FOLLOWER]: Refusing update from remote peer ac7de4f358864daa98d98cb042072912: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:38:04.576450 5521 raft_consensus.cc:1261] T 93f1ca18be734e9da77484f13d2f0f41 P fd8823eeae954b089aaf278fc23441ec [term 1 FOLLOWER]: Refusing update from remote peer ac7de4f358864daa98d98cb042072912: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:38:04.576689 5816 consensus_queue.cc:1035] T 93f1ca18be734e9da77484f13d2f0f41 P ac7de4f358864daa98d98cb042072912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd8823eeae954b089aaf278fc23441ec" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 36259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:38:04.576813 5804 consensus_queue.cc:1035] T 93f1ca18be734e9da77484f13d2f0f41 P ac7de4f358864daa98d98cb042072912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cc554e49f17483b9143ff94990f2697" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:38:04.577448 5764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:04.577298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:32869 (local address 127.24.175.195:36579)
0811 16:38:04.577386 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:04.577416 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:32869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260811 16:38:04.577842 5759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:04.577594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:32869 (local address 127.24.175.193:46397)
0811 16:38:04.577782 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:04.577813 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:32869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171}
I20260811 16:38:04.578743 5763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:04.578601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:32869 (local address 127.24.175.194:41253)
0811 16:38:04.578687 (+ 86us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:04.578715 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:32869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260811 16:38:04.579260 5764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:04.579165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:32869 (local address 127.24.175.195:59111)
0811 16:38:04.579200 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:04.579222 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:32869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260811 16:38:04.579429 5759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:04.579226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:32869 (local address 127.24.175.193:44223)
0811 16:38:04.579370 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:04.579402 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:32869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129}
I20260811 16:38:04.580365 4496 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42286:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:38:04.580446 4496 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42286:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:38:04.581597 4496 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0c4b4b269a314fcbbe5d31a56cdcbd58: Sending DeleteTablet for 3 replicas of tablet 93f1ca18be734e9da77484f13d2f0f41
I20260811 16:38:04.581832 5482 tablet_service.cc:1514] Processing DeleteTablet for tablet 93f1ca18be734e9da77484f13d2f0f41 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:38:04 UTC) from {username='oryx', principal='oryx/127.24.175.253@KRBTEST.COM'} at 127.0.0.1:44276
I20260811 16:38:04.581887 5258 tablet_service.cc:1514] Processing DeleteTablet for tablet 93f1ca18be734e9da77484f13d2f0f41 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:38:04 UTC) from {username='oryx', principal='oryx/127.24.175.253@KRBTEST.COM'} at 127.0.0.1:43050
I20260811 16:38:04.582000 5016 tablet_service.cc:1514] Processing DeleteTablet for tablet 93f1ca18be734e9da77484f13d2f0f41 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:38:04 UTC) from {username='oryx', principal='oryx/127.24.175.253@KRBTEST.COM'} at 127.0.0.1:60796
I20260811 16:38:04.582022 5841 tablet_replica.cc:330] T 93f1ca18be734e9da77484f13d2f0f41 P fd8823eeae954b089aaf278fc23441ec: stopping tablet replica
I20260811 16:38:04.582062 5843 tablet_replica.cc:330] T 93f1ca18be734e9da77484f13d2f0f41 P ac7de4f358864daa98d98cb042072912: stopping tablet replica
I20260811 16:38:04.582067 5841 raft_consensus.cc:2229] T 93f1ca18be734e9da77484f13d2f0f41 P fd8823eeae954b089aaf278fc23441ec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:38:04.582103 5843 raft_consensus.cc:2229] T 93f1ca18be734e9da77484f13d2f0f41 P ac7de4f358864daa98d98cb042072912 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:38:04.582108 5841 raft_consensus.cc:2258] T 93f1ca18be734e9da77484f13d2f0f41 P fd8823eeae954b089aaf278fc23441ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:38:04.582208 5843 raft_consensus.cc:2258] T 93f1ca18be734e9da77484f13d2f0f41 P ac7de4f358864daa98d98cb042072912 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:38:04.582275 5844 tablet_replica.cc:330] T 93f1ca18be734e9da77484f13d2f0f41 P 7cc554e49f17483b9143ff94990f2697: stopping tablet replica
I20260811 16:38:04.582365 5844 raft_consensus.cc:2229] T 93f1ca18be734e9da77484f13d2f0f41 P 7cc554e49f17483b9143ff94990f2697 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:38:04.582430 5844 raft_consensus.cc:2258] T 93f1ca18be734e9da77484f13d2f0f41 P 7cc554e49f17483b9143ff94990f2697 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:38:04.582487 5843 ts_tablet_manager.cc:1905] T 93f1ca18be734e9da77484f13d2f0f41 P ac7de4f358864daa98d98cb042072912: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:38:04.582595 5841 ts_tablet_manager.cc:1905] T 93f1ca18be734e9da77484f13d2f0f41 P fd8823eeae954b089aaf278fc23441ec: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:38:04.582685 5844 ts_tablet_manager.cc:1905] T 93f1ca18be734e9da77484f13d2f0f41 P 7cc554e49f17483b9143ff94990f2697: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:38:04.582821 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 4744
I20260811 16:38:04.584609 5843 ts_tablet_manager.cc:1918] T 93f1ca18be734e9da77484f13d2f0f41 P ac7de4f358864daa98d98cb042072912: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:38:04.584649 5843 log.cc:1196] T 93f1ca18be734e9da77484f13d2f0f41 P ac7de4f358864daa98d98cb042072912: Deleting WAL directory at /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-1/wal/wals/93f1ca18be734e9da77484f13d2f0f41
I20260811 16:38:04.584852 5843 ts_tablet_manager.cc:1939] T 93f1ca18be734e9da77484f13d2f0f41 P ac7de4f358864daa98d98cb042072912: Deleting consensus metadata
I20260811 16:38:04.584980 5841 ts_tablet_manager.cc:1918] T 93f1ca18be734e9da77484f13d2f0f41 P fd8823eeae954b089aaf278fc23441ec: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:38:04.585037 5841 log.cc:1196] T 93f1ca18be734e9da77484f13d2f0f41 P fd8823eeae954b089aaf278fc23441ec: Deleting WAL directory at /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466249441839-25279-0/minicluster-data/ts-2/wal/wals/93f1ca18be734e9da77484f13d2f0f41
I20260811 16:38:04.585090 4478 catalog_manager.cc:4841] TS ac7de4f358864daa98d98cb042072912 (127.24.175.194:43771): tablet 93f1ca18be734e9da77484f13d2f0f41 (table test-table [id=ed8fbf34055e47f3b3cfa83a8e788ec9]) successfully deleted
I20260811 16:38:04.585260 5841 ts_tablet_manager.cc:1939] T 93f1ca18be734e9da77484f13d2f0f41 P fd8823eeae954b089aaf278fc23441ec: Deleting consensus metadata
I20260811 16:38:04.585551 4478 catalog_manager.cc:4841] TS fd8823eeae954b089aaf278fc23441ec (127.24.175.195:36259): tablet 93f1ca18be734e9da77484f13d2f0f41 (table test-table [id=ed8fbf34055e47f3b3cfa83a8e788ec9]) successfully deleted
I20260811 16:38:04.596244 5790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:04.596135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.193:39351 (local address 127.0.0.1:60804)
0811 16:38:04.596185 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:04.596213 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.193:39351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260811 16:38:04.596247 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 5159
W20260811 16:38:04.598234 4475 catalog_manager.cc:4584] TS 7cc554e49f17483b9143ff94990f2697 (127.24.175.193:39351): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 93f1ca18be734e9da77484f13d2f0f41: Network error: Client connection negotiation failed: client connection to 127.24.175.193:39351: connect: Connection refused (error 111)
I20260811 16:38:04.618819 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 5379
I20260811 16:38:04.632083 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 4263
I20260811 16:38:04.641569 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 4583
2026-08-11T16:38:04Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (6689 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:38:04 dist-test-slave-zj8q krb5kdc[5849](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:38:04 dist-test-slave-zj8q krb5kdc[5849](info): set up 2 sockets
Aug 11 16:38:04 dist-test-slave-zj8q krb5kdc[5849](info): commencing operation
krb5kdc: starting...
W20260811 16:38:05.815380 25279 mini_kdc.cc:121] Time spent starting KDC: real 1.148s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Aug 11 16:38:05 dist-test-slave-zj8q krb5kdc[5849](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466285, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:38:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:38:05Z Disabled control of system clock
WARNING: no policy specified for oryx/127.24.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.24.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.24.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/krb5kdc/oryx_127.24.175.254.keytab.
Entry for principal oryx/127.24.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/krb5kdc/oryx_127.24.175.254.keytab.
I20260811 16:38:05.926230 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:33029
--webserver_interface=127.24.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/krb5kdc/oryx_127.24.175.254.keytab
--principal=oryx/127.24.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:37151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.175.254:33029
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:38:06.005944 5871 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:38:06.006146 5871 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:38:06.006206 5871 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:38:06.007361 5871 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:38:06.007398 5871 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 16:38:06.007416 5871 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:38:06.007432 5871 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:38:06.007448 5871 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:38:06.007469 5871 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:38:06.008967 5871 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:37151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.175.254:33029
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/krb5kdc/oryx_127.24.175.254.keytab
--principal=oryx/127.24.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:33029
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5871
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:38:06.009203 5871 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:38:06.009413 5871 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:38:06.014178 5888 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:38:06.014331 5871 server_base.cc:1034] running on GCE node
W20260811 16:38:06.014439 5884 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:38:06.014509 5890 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:38:06.014818 5871 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:38:06.015079 5871 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:38:06.016196 5871 hybrid_clock.cc:648] HybridClock initialized: now 1786466286016178 us; error 32 us; skew 500 ppm
Aug 11 16:38:06 dist-test-slave-zj8q krb5kdc[5849](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466286, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:38:06.019291 5871 init.cc:377] Logged in from keytab as oryx/127.24.175.254@KRBTEST.COM (short username oryx)
I20260811 16:38:06.019755 5871 webserver.cc:460] Webserver started at http://127.24.175.254:38213/ using document root <none> and password file <none>
I20260811 16:38:06.019986 5871 fs_manager.cc:359] Metadata directory not provided
I20260811 16:38:06.020047 5871 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:38:06.020179 5871 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:38:06.021412 5871 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/master-0/data/instance:
uuid: "045a6bde55b842b1a1bcede4c5b07c0c"
format_stamp: "Formatted at 2026-08-11 16:38:06 on dist-test-slave-zj8q"
server_key: "26a6613b5888b1cd700b69c1a06e9059"
server_key_iv: "bbf3571fb0c2fc58f48ab33e77822e83"
server_key_version: "encryptionkey@0"
I20260811 16:38:06.021817 5871 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/master-0/wal/instance:
uuid: "045a6bde55b842b1a1bcede4c5b07c0c"
format_stamp: "Formatted at 2026-08-11 16:38:06 on dist-test-slave-zj8q"
server_key: "26a6613b5888b1cd700b69c1a06e9059"
server_key_iv: "bbf3571fb0c2fc58f48ab33e77822e83"
server_key_version: "encryptionkey@0"
I20260811 16:38:06.023103 5871 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 16:38:06.023752 5900 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:06.023881 5871 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:06.023964 5871 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/master-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/master-0/wal
uuid: "045a6bde55b842b1a1bcede4c5b07c0c"
format_stamp: "Formatted at 2026-08-11 16:38:06 on dist-test-slave-zj8q"
server_key: "26a6613b5888b1cd700b69c1a06e9059"
server_key_iv: "bbf3571fb0c2fc58f48ab33e77822e83"
server_key_version: "encryptionkey@0"
I20260811 16:38:06.024032 5871 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:38:06.041409 5871 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:38:06.043188 5871 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:38:06.043313 5871 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:38:06.047794 5871 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.254:33029
I20260811 16:38:06.047879 6003 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.254:33029 every 8 connection(s)
I20260811 16:38:06.048149 5871 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
I20260811 16:38:06.048817 6007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:38:06.050350 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 5871
I20260811 16:38:06.050434 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/master-0/wal/instance
I20260811 16:38:06.050609 25279 external_mini_cluster.cc:1428] Setting key 0c8c4b1172a29be75a2143eb8a44ba73
I20260811 16:38:06.051290 6007 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 045a6bde55b842b1a1bcede4c5b07c0c: Bootstrap starting.
I20260811 16:38:06.052026 6007 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 045a6bde55b842b1a1bcede4c5b07c0c: Neither blocks nor log segments found. Creating new log.
I20260811 16:38:06.052349 6007 log.cc:824] T 00000000000000000000000000000000 P 045a6bde55b842b1a1bcede4c5b07c0c: Log is configured to *not* fsync() on all Append() calls
I20260811 16:38:06.052989 6007 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 045a6bde55b842b1a1bcede4c5b07c0c: No bootstrap required, opened a new log
I20260811 16:38:06.055214 6007 raft_consensus.cc:348] T 00000000000000000000000000000000 P 045a6bde55b842b1a1bcede4c5b07c0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "045a6bde55b842b1a1bcede4c5b07c0c" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 33029 } }
I20260811 16:38:06.055409 6007 raft_consensus.cc:374] T 00000000000000000000000000000000 P 045a6bde55b842b1a1bcede4c5b07c0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:38:06.055441 6007 raft_consensus.cc:729] T 00000000000000000000000000000000 P 045a6bde55b842b1a1bcede4c5b07c0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 045a6bde55b842b1a1bcede4c5b07c0c, State: Initialized, Role: FOLLOWER
I20260811 16:38:06.055589 6007 consensus_queue.cc:260] T 00000000000000000000000000000000 P 045a6bde55b842b1a1bcede4c5b07c0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "045a6bde55b842b1a1bcede4c5b07c0c" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 33029 } }
I20260811 16:38:06.055670 6007 raft_consensus.cc:388] T 00000000000000000000000000000000 P 045a6bde55b842b1a1bcede4c5b07c0c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:38:06.055706 6007 raft_consensus.cc:482] T 00000000000000000000000000000000 P 045a6bde55b842b1a1bcede4c5b07c0c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:38:06.055749 6007 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 045a6bde55b842b1a1bcede4c5b07c0c [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:38:06.056277 6007 raft_consensus.cc:504] T 00000000000000000000000000000000 P 045a6bde55b842b1a1bcede4c5b07c0c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "045a6bde55b842b1a1bcede4c5b07c0c" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 33029 } }
I20260811 16:38:06.056380 6007 leader_election.cc:302] T 00000000000000000000000000000000 P 045a6bde55b842b1a1bcede4c5b07c0c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 045a6bde55b842b1a1bcede4c5b07c0c; no voters:
I20260811 16:38:06.056550 6007 leader_election.cc:288] T 00000000000000000000000000000000 P 045a6bde55b842b1a1bcede4c5b07c0c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:38:06.056594 6020 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 045a6bde55b842b1a1bcede4c5b07c0c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:38:06.056775 6020 raft_consensus.cc:686] T 00000000000000000000000000000000 P 045a6bde55b842b1a1bcede4c5b07c0c [term 1 LEADER]: Becoming Leader. State: Replica: 045a6bde55b842b1a1bcede4c5b07c0c, State: Running, Role: LEADER
I20260811 16:38:06.056821 6007 sys_catalog.cc:564] T 00000000000000000000000000000000 P 045a6bde55b842b1a1bcede4c5b07c0c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:38:06.056929 6020 consensus_queue.cc:237] T 00000000000000000000000000000000 P 045a6bde55b842b1a1bcede4c5b07c0c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "045a6bde55b842b1a1bcede4c5b07c0c" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 33029 } }
Aug 11 16:38:06 dist-test-slave-zj8q krb5kdc[5849](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466285, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM
I20260811 16:38:06.057317 6021 sys_catalog.cc:455] T 00000000000000000000000000000000 P 045a6bde55b842b1a1bcede4c5b07c0c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "045a6bde55b842b1a1bcede4c5b07c0c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "045a6bde55b842b1a1bcede4c5b07c0c" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 33029 } } }
I20260811 16:38:06.057392 6021 sys_catalog.cc:458] T 00000000000000000000000000000000 P 045a6bde55b842b1a1bcede4c5b07c0c [sys.catalog]: This master's current role is: LEADER
I20260811 16:38:06.057606 6026 sys_catalog.cc:455] T 00000000000000000000000000000000 P 045a6bde55b842b1a1bcede4c5b07c0c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 045a6bde55b842b1a1bcede4c5b07c0c. Latest consensus state: current_term: 1 leader_uuid: "045a6bde55b842b1a1bcede4c5b07c0c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "045a6bde55b842b1a1bcede4c5b07c0c" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 33029 } } }
I20260811 16:38:06.057924 6026 sys_catalog.cc:458] T 00000000000000000000000000000000 P 045a6bde55b842b1a1bcede4c5b07c0c [sys.catalog]: This master's current role is: LEADER
I20260811 16:38:06.058063 6031 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:38:06.058578 6031 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:38:06.060269 6031 catalog_manager.cc:1347] Generated new cluster ID: e5f35e4793b14a8d84e9a69e1f0defaa
I20260811 16:38:06.060314 6031 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:38:06.061497 6016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:06.051085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57854 (local address 127.24.175.254:33029)
0811 16:38:06.051302 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:06.051312 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:06.051345 (+ 33us) server_negotiation.cc:407] Connection header received
0811 16:38:06.051895 (+ 550us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:06.051903 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:06.051965 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:06.052119 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:06.052725 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:06.053622 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:06.054685 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:06.055072 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:06.055146 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:06.057765 (+ 2619us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:38:06.057771 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:38:06.057771 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:38:06.057783 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:38:06.059872 (+ 2089us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:06.060219 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:06.060222 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:06.060223 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:06.060334 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:06.060570 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:06.060570 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:06.060571 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:06.060867 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:38:06.061015 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:06.061155 (+ 140us) server_negotiation.cc:299] Negotiation successful
0811 16:38:06.061299 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":117,"threads_started":1}
I20260811 16:38:06.074942 6031 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:38:06.075420 6031 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:38:06.086766 6031 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 045a6bde55b842b1a1bcede4c5b07c0c: Generated new TSK 0
I20260811 16:38:06.086933 6031 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.24.175.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.24.175.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.24.175.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/krb5kdc/oryx_127.24.175.193.keytab.
Entry for principal oryx/127.24.175.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/krb5kdc/oryx_127.24.175.193.keytab.
I20260811 16:38:06.117887 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.193:0
--local_ip_for_outbound_sockets=127.24.175.193
--webserver_interface=127.24.175.193
--webserver_port=0
--tserver_master_addrs=127.24.175.254:33029
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/krb5kdc/oryx_127.24.175.193.keytab
--principal=oryx/127.24.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:37151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:38:06.197606 6061 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:38:06.197813 6061 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:38:06.197844 6061 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:38:06.198972 6061 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:38:06.199010 6061 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:38:06.199038 6061 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 16:38:06.199059 6061 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.193
I20260811 16:38:06.200525 6061 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:37151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/krb5kdc/oryx_127.24.175.193.keytab
--principal=oryx/127.24.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.175.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.24.175.254:33029
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6061
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.193
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:38:06.200762 6061 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:38:06.200970 6061 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:38:06.205893 6072 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:38:06.205919 6070 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:38:06.205940 6075 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:38:06.205976 6061 server_base.cc:1034] running on GCE node
I20260811 16:38:06.206290 6061 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:38:06.206490 6061 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:38:06.207613 6061 hybrid_clock.cc:648] HybridClock initialized: now 1786466286207608 us; error 31 us; skew 500 ppm
Aug 11 16:38:06 dist-test-slave-zj8q krb5kdc[5849](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466286, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:38:06.209941 6061 init.cc:377] Logged in from keytab as oryx/127.24.175.193@KRBTEST.COM (short username oryx)
I20260811 16:38:06.210372 6061 webserver.cc:460] Webserver started at http://127.24.175.193:37895/ using document root <none> and password file <none>
I20260811 16:38:06.210572 6061 fs_manager.cc:359] Metadata directory not provided
I20260811 16:38:06.210626 6061 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:38:06.210741 6061 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:38:06.211714 6061 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/ts-0/data/instance:
uuid: "102e06f64abc4aa591d0697dce17c37d"
format_stamp: "Formatted at 2026-08-11 16:38:06 on dist-test-slave-zj8q"
server_key: "7b6474368df3511b0f3b4b46005ca7ea"
server_key_iv: "b1537c759737c0b23002220148579a5b"
server_key_version: "encryptionkey@0"
I20260811 16:38:06.212023 6061 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/ts-0/wal/instance:
uuid: "102e06f64abc4aa591d0697dce17c37d"
format_stamp: "Formatted at 2026-08-11 16:38:06 on dist-test-slave-zj8q"
server_key: "7b6474368df3511b0f3b4b46005ca7ea"
server_key_iv: "b1537c759737c0b23002220148579a5b"
server_key_version: "encryptionkey@0"
I20260811 16:38:06.213227 6061 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:38:06.213836 6091 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:06.213969 6061 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:38:06.214053 6061 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/ts-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/ts-0/wal
uuid: "102e06f64abc4aa591d0697dce17c37d"
format_stamp: "Formatted at 2026-08-11 16:38:06 on dist-test-slave-zj8q"
server_key: "7b6474368df3511b0f3b4b46005ca7ea"
server_key_iv: "b1537c759737c0b23002220148579a5b"
server_key_version: "encryptionkey@0"
I20260811 16:38:06.214111 6061 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:38:06.255532 6061 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:38:06.257804 6061 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:38:06.257943 6061 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:38:06.258488 6061 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:38:06.258533 6061 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:06.258561 6061 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:38:06.258634 6061 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 16:38:06 dist-test-slave-zj8q krb5kdc[5849](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466286, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.175.193@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM
I20260811 16:38:06.265617 6061 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.193:39861
I20260811 16:38:06.265677 6292 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.193:39861 every 8 connection(s)
I20260811 16:38:06.266008 6061 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
I20260811 16:38:06.268110 6016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:06.258968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:43597 (local address 127.24.175.254:33029)
0811 16:38:06.259024 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:06.259027 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:06.259229 (+ 202us) server_negotiation.cc:407] Connection header received
0811 16:38:06.259725 (+ 496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:06.259726 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:06.259740 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:06.259814 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:06.260631 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:06.261518 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:06.262699 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:06.262919 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:06.262987 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:06.265723 (+ 2736us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:38:06.265725 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:38:06.265725 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:38:06.265733 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:38:06.267028 (+ 1295us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:06.267374 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:06.267375 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:06.267376 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:06.267429 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:06.267600 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:06.267600 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:06.267600 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:06.267697 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:38:06.267745 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:06.267942 (+ 197us) server_negotiation.cc:299] Negotiation successful
0811 16:38:06.268014 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 16:38:06.268234 6103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:06.258936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:33029 (local address 127.24.175.193:43597)
0811 16:38:06.259101 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:06.259142 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:06.259631 (+ 489us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:06.259900 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:06.259905 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:06.260237 (+ 332us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:06.260532 (+ 295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:06.260539 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:06.261622 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:06.261623 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:06.262606 (+ 983us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:06.262609 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:06.263009 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:06.263010 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:06.263186 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:06.263729 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:06.263739 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:06.265642 (+ 1903us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:38:06.267107 (+ 1465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:06.267112 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:06.267114 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:06.267317 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:06.267476 (+ 159us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:06.267477 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:06.267477 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:06.267559 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:06.267740 (+ 181us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:38:06.267743 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:38:06.267852 (+ 109us) client_negotiation.cc:769] Sending connection context
0811 16:38:06.267927 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 16:38:06.268063 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":85,"threads_started":1}
I20260811 16:38:06.268683 6296 heartbeater.cc:347] Connected to a master server at 127.24.175.254:33029
I20260811 16:38:06.268761 6296 heartbeater.cc:464] Registering TS with master...
I20260811 16:38:06.268931 6296 heartbeater.cc:511] Master 127.24.175.254:33029 requested a full tablet report, sending...
I20260811 16:38:06.269451 5927 ts_manager.cc:194] Registered new tserver with Master: 102e06f64abc4aa591d0697dce17c37d (127.24.175.193:39861)
I20260811 16:38:06.270080 5927 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.24.175.193@KRBTEST.COM'} at 127.24.175.193:43597
I20260811 16:38:06.273182 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 6061
I20260811 16:38:06.273280 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/ts-0/wal/instance
I20260811 16:38:06.273504 25279 external_mini_cluster.cc:1428] Setting key 514e5e1ca7d97b312511616c2a768dc0
I20260811 16:38:06.274809 6303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:06.269622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:33029 (local address 127.24.175.193:37111)
0811 16:38:06.269768 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:06.269777 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:06.269828 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:06.269934 (+ 106us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:06.269935 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:06.270116 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:06.270185 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:06.270187 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:06.271012 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:06.271013 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:06.271518 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:06.271519 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:06.271836 (+ 317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:06.271837 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:06.271884 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:06.272196 (+ 312us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:06.272200 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:06.272447 (+ 247us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:38:06.273902 (+ 1455us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:06.273903 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:06.273903 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:06.274057 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:06.274247 (+ 190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:06.274248 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:06.274248 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:06.274310 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:06.274515 (+ 205us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:38:06.274516 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:38:06.274560 (+ 44us) client_negotiation.cc:769] Sending connection context
0811 16:38:06.274620 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 16:38:06.274717 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":74,"threads_started":1}
I20260811 16:38:06.274808 6016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:06.269677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:37111 (local address 127.24.175.254:33029)
0811 16:38:06.269715 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:06.269717 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:06.269830 (+ 113us) server_negotiation.cc:407] Connection header received
0811 16:38:06.269879 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:06.269880 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:06.269889 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:06.269932 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:06.270250 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:06.270919 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:06.271611 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:06.271786 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:06.271830 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:06.272510 (+ 680us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:38:06.272511 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:38:06.272511 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:38:06.272516 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:38:06.273833 (+ 1317us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:06.274115 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:06.274115 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:06.274116 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:06.274189 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:06.274362 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:06.274363 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:06.274363 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:06.274461 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:38:06.274515 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:06.274650 (+ 135us) server_negotiation.cc:299] Negotiation successful
0811 16:38:06.274715 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
WARNING: no policy specified for oryx/127.24.175.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.24.175.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.24.175.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/krb5kdc/oryx_127.24.175.194.keytab.
Entry for principal oryx/127.24.175.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/krb5kdc/oryx_127.24.175.194.keytab.
I20260811 16:38:06.296550 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.194:0
--local_ip_for_outbound_sockets=127.24.175.194
--webserver_interface=127.24.175.194
--webserver_port=0
--tserver_master_addrs=127.24.175.254:33029
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/krb5kdc/oryx_127.24.175.194.keytab
--principal=oryx/127.24.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:37151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:38:06.376900 6307 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:38:06.377094 6307 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:38:06.377115 6307 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:38:06.378233 6307 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:38:06.378266 6307 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:38:06.378286 6307 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 16:38:06.378301 6307 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.194
I20260811 16:38:06.379743 6307 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:37151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/krb5kdc/oryx_127.24.175.194.keytab
--principal=oryx/127.24.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.175.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.24.175.254:33029
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6307
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.194
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:38:06.379925 6307 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:38:06.380092 6307 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:38:06.385013 6325 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:38:06.385046 6313 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:38:06.385013 6317 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:38:06.385085 6307 server_base.cc:1034] running on GCE node
I20260811 16:38:06.385407 6307 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:38:06.385655 6307 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:38:06.386790 6307 hybrid_clock.cc:648] HybridClock initialized: now 1786466286386774 us; error 30 us; skew 500 ppm
Aug 11 16:38:06 dist-test-slave-zj8q krb5kdc[5849](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466286, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:38:06.389207 6307 init.cc:377] Logged in from keytab as oryx/127.24.175.194@KRBTEST.COM (short username oryx)
I20260811 16:38:06.389618 6307 webserver.cc:460] Webserver started at http://127.24.175.194:37987/ using document root <none> and password file <none>
I20260811 16:38:06.389819 6307 fs_manager.cc:359] Metadata directory not provided
I20260811 16:38:06.389866 6307 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:38:06.389986 6307 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:38:06.391010 6307 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/ts-1/data/instance:
uuid: "ae5214c78bc64887ad236150e281400b"
format_stamp: "Formatted at 2026-08-11 16:38:06 on dist-test-slave-zj8q"
server_key: "36ac8d4bf1a68b61170883b0ae523d53"
server_key_iv: "e825b6b8fd5de35fe779cb15813430c7"
server_key_version: "encryptionkey@0"
I20260811 16:38:06.391345 6307 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/ts-1/wal/instance:
uuid: "ae5214c78bc64887ad236150e281400b"
format_stamp: "Formatted at 2026-08-11 16:38:06 on dist-test-slave-zj8q"
server_key: "36ac8d4bf1a68b61170883b0ae523d53"
server_key_iv: "e825b6b8fd5de35fe779cb15813430c7"
server_key_version: "encryptionkey@0"
I20260811 16:38:06.392550 6307 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:38:06.393271 6336 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:06.393416 6307 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:38:06.393501 6307 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/ts-1/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/ts-1/wal
uuid: "ae5214c78bc64887ad236150e281400b"
format_stamp: "Formatted at 2026-08-11 16:38:06 on dist-test-slave-zj8q"
server_key: "36ac8d4bf1a68b61170883b0ae523d53"
server_key_iv: "e825b6b8fd5de35fe779cb15813430c7"
server_key_version: "encryptionkey@0"
I20260811 16:38:06.393566 6307 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:38:06.408560 6307 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:38:06.410321 6307 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:38:06.410449 6307 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:38:06.410974 6307 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:38:06.411023 6307 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:06.411051 6307 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:38:06.411077 6307 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 16:38:06 dist-test-slave-zj8q krb5kdc[5849](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466286, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.175.194@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM
I20260811 16:38:06.417654 6307 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.194:40049
I20260811 16:38:06.417762 6550 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.194:40049 every 8 connection(s)
I20260811 16:38:06.418066 6307 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
I20260811 16:38:06.420135 6356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:06.411343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:33029 (local address 127.24.175.194:51633)
0811 16:38:06.411477 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:06.411511 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:06.412002 (+ 491us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:06.412258 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:06.412261 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:06.412556 (+ 295us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:06.412741 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:06.412746 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:06.413433 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:06.413434 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:06.414543 (+ 1109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:06.414545 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:06.414920 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:06.414922 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:06.415047 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:06.415509 (+ 462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:06.415519 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:06.417228 (+ 1709us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:38:06.418877 (+ 1649us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:06.418881 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:06.418883 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:06.419227 (+ 344us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:06.419404 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:06.419404 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:06.419404 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:06.419495 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:06.419680 (+ 185us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:38:06.419683 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:38:06.419794 (+ 111us) client_negotiation.cc:769] Sending connection context
0811 16:38:06.419869 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 16:38:06.419983 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":74,"threads_started":1}
I20260811 16:38:06.420159 6016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:06.411355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:51633 (local address 127.24.175.254:33029)
0811 16:38:06.411397 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:06.411399 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:06.411592 (+ 193us) server_negotiation.cc:407] Connection header received
0811 16:38:06.412118 (+ 526us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:06.412120 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:06.412133 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:06.412180 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:06.412836 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:06.413351 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:06.414628 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:06.414837 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:06.414894 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:06.417316 (+ 2422us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:38:06.417318 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:38:06.417318 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:38:06.417326 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:38:06.418806 (+ 1480us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:06.419296 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:06.419296 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:06.419297 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:06.419354 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:06.419537 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:06.419537 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:06.419537 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:06.419634 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:38:06.419684 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:06.419889 (+ 205us) server_negotiation.cc:299] Negotiation successful
0811 16:38:06.420095 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 16:38:06.420797 6551 heartbeater.cc:347] Connected to a master server at 127.24.175.254:33029
I20260811 16:38:06.420882 6551 heartbeater.cc:464] Registering TS with master...
I20260811 16:38:06.420883 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 6307
I20260811 16:38:06.420986 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/ts-1/wal/instance
I20260811 16:38:06.421094 6551 heartbeater.cc:511] Master 127.24.175.254:33029 requested a full tablet report, sending...
I20260811 16:38:06.421187 25279 external_mini_cluster.cc:1428] Setting key 1c86a761db8ca14b3d22a99a84781779
I20260811 16:38:06.421449 5928 ts_manager.cc:194] Registered new tserver with Master: ae5214c78bc64887ad236150e281400b (127.24.175.194:40049)
I20260811 16:38:06.421926 5928 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.24.175.194@KRBTEST.COM'} at 127.24.175.194:51633
I20260811 16:38:06.427675 6564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:06.421845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:33029 (local address 127.24.175.194:58135)
0811 16:38:06.421991 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:06.422002 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:06.422051 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:06.422440 (+ 389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:06.422441 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:06.422647 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:06.422706 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:06.422708 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:06.423325 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:06.423325 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:06.423944 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:06.423946 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:06.424376 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:06.424376 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:06.424416 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:06.424771 (+ 355us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:06.424775 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:06.425019 (+ 244us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:38:06.426702 (+ 1683us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:06.426703 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:06.426704 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:06.426876 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:06.427070 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:06.427070 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:06.427071 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:06.427120 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:06.427453 (+ 333us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:38:06.427453 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:38:06.427489 (+ 36us) client_negotiation.cc:769] Sending connection context
0811 16:38:06.427545 (+ 56us) client_negotiation.cc:240] Negotiation successful
0811 16:38:06.427616 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":70,"threads_started":1}
I20260811 16:38:06.427747 6016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:06.422275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:58135 (local address 127.24.175.254:33029)
0811 16:38:06.422327 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:06.422329 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:06.422336 (+ 7us) server_negotiation.cc:407] Connection header received
0811 16:38:06.422356 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:06.422357 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:06.422366 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:06.422420 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:06.422784 (+ 364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:06.423233 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:06.424015 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:06.424307 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:06.424369 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:06.425107 (+ 738us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:38:06.425109 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:38:06.425109 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:38:06.425116 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:38:06.426612 (+ 1496us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:06.426935 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:06.426936 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:06.426937 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:06.426999 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:06.427173 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:06.427174 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:06.427174 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:06.427367 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:38:06.427447 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:06.427584 (+ 137us) server_negotiation.cc:299] Negotiation successful
0811 16:38:06.427662 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
WARNING: no policy specified for oryx/127.24.175.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.24.175.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.24.175.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/krb5kdc/oryx_127.24.175.195.keytab.
Entry for principal oryx/127.24.175.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/krb5kdc/oryx_127.24.175.195.keytab.
I20260811 16:38:06.448127 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.195:0
--local_ip_for_outbound_sockets=127.24.175.195
--webserver_interface=127.24.175.195
--webserver_port=0
--tserver_master_addrs=127.24.175.254:33029
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/krb5kdc/oryx_127.24.175.195.keytab
--principal=oryx/127.24.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:37151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:38:06.530572 6572 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:38:06.530759 6572 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:38:06.530781 6572 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:38:06.531870 6572 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:38:06.531903 6572 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:38:06.531922 6572 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 16:38:06.531937 6572 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.195
I20260811 16:38:06.533373 6572 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:37151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/krb5kdc/oryx_127.24.175.195.keytab
--principal=oryx/127.24.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.175.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.24.175.254:33029
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6572
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.195
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:38:06.533555 6572 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:38:06.533725 6572 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:38:06.538528 6578 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:38:06.538583 6582 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:38:06.538671 6572 server_base.cc:1034] running on GCE node
W20260811 16:38:06.538551 6579 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:38:06.538981 6572 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:38:06.539228 6572 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:38:06.540369 6572 hybrid_clock.cc:648] HybridClock initialized: now 1786466286540355 us; error 29 us; skew 500 ppm
Aug 11 16:38:06 dist-test-slave-zj8q krb5kdc[5849](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466286, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:38:06.542732 6572 init.cc:377] Logged in from keytab as oryx/127.24.175.195@KRBTEST.COM (short username oryx)
I20260811 16:38:06.543177 6572 webserver.cc:460] Webserver started at http://127.24.175.195:43075/ using document root <none> and password file <none>
I20260811 16:38:06.543368 6572 fs_manager.cc:359] Metadata directory not provided
I20260811 16:38:06.543416 6572 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:38:06.543540 6572 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:38:06.544500 6572 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/ts-2/data/instance:
uuid: "6ba51a559bd64e4b95ac7a31b675868d"
format_stamp: "Formatted at 2026-08-11 16:38:06 on dist-test-slave-zj8q"
server_key: "4657a9feab04a94313022190c319d741"
server_key_iv: "ea0a05f11b34a7aacab92ebc939d898b"
server_key_version: "encryptionkey@0"
I20260811 16:38:06.544828 6572 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/ts-2/wal/instance:
uuid: "6ba51a559bd64e4b95ac7a31b675868d"
format_stamp: "Formatted at 2026-08-11 16:38:06 on dist-test-slave-zj8q"
server_key: "4657a9feab04a94313022190c319d741"
server_key_iv: "ea0a05f11b34a7aacab92ebc939d898b"
server_key_version: "encryptionkey@0"
I20260811 16:38:06.546053 6572 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:38:06.546763 6594 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:06.546916 6572 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:06.547001 6572 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/ts-2/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/ts-2/wal
uuid: "6ba51a559bd64e4b95ac7a31b675868d"
format_stamp: "Formatted at 2026-08-11 16:38:06 on dist-test-slave-zj8q"
server_key: "4657a9feab04a94313022190c319d741"
server_key_iv: "ea0a05f11b34a7aacab92ebc939d898b"
server_key_version: "encryptionkey@0"
I20260811 16:38:06.547080 6572 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:38:06.557156 6572 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:38:06.559113 6572 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:38:06.559218 6572 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:38:06.559655 6572 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:38:06.559695 6572 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:06.559715 6572 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:38:06.559728 6572 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 16:38:06 dist-test-slave-zj8q krb5kdc[5849](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466286, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.175.195@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM
I20260811 16:38:06.566344 6572 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.195:39585
I20260811 16:38:06.566416 6791 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.195:39585 every 8 connection(s)
I20260811 16:38:06.566742 6572 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
I20260811 16:38:06.568976 6016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:06.560080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.195:42199 (local address 127.24.175.254:33029)
0811 16:38:06.560145 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:06.560148 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:06.560326 (+ 178us) server_negotiation.cc:407] Connection header received
0811 16:38:06.560771 (+ 445us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:06.560773 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:06.560785 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:06.560855 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:06.561631 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:06.562368 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:06.563405 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:06.563613 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:06.563669 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:06.566295 (+ 2626us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:38:06.566296 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:38:06.566297 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:38:06.566305 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:38:06.567644 (+ 1339us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:06.568007 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:06.568008 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:06.568009 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:06.568084 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:06.568303 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:06.568305 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:06.568305 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:06.568437 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:38:06.568501 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:06.568829 (+ 328us) server_negotiation.cc:299] Negotiation successful
0811 16:38:06.568912 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 16:38:06.569075 6609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:06.560045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:33029 (local address 127.24.175.195:42199)
0811 16:38:06.560210 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:06.560249 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:06.560689 (+ 440us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:06.560924 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:06.560928 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:06.561269 (+ 341us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:06.561542 (+ 273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:06.561548 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:06.562460 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:06.562462 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:06.563327 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:06.563330 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:06.563695 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:06.563696 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:06.563818 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:06.564285 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:06.564293 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:06.566183 (+ 1890us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:38:06.567710 (+ 1527us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:06.567714 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:06.567716 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:06.567945 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:06.568132 (+ 187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:06.568133 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:06.568133 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:06.568221 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:06.568526 (+ 305us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:38:06.568532 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:38:06.568662 (+ 130us) client_negotiation.cc:769] Sending connection context
0811 16:38:06.568755 (+ 93us) client_negotiation.cc:240] Negotiation successful
0811 16:38:06.568905 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":82,"threads_started":1}
I20260811 16:38:06.569525 6793 heartbeater.cc:347] Connected to a master server at 127.24.175.254:33029
I20260811 16:38:06.569619 6793 heartbeater.cc:464] Registering TS with master...
I20260811 16:38:06.569808 6793 heartbeater.cc:511] Master 127.24.175.254:33029 requested a full tablet report, sending...
I20260811 16:38:06.570292 5927 ts_manager.cc:194] Registered new tserver with Master: 6ba51a559bd64e4b95ac7a31b675868d (127.24.175.195:39585)
I20260811 16:38:06.570744 5927 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.24.175.195@KRBTEST.COM'} at 127.24.175.195:42199
I20260811 16:38:06.573405 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 6572
I20260811 16:38:06.573499 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/ts-2/wal/instance
I20260811 16:38:06.573709 25279 external_mini_cluster.cc:1428] Setting key 6c7d83d4812e836939280bbae933fd6b
I20260811 16:38:06.574486 25279 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 16:38:06.575485 6016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:06.570610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.195:52447 (local address 127.24.175.254:33029)
0811 16:38:06.570649 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:06.570651 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:06.570711 (+ 60us) server_negotiation.cc:407] Connection header received
0811 16:38:06.570767 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:06.570768 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:06.570776 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:06.570819 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:06.571164 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:06.571606 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:06.572231 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:06.572398 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:06.572438 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:06.573134 (+ 696us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:38:06.573135 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:38:06.573136 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:38:06.573141 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:38:06.574447 (+ 1306us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:06.574767 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:06.574768 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:06.574769 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:06.574824 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:06.575021 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:06.575022 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:06.575022 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:06.575131 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:38:06.575191 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:06.575329 (+ 138us) server_negotiation.cc:299] Negotiation successful
0811 16:38:06.575396 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 16:38:06.575501 6802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:06.570530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:33029 (local address 127.24.175.195:52447)
0811 16:38:06.570659 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:06.570669 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:06.570726 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:06.570821 (+ 95us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:06.570822 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:06.571002 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:06.571081 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:06.571084 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:06.571688 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:06.571689 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:06.572175 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:06.572176 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:06.572442 (+ 266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:06.572443 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:06.572485 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:06.572802 (+ 317us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:06.572805 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:06.573070 (+ 265us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:38:06.574516 (+ 1446us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:06.574517 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:06.574518 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:06.574704 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:06.574875 (+ 171us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:06.574876 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:06.574876 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:06.574934 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:06.575191 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:38:06.575191 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:38:06.575237 (+ 46us) client_negotiation.cc:769] Sending connection context
0811 16:38:06.575296 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 16:38:06.575398 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":72,"threads_started":1}
Aug 11 16:38:06 dist-test-slave-zj8q krb5kdc[5849](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466286, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 16:38:06 dist-test-slave-zj8q krb5kdc[5849](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:38:06 dist-test-slave-zj8q krb5kdc[5849](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
W20260811 16:38:06.595767 6016 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:38:06.591066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57862 (local address 127.24.175.254:33029)
0811 16:38:06.591122 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:06.591124 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:06.591145 (+ 21us) server_negotiation.cc:407] Connection header received
0811 16:38:06.591164 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:06.591164 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:06.591173 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:06.591210 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:06.591713 (+ 503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:06.592191 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:06.592864 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:06.593032 (+ 168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:06.593084 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:06.595707 (+ 2623us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57862: BlockingRecv error: recv got EOF from 127.0.0.1:57862 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Aug 11 16:38:06 dist-test-slave-zj8q krb5kdc[5849](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466286, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM
I20260811 16:38:06.602016 6016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:06.596456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57866 (local address 127.24.175.254:33029)
0811 16:38:06.596514 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:06.596516 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:06.596562 (+ 46us) server_negotiation.cc:407] Connection header received
0811 16:38:06.596616 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:06.596617 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:06.596626 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:06.596678 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:06.597068 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:06.597560 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:06.598211 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:06.598390 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:06.598435 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:06.600222 (+ 1787us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:38:06.600224 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:38:06.600229 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:38:06.600235 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:38:06.601258 (+ 1023us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:06.601528 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:06.601529 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:06.601529 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:06.601570 (+ 41us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:06.601692 (+ 122us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:06.601692 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:06.601692 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:06.601775 (+ 83us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:38:06.601840 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:06.601906 (+ 66us) server_negotiation.cc:299] Negotiation successful
0811 16:38:06.601956 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 16:38:06.603526 5927 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57866:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:38:06.605181 5927 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:38:06.611558 6823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:06.607282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.195:39585 (local address 127.0.0.1:58562)
0811 16:38:06.607792 (+ 510us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:06.607800 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:06.607848 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:06.608008 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:06.608011 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:06.608013 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:38:06.608084 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:06.608085 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:06.609114 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:06.609115 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:06.610390 (+ 1275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:06.610394 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:06.611260 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:06.611260 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:06.611312 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:06.611329 (+ 17us) client_negotiation.cc:769] Sending connection context
0811 16:38:06.611400 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 16:38:06.611465 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":491,"mutex_wait_us":34,"thread_start_us":73,"threads_started":1}
I20260811 16:38:06.611568 6825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:06.607438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34386 (local address 127.24.175.194:40049)
0811 16:38:06.607941 (+ 503us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:06.607944 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:06.607952 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:38:06.607988 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:06.607990 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:06.608005 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:06.608082 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:38:06.608223 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:06.609278 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:06.610512 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:06.611045 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:06.611126 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:06.611182 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:06.611427 (+ 245us) server_negotiation.cc:299] Negotiation successful
0811 16:38:06.611471 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":475,"thread_start_us":80,"threads_started":1}
I20260811 16:38:06.611768 6826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:06.607470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.193:39861 (local address 127.0.0.1:56256)
0811 16:38:06.608167 (+ 697us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:06.608177 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:06.608224 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:06.608464 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:06.608464 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:06.608466 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:38:06.608501 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:06.608502 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:06.609623 (+ 1121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:06.609624 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:06.610546 (+ 922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:06.610549 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:06.611530 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:06.611532 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:06.611599 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:06.611603 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:38:06.611662 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 16:38:06.611702 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":676,"thread_start_us":65,"threads_started":1}
I20260811 16:38:06.611812 6829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:06.607615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58562 (local address 127.24.175.195:39585)
0811 16:38:06.607785 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:06.607789 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:06.607841 (+ 52us) server_negotiation.cc:407] Connection header received
0811 16:38:06.607899 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:06.607901 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:06.607913 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:06.607976 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:38:06.608185 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:06.609046 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:06.610463 (+ 1417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:06.611183 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:06.611274 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:06.611326 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:06.611679 (+ 353us) server_negotiation.cc:299] Negotiation successful
0811 16:38:06.611721 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":85,"threads_started":1}
I20260811 16:38:06.611557 6822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:06.607270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.194:40049 (local address 127.0.0.1:34386)
0811 16:38:06.607389 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:06.607427 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:06.607486 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:06.608080 (+ 594us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:06.608081 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:06.608083 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:38:06.608135 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:06.608136 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:06.609363 (+ 1227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:06.609363 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:06.610431 (+ 1068us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:06.610433 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:06.611212 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:06.611213 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:06.611312 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:06.611329 (+ 17us) client_negotiation.cc:769] Sending connection context
0811 16:38:06.611396 (+ 67us) client_negotiation.cc:240] Negotiation successful
0811 16:38:06.611465 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":94,"mutex_wait_us":21,"thread_start_us":45,"threads_started":1}
I20260811 16:38:06.612131 6827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:06.607585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56256 (local address 127.24.175.193:39861)
0811 16:38:06.607765 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:06.607769 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:06.608275 (+ 506us) server_negotiation.cc:407] Connection header received
0811 16:38:06.608317 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:06.608319 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:06.608334 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:06.608400 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:38:06.608579 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:06.609554 (+ 975us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:06.610630 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:06.611364 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:06.611444 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:06.611493 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:06.611989 (+ 496us) server_negotiation.cc:299] Negotiation successful
0811 16:38:06.612035 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":82,"threads_started":1}
I20260811 16:38:06.612483 6671 tablet_service.cc:1467] Processing CreateTablet for tablet 462f6b7de3334b22b57469725a9ff571 (DEFAULT_TABLE table=test-table [id=ea54ca15705141b28c84124999468c05]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:38:06.612679 6430 tablet_service.cc:1467] Processing CreateTablet for tablet 462f6b7de3334b22b57469725a9ff571 (DEFAULT_TABLE table=test-table [id=ea54ca15705141b28c84124999468c05]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:38:06.612720 6174 tablet_service.cc:1467] Processing CreateTablet for tablet 462f6b7de3334b22b57469725a9ff571 (DEFAULT_TABLE table=test-table [id=ea54ca15705141b28c84124999468c05]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:38:06.612849 6671 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 462f6b7de3334b22b57469725a9ff571. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:38:06.613027 6174 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 462f6b7de3334b22b57469725a9ff571. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:38:06.613027 6430 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 462f6b7de3334b22b57469725a9ff571. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:38:06.615644 6830 tablet_bootstrap.cc:492] T 462f6b7de3334b22b57469725a9ff571 P 6ba51a559bd64e4b95ac7a31b675868d: Bootstrap starting.
I20260811 16:38:06.616293 6830 tablet_bootstrap.cc:654] T 462f6b7de3334b22b57469725a9ff571 P 6ba51a559bd64e4b95ac7a31b675868d: Neither blocks nor log segments found. Creating new log.
I20260811 16:38:06.616572 6832 tablet_bootstrap.cc:492] T 462f6b7de3334b22b57469725a9ff571 P ae5214c78bc64887ad236150e281400b: Bootstrap starting.
I20260811 16:38:06.616653 6830 log.cc:824] T 462f6b7de3334b22b57469725a9ff571 P 6ba51a559bd64e4b95ac7a31b675868d: Log is configured to *not* fsync() on all Append() calls
I20260811 16:38:06.617273 6832 tablet_bootstrap.cc:654] T 462f6b7de3334b22b57469725a9ff571 P ae5214c78bc64887ad236150e281400b: Neither blocks nor log segments found. Creating new log.
I20260811 16:38:06.617401 6830 tablet_bootstrap.cc:492] T 462f6b7de3334b22b57469725a9ff571 P 6ba51a559bd64e4b95ac7a31b675868d: No bootstrap required, opened a new log
I20260811 16:38:06.617470 6830 ts_tablet_manager.cc:1397] T 462f6b7de3334b22b57469725a9ff571 P 6ba51a559bd64e4b95ac7a31b675868d: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 16:38:06.617596 6832 log.cc:824] T 462f6b7de3334b22b57469725a9ff571 P ae5214c78bc64887ad236150e281400b: Log is configured to *not* fsync() on all Append() calls
I20260811 16:38:06.618378 6832 tablet_bootstrap.cc:492] T 462f6b7de3334b22b57469725a9ff571 P ae5214c78bc64887ad236150e281400b: No bootstrap required, opened a new log
I20260811 16:38:06.618392 6835 tablet_bootstrap.cc:492] T 462f6b7de3334b22b57469725a9ff571 P 102e06f64abc4aa591d0697dce17c37d: Bootstrap starting.
I20260811 16:38:06.618508 6832 ts_tablet_manager.cc:1397] T 462f6b7de3334b22b57469725a9ff571 P ae5214c78bc64887ad236150e281400b: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:38:06.618904 6835 tablet_bootstrap.cc:654] T 462f6b7de3334b22b57469725a9ff571 P 102e06f64abc4aa591d0697dce17c37d: Neither blocks nor log segments found. Creating new log.
I20260811 16:38:06.619174 6835 log.cc:824] T 462f6b7de3334b22b57469725a9ff571 P 102e06f64abc4aa591d0697dce17c37d: Log is configured to *not* fsync() on all Append() calls
I20260811 16:38:06.619386 6830 raft_consensus.cc:348] T 462f6b7de3334b22b57469725a9ff571 P 6ba51a559bd64e4b95ac7a31b675868d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae5214c78bc64887ad236150e281400b" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 40049 } } peers { permanent_uuid: "6ba51a559bd64e4b95ac7a31b675868d" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39585 } } peers { permanent_uuid: "102e06f64abc4aa591d0697dce17c37d" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39861 } }
I20260811 16:38:06.619556 6830 raft_consensus.cc:374] T 462f6b7de3334b22b57469725a9ff571 P 6ba51a559bd64e4b95ac7a31b675868d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:38:06.619598 6830 raft_consensus.cc:729] T 462f6b7de3334b22b57469725a9ff571 P 6ba51a559bd64e4b95ac7a31b675868d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba51a559bd64e4b95ac7a31b675868d, State: Initialized, Role: FOLLOWER
I20260811 16:38:06.619709 6830 consensus_queue.cc:260] T 462f6b7de3334b22b57469725a9ff571 P 6ba51a559bd64e4b95ac7a31b675868d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae5214c78bc64887ad236150e281400b" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 40049 } } peers { permanent_uuid: "6ba51a559bd64e4b95ac7a31b675868d" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39585 } } peers { permanent_uuid: "102e06f64abc4aa591d0697dce17c37d" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39861 } }
I20260811 16:38:06.619813 6835 tablet_bootstrap.cc:492] T 462f6b7de3334b22b57469725a9ff571 P 102e06f64abc4aa591d0697dce17c37d: No bootstrap required, opened a new log
I20260811 16:38:06.619858 6835 ts_tablet_manager.cc:1397] T 462f6b7de3334b22b57469725a9ff571 P 102e06f64abc4aa591d0697dce17c37d: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 16:38:06.619956 6830 ts_tablet_manager.cc:1428] T 462f6b7de3334b22b57469725a9ff571 P 6ba51a559bd64e4b95ac7a31b675868d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:38:06.620003 6793 heartbeater.cc:503] Master 127.24.175.254:33029 was elected leader, sending a full tablet report...
I20260811 16:38:06.620627 6832 raft_consensus.cc:348] T 462f6b7de3334b22b57469725a9ff571 P ae5214c78bc64887ad236150e281400b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae5214c78bc64887ad236150e281400b" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 40049 } } peers { permanent_uuid: "6ba51a559bd64e4b95ac7a31b675868d" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39585 } } peers { permanent_uuid: "102e06f64abc4aa591d0697dce17c37d" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39861 } }
I20260811 16:38:06.620854 6832 raft_consensus.cc:374] T 462f6b7de3334b22b57469725a9ff571 P ae5214c78bc64887ad236150e281400b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:38:06.620934 6832 raft_consensus.cc:729] T 462f6b7de3334b22b57469725a9ff571 P ae5214c78bc64887ad236150e281400b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae5214c78bc64887ad236150e281400b, State: Initialized, Role: FOLLOWER
I20260811 16:38:06.621073 6832 consensus_queue.cc:260] T 462f6b7de3334b22b57469725a9ff571 P ae5214c78bc64887ad236150e281400b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae5214c78bc64887ad236150e281400b" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 40049 } } peers { permanent_uuid: "6ba51a559bd64e4b95ac7a31b675868d" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39585 } } peers { permanent_uuid: "102e06f64abc4aa591d0697dce17c37d" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39861 } }
I20260811 16:38:06.621320 6832 ts_tablet_manager.cc:1428] T 462f6b7de3334b22b57469725a9ff571 P ae5214c78bc64887ad236150e281400b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260811 16:38:06.621366 6551 heartbeater.cc:503] Master 127.24.175.254:33029 was elected leader, sending a full tablet report...
I20260811 16:38:06.622102 6835 raft_consensus.cc:348] T 462f6b7de3334b22b57469725a9ff571 P 102e06f64abc4aa591d0697dce17c37d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae5214c78bc64887ad236150e281400b" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 40049 } } peers { permanent_uuid: "6ba51a559bd64e4b95ac7a31b675868d" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39585 } } peers { permanent_uuid: "102e06f64abc4aa591d0697dce17c37d" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39861 } }
I20260811 16:38:06.622277 6835 raft_consensus.cc:374] T 462f6b7de3334b22b57469725a9ff571 P 102e06f64abc4aa591d0697dce17c37d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:38:06.622314 6835 raft_consensus.cc:729] T 462f6b7de3334b22b57469725a9ff571 P 102e06f64abc4aa591d0697dce17c37d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 102e06f64abc4aa591d0697dce17c37d, State: Initialized, Role: FOLLOWER
I20260811 16:38:06.622421 6835 consensus_queue.cc:260] T 462f6b7de3334b22b57469725a9ff571 P 102e06f64abc4aa591d0697dce17c37d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae5214c78bc64887ad236150e281400b" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 40049 } } peers { permanent_uuid: "6ba51a559bd64e4b95ac7a31b675868d" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39585 } } peers { permanent_uuid: "102e06f64abc4aa591d0697dce17c37d" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39861 } }
I20260811 16:38:06.622642 6835 ts_tablet_manager.cc:1428] T 462f6b7de3334b22b57469725a9ff571 P 102e06f64abc4aa591d0697dce17c37d: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 16:38:06.622674 6296 heartbeater.cc:503] Master 127.24.175.254:33029 was elected leader, sending a full tablet report...
W20260811 16:38:06.668618 6554 tablet.cc:2369] T 462f6b7de3334b22b57469725a9ff571 P ae5214c78bc64887ad236150e281400b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 16:38:06.766765 6297 tablet.cc:2369] T 462f6b7de3334b22b57469725a9ff571 P 102e06f64abc4aa591d0697dce17c37d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:38:06.793694 6842 raft_consensus.cc:482] T 462f6b7de3334b22b57469725a9ff571 P ae5214c78bc64887ad236150e281400b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:38:06.793823 6842 raft_consensus.cc:504] T 462f6b7de3334b22b57469725a9ff571 P ae5214c78bc64887ad236150e281400b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae5214c78bc64887ad236150e281400b" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 40049 } } peers { permanent_uuid: "6ba51a559bd64e4b95ac7a31b675868d" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39585 } } peers { permanent_uuid: "102e06f64abc4aa591d0697dce17c37d" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39861 } }
I20260811 16:38:06.794230 6842 leader_election.cc:288] T 462f6b7de3334b22b57469725a9ff571 P ae5214c78bc64887ad236150e281400b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ba51a559bd64e4b95ac7a31b675868d (127.24.175.195:39585), 102e06f64abc4aa591d0697dce17c37d (127.24.175.193:39861)
I20260811 16:38:06.798008 6827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:06.794490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:40875 (local address 127.24.175.193:39861)
0811 16:38:06.794536 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:06.794538 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:06.794549 (+ 11us) server_negotiation.cc:407] Connection header received
0811 16:38:06.794584 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:06.794585 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:06.794595 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:06.794673 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:38:06.794834 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:06.795605 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:06.797095 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:06.797655 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:06.797724 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:06.797733 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:06.797922 (+ 189us) server_negotiation.cc:299] Negotiation successful
0811 16:38:06.797954 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 16:38:06.798058 6356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:06.794407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.193:39861 (local address 127.24.175.194:40875)
0811 16:38:06.794473 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:06.794486 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:06.794535 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:06.794685 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:06.794686 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:06.794688 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:38:06.794765 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:06.794767 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:06.795677 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:06.795678 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:06.796994 (+ 1316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:06.796997 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:06.797733 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:06.797734 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:06.797857 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:06.797861 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:38:06.797912 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 16:38:06.797963 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42,"mutex_wait_us":37}
I20260811 16:38:06.798300 6829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:06.794524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:48569 (local address 127.24.175.195:39585)
0811 16:38:06.794566 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:06.794568 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:06.794723 (+ 155us) server_negotiation.cc:407] Connection header received
0811 16:38:06.794772 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:06.794773 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:06.794781 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:06.794832 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:38:06.794940 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:06.795666 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:06.797074 (+ 1408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:06.797655 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:06.797725 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:06.797733 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:06.798194 (+ 461us) server_negotiation.cc:299] Negotiation successful
0811 16:38:06.798242 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 16:38:06.798308 6845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:06.794409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.195:39585 (local address 127.24.175.194:48569)
0811 16:38:06.794649 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:06.794658 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:06.794710 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:06.794840 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:06.794841 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:06.794842 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:38:06.794888 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:06.794889 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:06.795743 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:06.795744 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:06.796994 (+ 1250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:06.796997 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:06.797739 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:06.797740 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:06.798104 (+ 364us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:06.798107 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:38:06.798184 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 16:38:06.798221 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":224,"mutex_wait_us":72,"thread_start_us":127,"threads_started":1}
I20260811 16:38:06.798429 6210 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "462f6b7de3334b22b57469725a9ff571" candidate_uuid: "ae5214c78bc64887ad236150e281400b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "102e06f64abc4aa591d0697dce17c37d" is_pre_election: true
I20260811 16:38:06.798595 6210 raft_consensus.cc:2454] T 462f6b7de3334b22b57469725a9ff571 P 102e06f64abc4aa591d0697dce17c37d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae5214c78bc64887ad236150e281400b in term 0.
I20260811 16:38:06.798620 6702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "462f6b7de3334b22b57469725a9ff571" candidate_uuid: "ae5214c78bc64887ad236150e281400b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba51a559bd64e4b95ac7a31b675868d" is_pre_election: true
I20260811 16:38:06.798774 6702 raft_consensus.cc:2454] T 462f6b7de3334b22b57469725a9ff571 P 6ba51a559bd64e4b95ac7a31b675868d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae5214c78bc64887ad236150e281400b in term 0.
I20260811 16:38:06.798833 6338 leader_election.cc:302] T 462f6b7de3334b22b57469725a9ff571 P ae5214c78bc64887ad236150e281400b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 102e06f64abc4aa591d0697dce17c37d, ae5214c78bc64887ad236150e281400b; no voters:
I20260811 16:38:06.798962 6842 raft_consensus.cc:2781] T 462f6b7de3334b22b57469725a9ff571 P ae5214c78bc64887ad236150e281400b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:38:06.799022 6842 raft_consensus.cc:482] T 462f6b7de3334b22b57469725a9ff571 P ae5214c78bc64887ad236150e281400b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:38:06.799045 6842 raft_consensus.cc:3037] T 462f6b7de3334b22b57469725a9ff571 P ae5214c78bc64887ad236150e281400b [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:38:06.799750 6842 raft_consensus.cc:504] T 462f6b7de3334b22b57469725a9ff571 P ae5214c78bc64887ad236150e281400b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae5214c78bc64887ad236150e281400b" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 40049 } } peers { permanent_uuid: "6ba51a559bd64e4b95ac7a31b675868d" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39585 } } peers { permanent_uuid: "102e06f64abc4aa591d0697dce17c37d" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39861 } }
I20260811 16:38:06.799878 6842 leader_election.cc:288] T 462f6b7de3334b22b57469725a9ff571 P ae5214c78bc64887ad236150e281400b [CANDIDATE]: Term 1 election: Requested vote from peers 6ba51a559bd64e4b95ac7a31b675868d (127.24.175.195:39585), 102e06f64abc4aa591d0697dce17c37d (127.24.175.193:39861)
I20260811 16:38:06.800071 6210 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "462f6b7de3334b22b57469725a9ff571" candidate_uuid: "ae5214c78bc64887ad236150e281400b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "102e06f64abc4aa591d0697dce17c37d"
I20260811 16:38:06.800094 6702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "462f6b7de3334b22b57469725a9ff571" candidate_uuid: "ae5214c78bc64887ad236150e281400b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba51a559bd64e4b95ac7a31b675868d"
I20260811 16:38:06.800163 6702 raft_consensus.cc:3037] T 462f6b7de3334b22b57469725a9ff571 P 6ba51a559bd64e4b95ac7a31b675868d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:38:06.800163 6210 raft_consensus.cc:3037] T 462f6b7de3334b22b57469725a9ff571 P 102e06f64abc4aa591d0697dce17c37d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:38:06.801002 6702 raft_consensus.cc:2454] T 462f6b7de3334b22b57469725a9ff571 P 6ba51a559bd64e4b95ac7a31b675868d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae5214c78bc64887ad236150e281400b in term 1.
I20260811 16:38:06.801002 6210 raft_consensus.cc:2454] T 462f6b7de3334b22b57469725a9ff571 P 102e06f64abc4aa591d0697dce17c37d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae5214c78bc64887ad236150e281400b in term 1.
I20260811 16:38:06.801154 6338 leader_election.cc:302] T 462f6b7de3334b22b57469725a9ff571 P ae5214c78bc64887ad236150e281400b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 102e06f64abc4aa591d0697dce17c37d, ae5214c78bc64887ad236150e281400b; no voters:
I20260811 16:38:06.801286 6842 raft_consensus.cc:2781] T 462f6b7de3334b22b57469725a9ff571 P ae5214c78bc64887ad236150e281400b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:38:06.801427 6842 raft_consensus.cc:686] T 462f6b7de3334b22b57469725a9ff571 P ae5214c78bc64887ad236150e281400b [term 1 LEADER]: Becoming Leader. State: Replica: ae5214c78bc64887ad236150e281400b, State: Running, Role: LEADER
I20260811 16:38:06.801515 6842 consensus_queue.cc:237] T 462f6b7de3334b22b57469725a9ff571 P ae5214c78bc64887ad236150e281400b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae5214c78bc64887ad236150e281400b" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 40049 } } peers { permanent_uuid: "6ba51a559bd64e4b95ac7a31b675868d" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39585 } } peers { permanent_uuid: "102e06f64abc4aa591d0697dce17c37d" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39861 } }
I20260811 16:38:06.802380 5927 catalog_manager.cc:5495] T 462f6b7de3334b22b57469725a9ff571 P ae5214c78bc64887ad236150e281400b reported cstate change: term changed from 0 to 1, leader changed from <none> to ae5214c78bc64887ad236150e281400b (127.24.175.194). New cstate: current_term: 1 leader_uuid: "ae5214c78bc64887ad236150e281400b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae5214c78bc64887ad236150e281400b" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 40049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ba51a559bd64e4b95ac7a31b675868d" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "102e06f64abc4aa591d0697dce17c37d" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39861 } health_report { overall_health: UNKNOWN } } }
W20260811 16:38:06.817482 6795 tablet.cc:2369] T 462f6b7de3334b22b57469725a9ff571 P 6ba51a559bd64e4b95ac7a31b675868d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:38:06.836943 6825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:06.834660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34396 (local address 127.24.175.194:40049)
0811 16:38:06.834726 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:06.834728 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:06.834737 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:38:06.834773 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:06.834774 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:06.834790 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:06.834849 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:38:06.834995 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:06.835469 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:06.836206 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:06.836394 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:06.836447 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:06.836614 (+ 167us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:38:06.836736 (+ 122us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:38:06.836810 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:06.836848 (+ 38us) server_negotiation.cc:299] Negotiation successful
0811 16:38:06.836869 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 16:38:06.838768 6210 raft_consensus.cc:1261] T 462f6b7de3334b22b57469725a9ff571 P 102e06f64abc4aa591d0697dce17c37d [term 1 FOLLOWER]: Refusing update from remote peer ae5214c78bc64887ad236150e281400b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:38:06.838768 6702 raft_consensus.cc:1261] T 462f6b7de3334b22b57469725a9ff571 P 6ba51a559bd64e4b95ac7a31b675868d [term 1 FOLLOWER]: Refusing update from remote peer ae5214c78bc64887ad236150e281400b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:38:06.839160 6842 consensus_queue.cc:1035] T 462f6b7de3334b22b57469725a9ff571 P ae5214c78bc64887ad236150e281400b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba51a559bd64e4b95ac7a31b675868d" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:38:06.839315 6846 consensus_queue.cc:1035] T 462f6b7de3334b22b57469725a9ff571 P ae5214c78bc64887ad236150e281400b [LEADER]: Connected to new peer: Peer: permanent_uuid: "102e06f64abc4aa591d0697dce17c37d" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:38:06.841600 6856 mvcc.cc:205] Tried to move back new op lower bound from 7317365910888787968 to 7317365910739566592. Current Snapshot: MvccSnapshot[applied={T|T < 7317365910888787968}]
I20260811 16:38:06.842342 6857 mvcc.cc:205] Tried to move back new op lower bound from 7317365910888787968 to 7317365910739566592. Current Snapshot: MvccSnapshot[applied={T|T < 7317365910888787968 or (T in {7317365910888787968})}]
I20260811 16:38:06.843654 5927 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57866:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:38:06.843753 5927 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57866:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:38:06.844457 5927 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 045a6bde55b842b1a1bcede4c5b07c0c: Sending DeleteTablet for 3 replicas of tablet 462f6b7de3334b22b57469725a9ff571
I20260811 16:38:06.844756 6430 tablet_service.cc:1514] Processing DeleteTablet for tablet 462f6b7de3334b22b57469725a9ff571 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:38:06 UTC) from {username='oryx', principal='oryx/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:34386
I20260811 16:38:06.844798 6174 tablet_service.cc:1514] Processing DeleteTablet for tablet 462f6b7de3334b22b57469725a9ff571 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:38:06 UTC) from {username='oryx', principal='oryx/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:56256
I20260811 16:38:06.844799 6671 tablet_service.cc:1514] Processing DeleteTablet for tablet 462f6b7de3334b22b57469725a9ff571 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:38:06 UTC) from {username='oryx', principal='oryx/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:58562
I20260811 16:38:06.845036 6867 tablet_replica.cc:330] T 462f6b7de3334b22b57469725a9ff571 P 102e06f64abc4aa591d0697dce17c37d: stopping tablet replica
I20260811 16:38:06.845180 6866 tablet_replica.cc:330] T 462f6b7de3334b22b57469725a9ff571 P ae5214c78bc64887ad236150e281400b: stopping tablet replica
I20260811 16:38:06.845269 6869 tablet_replica.cc:330] T 462f6b7de3334b22b57469725a9ff571 P 6ba51a559bd64e4b95ac7a31b675868d: stopping tablet replica
I20260811 16:38:06.845208 5927 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57866:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 16:38:06.845317 6867 raft_consensus.cc:2229] T 462f6b7de3334b22b57469725a9ff571 P 102e06f64abc4aa591d0697dce17c37d [term 1 FOLLOWER]: Raft consensus shutting down.
W20260811 16:38:06.845346 5927 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:38:06.845422 6867 raft_consensus.cc:2258] T 462f6b7de3334b22b57469725a9ff571 P 102e06f64abc4aa591d0697dce17c37d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:38:06.845517 6866 raft_consensus.cc:2229] T 462f6b7de3334b22b57469725a9ff571 P ae5214c78bc64887ad236150e281400b [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:38:06.845553 6869 raft_consensus.cc:2229] T 462f6b7de3334b22b57469725a9ff571 P 6ba51a559bd64e4b95ac7a31b675868d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:38:06.845670 6869 raft_consensus.cc:2258] T 462f6b7de3334b22b57469725a9ff571 P 6ba51a559bd64e4b95ac7a31b675868d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:38:06.845719 6866 raft_consensus.cc:2258] T 462f6b7de3334b22b57469725a9ff571 P ae5214c78bc64887ad236150e281400b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:38:06.846199 6869 ts_tablet_manager.cc:1905] T 462f6b7de3334b22b57469725a9ff571 P 6ba51a559bd64e4b95ac7a31b675868d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:38:06.846210 6867 ts_tablet_manager.cc:1905] T 462f6b7de3334b22b57469725a9ff571 P 102e06f64abc4aa591d0697dce17c37d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:38:06.846899 6174 tablet_service.cc:1467] Processing CreateTablet for tablet 29a8d266e88c40c1a875545e4242a47e (DEFAULT_TABLE table=test-table [id=261ce61b504c4545a3622eddbdfc95c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:38:06.847110 6174 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29a8d266e88c40c1a875545e4242a47e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:38:06.847546 6866 ts_tablet_manager.cc:1905] T 462f6b7de3334b22b57469725a9ff571 P ae5214c78bc64887ad236150e281400b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:38:06.847890 6869 ts_tablet_manager.cc:1918] T 462f6b7de3334b22b57469725a9ff571 P 6ba51a559bd64e4b95ac7a31b675868d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:38:06.847952 6869 log.cc:1196] T 462f6b7de3334b22b57469725a9ff571 P 6ba51a559bd64e4b95ac7a31b675868d: Deleting WAL directory at /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/ts-2/wal/wals/462f6b7de3334b22b57469725a9ff571
I20260811 16:38:06.848191 6869 ts_tablet_manager.cc:1939] T 462f6b7de3334b22b57469725a9ff571 P 6ba51a559bd64e4b95ac7a31b675868d: Deleting consensus metadata
I20260811 16:38:06.848362 6835 tablet_bootstrap.cc:492] T 29a8d266e88c40c1a875545e4242a47e P 102e06f64abc4aa591d0697dce17c37d: Bootstrap starting.
I20260811 16:38:06.848560 6671 tablet_service.cc:1467] Processing CreateTablet for tablet 29a8d266e88c40c1a875545e4242a47e (DEFAULT_TABLE table=test-table [id=261ce61b504c4545a3622eddbdfc95c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:38:06.848747 6835 tablet_bootstrap.cc:654] T 29a8d266e88c40c1a875545e4242a47e P 102e06f64abc4aa591d0697dce17c37d: Neither blocks nor log segments found. Creating new log.
I20260811 16:38:06.849061 6866 ts_tablet_manager.cc:1918] T 462f6b7de3334b22b57469725a9ff571 P ae5214c78bc64887ad236150e281400b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:38:06.849120 6866 log.cc:1196] T 462f6b7de3334b22b57469725a9ff571 P ae5214c78bc64887ad236150e281400b: Deleting WAL directory at /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/ts-1/wal/wals/462f6b7de3334b22b57469725a9ff571
I20260811 16:38:06.849171 6430 tablet_service.cc:1467] Processing CreateTablet for tablet 29a8d266e88c40c1a875545e4242a47e (DEFAULT_TABLE table=test-table [id=261ce61b504c4545a3622eddbdfc95c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:38:06.849254 6430 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29a8d266e88c40c1a875545e4242a47e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:38:06.849360 6866 ts_tablet_manager.cc:1939] T 462f6b7de3334b22b57469725a9ff571 P ae5214c78bc64887ad236150e281400b: Deleting consensus metadata
I20260811 16:38:06.849710 5902 catalog_manager.cc:4841] TS ae5214c78bc64887ad236150e281400b (127.24.175.194:40049): tablet 462f6b7de3334b22b57469725a9ff571 (table test-table [id=ea54ca15705141b28c84124999468c05]) successfully deleted
I20260811 16:38:06.850284 6867 ts_tablet_manager.cc:1918] T 462f6b7de3334b22b57469725a9ff571 P 102e06f64abc4aa591d0697dce17c37d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:38:06.850350 6867 log.cc:1196] T 462f6b7de3334b22b57469725a9ff571 P 102e06f64abc4aa591d0697dce17c37d: Deleting WAL directory at /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/ts-0/wal/wals/462f6b7de3334b22b57469725a9ff571
I20260811 16:38:06.850443 6832 tablet_bootstrap.cc:492] T 29a8d266e88c40c1a875545e4242a47e P ae5214c78bc64887ad236150e281400b: Bootstrap starting.
I20260811 16:38:06.850577 6867 ts_tablet_manager.cc:1939] T 462f6b7de3334b22b57469725a9ff571 P 102e06f64abc4aa591d0697dce17c37d: Deleting consensus metadata
I20260811 16:38:06.850847 6832 tablet_bootstrap.cc:654] T 29a8d266e88c40c1a875545e4242a47e P ae5214c78bc64887ad236150e281400b: Neither blocks nor log segments found. Creating new log.
I20260811 16:38:06.850960 5902 catalog_manager.cc:4841] TS 102e06f64abc4aa591d0697dce17c37d (127.24.175.193:39861): tablet 462f6b7de3334b22b57469725a9ff571 (table test-table [id=ea54ca15705141b28c84124999468c05]) successfully deleted
I20260811 16:38:06.851392 6835 tablet_bootstrap.cc:492] T 29a8d266e88c40c1a875545e4242a47e P 102e06f64abc4aa591d0697dce17c37d: No bootstrap required, opened a new log
I20260811 16:38:06.851436 6835 ts_tablet_manager.cc:1397] T 29a8d266e88c40c1a875545e4242a47e P 102e06f64abc4aa591d0697dce17c37d: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260811 16:38:06.851435 6832 tablet_bootstrap.cc:492] T 29a8d266e88c40c1a875545e4242a47e P ae5214c78bc64887ad236150e281400b: No bootstrap required, opened a new log
I20260811 16:38:06.851477 6832 ts_tablet_manager.cc:1397] T 29a8d266e88c40c1a875545e4242a47e P ae5214c78bc64887ad236150e281400b: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 16:38:06.851567 6835 raft_consensus.cc:348] T 29a8d266e88c40c1a875545e4242a47e P 102e06f64abc4aa591d0697dce17c37d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102e06f64abc4aa591d0697dce17c37d" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39861 } } peers { permanent_uuid: "ae5214c78bc64887ad236150e281400b" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 40049 } } peers { permanent_uuid: "6ba51a559bd64e4b95ac7a31b675868d" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39585 } }
I20260811 16:38:06.851619 6835 raft_consensus.cc:374] T 29a8d266e88c40c1a875545e4242a47e P 102e06f64abc4aa591d0697dce17c37d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:38:06.851630 6835 raft_consensus.cc:729] T 29a8d266e88c40c1a875545e4242a47e P 102e06f64abc4aa591d0697dce17c37d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 102e06f64abc4aa591d0697dce17c37d, State: Initialized, Role: FOLLOWER
I20260811 16:38:06.851625 6832 raft_consensus.cc:348] T 29a8d266e88c40c1a875545e4242a47e P ae5214c78bc64887ad236150e281400b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102e06f64abc4aa591d0697dce17c37d" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39861 } } peers { permanent_uuid: "ae5214c78bc64887ad236150e281400b" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 40049 } } peers { permanent_uuid: "6ba51a559bd64e4b95ac7a31b675868d" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39585 } }
I20260811 16:38:06.851686 6832 raft_consensus.cc:374] T 29a8d266e88c40c1a875545e4242a47e P ae5214c78bc64887ad236150e281400b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:38:06.851672 6835 consensus_queue.cc:260] T 29a8d266e88c40c1a875545e4242a47e P 102e06f64abc4aa591d0697dce17c37d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102e06f64abc4aa591d0697dce17c37d" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39861 } } peers { permanent_uuid: "ae5214c78bc64887ad236150e281400b" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 40049 } } peers { permanent_uuid: "6ba51a559bd64e4b95ac7a31b675868d" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39585 } }
I20260811 16:38:06.851706 6832 raft_consensus.cc:729] T 29a8d266e88c40c1a875545e4242a47e P ae5214c78bc64887ad236150e281400b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae5214c78bc64887ad236150e281400b, State: Initialized, Role: FOLLOWER
I20260811 16:38:06.851756 6832 consensus_queue.cc:260] T 29a8d266e88c40c1a875545e4242a47e P ae5214c78bc64887ad236150e281400b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102e06f64abc4aa591d0697dce17c37d" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39861 } } peers { permanent_uuid: "ae5214c78bc64887ad236150e281400b" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 40049 } } peers { permanent_uuid: "6ba51a559bd64e4b95ac7a31b675868d" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39585 } }
I20260811 16:38:06.851845 6832 ts_tablet_manager.cc:1428] T 29a8d266e88c40c1a875545e4242a47e P ae5214c78bc64887ad236150e281400b: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:06.851963 6835 ts_tablet_manager.cc:1428] T 29a8d266e88c40c1a875545e4242a47e P 102e06f64abc4aa591d0697dce17c37d: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:06.852133 6671 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29a8d266e88c40c1a875545e4242a47e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:38:06.853220 6830 tablet_bootstrap.cc:492] T 29a8d266e88c40c1a875545e4242a47e P 6ba51a559bd64e4b95ac7a31b675868d: Bootstrap starting.
I20260811 16:38:06.853452 5901 catalog_manager.cc:4841] TS 6ba51a559bd64e4b95ac7a31b675868d (127.24.175.195:39585): tablet 462f6b7de3334b22b57469725a9ff571 (table test-table [id=ea54ca15705141b28c84124999468c05]) successfully deleted
I20260811 16:38:06.853596 6830 tablet_bootstrap.cc:654] T 29a8d266e88c40c1a875545e4242a47e P 6ba51a559bd64e4b95ac7a31b675868d: Neither blocks nor log segments found. Creating new log.
I20260811 16:38:06.854084 6830 tablet_bootstrap.cc:492] T 29a8d266e88c40c1a875545e4242a47e P 6ba51a559bd64e4b95ac7a31b675868d: No bootstrap required, opened a new log
I20260811 16:38:06.854123 6830 ts_tablet_manager.cc:1397] T 29a8d266e88c40c1a875545e4242a47e P 6ba51a559bd64e4b95ac7a31b675868d: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 16:38:06.854278 6830 raft_consensus.cc:348] T 29a8d266e88c40c1a875545e4242a47e P 6ba51a559bd64e4b95ac7a31b675868d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102e06f64abc4aa591d0697dce17c37d" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39861 } } peers { permanent_uuid: "ae5214c78bc64887ad236150e281400b" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 40049 } } peers { permanent_uuid: "6ba51a559bd64e4b95ac7a31b675868d" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39585 } }
I20260811 16:38:06.854337 6830 raft_consensus.cc:374] T 29a8d266e88c40c1a875545e4242a47e P 6ba51a559bd64e4b95ac7a31b675868d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:38:06.854350 6830 raft_consensus.cc:729] T 29a8d266e88c40c1a875545e4242a47e P 6ba51a559bd64e4b95ac7a31b675868d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba51a559bd64e4b95ac7a31b675868d, State: Initialized, Role: FOLLOWER
I20260811 16:38:06.854382 6830 consensus_queue.cc:260] T 29a8d266e88c40c1a875545e4242a47e P 6ba51a559bd64e4b95ac7a31b675868d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102e06f64abc4aa591d0697dce17c37d" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39861 } } peers { permanent_uuid: "ae5214c78bc64887ad236150e281400b" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 40049 } } peers { permanent_uuid: "6ba51a559bd64e4b95ac7a31b675868d" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39585 } }
I20260811 16:38:06.854466 6830 ts_tablet_manager.cc:1428] T 29a8d266e88c40c1a875545e4242a47e P 6ba51a559bd64e4b95ac7a31b675868d: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:07.022295 6843 raft_consensus.cc:482] T 29a8d266e88c40c1a875545e4242a47e P 102e06f64abc4aa591d0697dce17c37d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:38:07.022390 6843 raft_consensus.cc:504] T 29a8d266e88c40c1a875545e4242a47e P 102e06f64abc4aa591d0697dce17c37d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102e06f64abc4aa591d0697dce17c37d" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39861 } } peers { permanent_uuid: "ae5214c78bc64887ad236150e281400b" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 40049 } } peers { permanent_uuid: "6ba51a559bd64e4b95ac7a31b675868d" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39585 } }
I20260811 16:38:07.022718 6843 leader_election.cc:288] T 29a8d266e88c40c1a875545e4242a47e P 102e06f64abc4aa591d0697dce17c37d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae5214c78bc64887ad236150e281400b (127.24.175.194:40049), 6ba51a559bd64e4b95ac7a31b675868d (127.24.175.195:39585)
I20260811 16:38:07.025583 6829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:07.023034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:41607 (local address 127.24.175.195:39585)
0811 16:38:07.023080 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:07.023082 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:07.023163 (+ 81us) server_negotiation.cc:407] Connection header received
0811 16:38:07.023233 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:07.023234 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:07.023244 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:07.023292 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:38:07.023450 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:07.023931 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:07.024905 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:07.025248 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:07.025310 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:07.025319 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:07.025467 (+ 148us) server_negotiation.cc:299] Negotiation successful
0811 16:38:07.025501 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 16:38:07.025588 6825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:07.022973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:42287 (local address 127.24.175.194:40049)
0811 16:38:07.023025 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:07.023027 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:07.023181 (+ 154us) server_negotiation.cc:407] Connection header received
0811 16:38:07.023234 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:07.023235 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:07.023248 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:07.023296 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:38:07.023438 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:07.023915 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:07.024907 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:07.025265 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:07.025325 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:07.025334 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:07.025469 (+ 135us) server_negotiation.cc:299] Negotiation successful
0811 16:38:07.025508 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 16:38:07.025611 6878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:07.022920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.195:39585 (local address 127.24.175.193:41607)
0811 16:38:07.023094 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:07.023104 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:07.023179 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:07.023302 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:07.023303 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:07.023305 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:38:07.023394 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:07.023395 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:07.024003 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:07.024004 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:07.024822 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:07.024824 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:07.025340 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:07.025341 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:07.025408 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:07.025411 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:38:07.025455 (+ 44us) client_negotiation.cc:240] Negotiation successful
0811 16:38:07.025494 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"mutex_wait_us":4,"thread_start_us":86,"threads_started":1}
I20260811 16:38:07.025614 6875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:07.022921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.194:40049 (local address 127.24.175.193:42287)
0811 16:38:07.023105 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:07.023115 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:07.023179 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:07.023308 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:07.023309 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:07.023310 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:38:07.023381 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:07.023383 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:07.023989 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:07.023990 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:07.024825 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:07.024827 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:07.025358 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:07.025359 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:07.025411 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:07.025414 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:38:07.025458 (+ 44us) client_negotiation.cc:240] Negotiation successful
0811 16:38:07.025500 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"mutex_wait_us":58,"thread_start_us":92,"threads_started":1}
I20260811 16:38:07.025933 6702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29a8d266e88c40c1a875545e4242a47e" candidate_uuid: "102e06f64abc4aa591d0697dce17c37d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba51a559bd64e4b95ac7a31b675868d" is_pre_election: true
I20260811 16:38:07.026048 6702 raft_consensus.cc:2454] T 29a8d266e88c40c1a875545e4242a47e P 6ba51a559bd64e4b95ac7a31b675868d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 102e06f64abc4aa591d0697dce17c37d in term 0.
I20260811 16:38:07.026057 6466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29a8d266e88c40c1a875545e4242a47e" candidate_uuid: "102e06f64abc4aa591d0697dce17c37d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae5214c78bc64887ad236150e281400b" is_pre_election: true
I20260811 16:38:07.026212 6466 raft_consensus.cc:2454] T 29a8d266e88c40c1a875545e4242a47e P ae5214c78bc64887ad236150e281400b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 102e06f64abc4aa591d0697dce17c37d in term 0.
I20260811 16:38:07.026234 6092 leader_election.cc:302] T 29a8d266e88c40c1a875545e4242a47e P 102e06f64abc4aa591d0697dce17c37d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 102e06f64abc4aa591d0697dce17c37d, 6ba51a559bd64e4b95ac7a31b675868d; no voters:
I20260811 16:38:07.026371 6843 raft_consensus.cc:2781] T 29a8d266e88c40c1a875545e4242a47e P 102e06f64abc4aa591d0697dce17c37d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:38:07.026419 6843 raft_consensus.cc:482] T 29a8d266e88c40c1a875545e4242a47e P 102e06f64abc4aa591d0697dce17c37d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:38:07.026440 6843 raft_consensus.cc:3037] T 29a8d266e88c40c1a875545e4242a47e P 102e06f64abc4aa591d0697dce17c37d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:38:07.027096 6843 raft_consensus.cc:504] T 29a8d266e88c40c1a875545e4242a47e P 102e06f64abc4aa591d0697dce17c37d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102e06f64abc4aa591d0697dce17c37d" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39861 } } peers { permanent_uuid: "ae5214c78bc64887ad236150e281400b" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 40049 } } peers { permanent_uuid: "6ba51a559bd64e4b95ac7a31b675868d" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39585 } }
I20260811 16:38:07.027232 6843 leader_election.cc:288] T 29a8d266e88c40c1a875545e4242a47e P 102e06f64abc4aa591d0697dce17c37d [CANDIDATE]: Term 1 election: Requested vote from peers ae5214c78bc64887ad236150e281400b (127.24.175.194:40049), 6ba51a559bd64e4b95ac7a31b675868d (127.24.175.195:39585)
I20260811 16:38:07.027375 6702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29a8d266e88c40c1a875545e4242a47e" candidate_uuid: "102e06f64abc4aa591d0697dce17c37d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba51a559bd64e4b95ac7a31b675868d"
I20260811 16:38:07.027376 6466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29a8d266e88c40c1a875545e4242a47e" candidate_uuid: "102e06f64abc4aa591d0697dce17c37d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae5214c78bc64887ad236150e281400b"
I20260811 16:38:07.027446 6702 raft_consensus.cc:3037] T 29a8d266e88c40c1a875545e4242a47e P 6ba51a559bd64e4b95ac7a31b675868d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:38:07.027472 6466 raft_consensus.cc:3037] T 29a8d266e88c40c1a875545e4242a47e P ae5214c78bc64887ad236150e281400b [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:38:07.028043 6702 raft_consensus.cc:2454] T 29a8d266e88c40c1a875545e4242a47e P 6ba51a559bd64e4b95ac7a31b675868d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 102e06f64abc4aa591d0697dce17c37d in term 1.
I20260811 16:38:07.028103 6466 raft_consensus.cc:2454] T 29a8d266e88c40c1a875545e4242a47e P ae5214c78bc64887ad236150e281400b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 102e06f64abc4aa591d0697dce17c37d in term 1.
I20260811 16:38:07.028219 6092 leader_election.cc:302] T 29a8d266e88c40c1a875545e4242a47e P 102e06f64abc4aa591d0697dce17c37d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 102e06f64abc4aa591d0697dce17c37d, 6ba51a559bd64e4b95ac7a31b675868d; no voters:
I20260811 16:38:07.028330 6843 raft_consensus.cc:2781] T 29a8d266e88c40c1a875545e4242a47e P 102e06f64abc4aa591d0697dce17c37d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:38:07.028489 6843 raft_consensus.cc:686] T 29a8d266e88c40c1a875545e4242a47e P 102e06f64abc4aa591d0697dce17c37d [term 1 LEADER]: Becoming Leader. State: Replica: 102e06f64abc4aa591d0697dce17c37d, State: Running, Role: LEADER
I20260811 16:38:07.028566 6843 consensus_queue.cc:237] T 29a8d266e88c40c1a875545e4242a47e P 102e06f64abc4aa591d0697dce17c37d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102e06f64abc4aa591d0697dce17c37d" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39861 } } peers { permanent_uuid: "ae5214c78bc64887ad236150e281400b" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 40049 } } peers { permanent_uuid: "6ba51a559bd64e4b95ac7a31b675868d" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39585 } }
I20260811 16:38:07.029232 5927 catalog_manager.cc:5495] T 29a8d266e88c40c1a875545e4242a47e P 102e06f64abc4aa591d0697dce17c37d reported cstate change: term changed from 0 to 1, leader changed from <none> to 102e06f64abc4aa591d0697dce17c37d (127.24.175.193). New cstate: current_term: 1 leader_uuid: "102e06f64abc4aa591d0697dce17c37d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102e06f64abc4aa591d0697dce17c37d" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39861 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae5214c78bc64887ad236150e281400b" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 40049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba51a559bd64e4b95ac7a31b675868d" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39585 } health_report { overall_health: UNKNOWN } } }
Aug 11 16:38:07 dist-test-slave-zj8q krb5kdc[5849](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466286, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.175.254@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM
I20260811 16:38:07.097651 6016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:07.090857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57874 (local address 127.24.175.254:33029)
0811 16:38:07.090924 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:07.090926 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:07.091002 (+ 76us) server_negotiation.cc:407] Connection header received
0811 16:38:07.091058 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:07.091059 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:07.091069 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:07.091116 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:07.091617 (+ 501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:07.092113 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:07.092926 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:07.093160 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:07.093230 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:07.095298 (+ 2068us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:38:07.095300 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:38:07.095300 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:38:07.095308 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:38:07.096526 (+ 1218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:07.096905 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:07.096906 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:07.096907 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:07.096957 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:07.097112 (+ 155us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:07.097113 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:07.097113 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:07.097221 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:38:07.097275 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:07.097429 (+ 154us) server_negotiation.cc:299] Negotiation successful
0811 16:38:07.097551 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":15,"server-negotiator.queue_time_us":42}
I20260811 16:38:07.097734 6889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:07.090779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:33029 (local address 127.0.0.1:57874)
0811 16:38:07.090934 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:07.090945 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:07.091010 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:07.091126 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:07.091126 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:07.091483 (+ 357us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:07.091534 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:07.091537 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:07.092184 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:07.092185 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:07.092818 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:07.092824 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:07.093239 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:07.093241 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:07.093294 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:07.093814 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:07.093820 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:07.095221 (+ 1401us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:38:07.096597 (+ 1376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:07.096605 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:07.096607 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:07.096839 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:07.097008 (+ 169us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:07.097009 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:07.097009 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:07.097066 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:07.097291 (+ 225us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:38:07.097299 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:38:07.097345 (+ 46us) client_negotiation.cc:769] Sending connection context
0811 16:38:07.097399 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 16:38:07.097615 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"mutex_wait_us":98,"thread_start_us":78,"threads_started":1}
I20260811 16:38:07.099488 5927 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:57874:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 16:38:07.099699 5927 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:38:07.101033 6174 tablet_service.cc:1467] Processing CreateTablet for tablet a68b081bff964ba6a2a8fbf4546a846c (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=52a097292d464472a91db9b67cf301b5]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 16:38:07.101047 6671 tablet_service.cc:1467] Processing CreateTablet for tablet a68b081bff964ba6a2a8fbf4546a846c (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=52a097292d464472a91db9b67cf301b5]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 16:38:07.101047 6430 tablet_service.cc:1467] Processing CreateTablet for tablet a68b081bff964ba6a2a8fbf4546a846c (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=52a097292d464472a91db9b67cf301b5]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 16:38:07.101190 6174 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a68b081bff964ba6a2a8fbf4546a846c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:38:07.101195 6430 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a68b081bff964ba6a2a8fbf4546a846c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:38:07.101194 6671 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a68b081bff964ba6a2a8fbf4546a846c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:38:07.102660 6830 tablet_bootstrap.cc:492] T a68b081bff964ba6a2a8fbf4546a846c P 6ba51a559bd64e4b95ac7a31b675868d: Bootstrap starting.
I20260811 16:38:07.102660 6832 tablet_bootstrap.cc:492] T a68b081bff964ba6a2a8fbf4546a846c P ae5214c78bc64887ad236150e281400b: Bootstrap starting.
I20260811 16:38:07.102684 6835 tablet_bootstrap.cc:492] T a68b081bff964ba6a2a8fbf4546a846c P 102e06f64abc4aa591d0697dce17c37d: Bootstrap starting.
I20260811 16:38:07.103014 6832 tablet_bootstrap.cc:654] T a68b081bff964ba6a2a8fbf4546a846c P ae5214c78bc64887ad236150e281400b: Neither blocks nor log segments found. Creating new log.
I20260811 16:38:07.103034 6830 tablet_bootstrap.cc:654] T a68b081bff964ba6a2a8fbf4546a846c P 6ba51a559bd64e4b95ac7a31b675868d: Neither blocks nor log segments found. Creating new log.
I20260811 16:38:07.103039 6835 tablet_bootstrap.cc:654] T a68b081bff964ba6a2a8fbf4546a846c P 102e06f64abc4aa591d0697dce17c37d: Neither blocks nor log segments found. Creating new log.
I20260811 16:38:07.103587 6832 tablet_bootstrap.cc:492] T a68b081bff964ba6a2a8fbf4546a846c P ae5214c78bc64887ad236150e281400b: No bootstrap required, opened a new log
I20260811 16:38:07.103634 6832 ts_tablet_manager.cc:1397] T a68b081bff964ba6a2a8fbf4546a846c P ae5214c78bc64887ad236150e281400b: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 16:38:07.103668 6830 tablet_bootstrap.cc:492] T a68b081bff964ba6a2a8fbf4546a846c P 6ba51a559bd64e4b95ac7a31b675868d: No bootstrap required, opened a new log
I20260811 16:38:07.103715 6830 ts_tablet_manager.cc:1397] T a68b081bff964ba6a2a8fbf4546a846c P 6ba51a559bd64e4b95ac7a31b675868d: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 16:38:07.103780 6832 raft_consensus.cc:348] T a68b081bff964ba6a2a8fbf4546a846c P ae5214c78bc64887ad236150e281400b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102e06f64abc4aa591d0697dce17c37d" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39861 } } peers { permanent_uuid: "ae5214c78bc64887ad236150e281400b" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 40049 } } peers { permanent_uuid: "6ba51a559bd64e4b95ac7a31b675868d" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39585 } }
I20260811 16:38:07.103848 6832 raft_consensus.cc:374] T a68b081bff964ba6a2a8fbf4546a846c P ae5214c78bc64887ad236150e281400b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:38:07.103868 6832 raft_consensus.cc:729] T a68b081bff964ba6a2a8fbf4546a846c P ae5214c78bc64887ad236150e281400b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae5214c78bc64887ad236150e281400b, State: Initialized, Role: FOLLOWER
I20260811 16:38:07.103869 6835 tablet_bootstrap.cc:492] T a68b081bff964ba6a2a8fbf4546a846c P 102e06f64abc4aa591d0697dce17c37d: No bootstrap required, opened a new log
I20260811 16:38:07.103849 6830 raft_consensus.cc:348] T a68b081bff964ba6a2a8fbf4546a846c P 6ba51a559bd64e4b95ac7a31b675868d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102e06f64abc4aa591d0697dce17c37d" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39861 } } peers { permanent_uuid: "ae5214c78bc64887ad236150e281400b" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 40049 } } peers { permanent_uuid: "6ba51a559bd64e4b95ac7a31b675868d" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39585 } }
I20260811 16:38:07.103901 6830 raft_consensus.cc:374] T a68b081bff964ba6a2a8fbf4546a846c P 6ba51a559bd64e4b95ac7a31b675868d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:38:07.103909 6835 ts_tablet_manager.cc:1397] T a68b081bff964ba6a2a8fbf4546a846c P 102e06f64abc4aa591d0697dce17c37d: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 16:38:07.103919 6830 raft_consensus.cc:729] T a68b081bff964ba6a2a8fbf4546a846c P 6ba51a559bd64e4b95ac7a31b675868d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba51a559bd64e4b95ac7a31b675868d, State: Initialized, Role: FOLLOWER
I20260811 16:38:07.103916 6832 consensus_queue.cc:260] T a68b081bff964ba6a2a8fbf4546a846c P ae5214c78bc64887ad236150e281400b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102e06f64abc4aa591d0697dce17c37d" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39861 } } peers { permanent_uuid: "ae5214c78bc64887ad236150e281400b" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 40049 } } peers { permanent_uuid: "6ba51a559bd64e4b95ac7a31b675868d" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39585 } }
I20260811 16:38:07.103958 6830 consensus_queue.cc:260] T a68b081bff964ba6a2a8fbf4546a846c P 6ba51a559bd64e4b95ac7a31b675868d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102e06f64abc4aa591d0697dce17c37d" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39861 } } peers { permanent_uuid: "ae5214c78bc64887ad236150e281400b" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 40049 } } peers { permanent_uuid: "6ba51a559bd64e4b95ac7a31b675868d" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39585 } }
I20260811 16:38:07.104008 6832 ts_tablet_manager.cc:1428] T a68b081bff964ba6a2a8fbf4546a846c P ae5214c78bc64887ad236150e281400b: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:07.104063 6830 ts_tablet_manager.cc:1428] T a68b081bff964ba6a2a8fbf4546a846c P 6ba51a559bd64e4b95ac7a31b675868d: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:07.104041 6835 raft_consensus.cc:348] T a68b081bff964ba6a2a8fbf4546a846c P 102e06f64abc4aa591d0697dce17c37d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102e06f64abc4aa591d0697dce17c37d" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39861 } } peers { permanent_uuid: "ae5214c78bc64887ad236150e281400b" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 40049 } } peers { permanent_uuid: "6ba51a559bd64e4b95ac7a31b675868d" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39585 } }
I20260811 16:38:07.104100 6835 raft_consensus.cc:374] T a68b081bff964ba6a2a8fbf4546a846c P 102e06f64abc4aa591d0697dce17c37d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:38:07.104116 6835 raft_consensus.cc:729] T a68b081bff964ba6a2a8fbf4546a846c P 102e06f64abc4aa591d0697dce17c37d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 102e06f64abc4aa591d0697dce17c37d, State: Initialized, Role: FOLLOWER
I20260811 16:38:07.104151 6835 consensus_queue.cc:260] T a68b081bff964ba6a2a8fbf4546a846c P 102e06f64abc4aa591d0697dce17c37d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102e06f64abc4aa591d0697dce17c37d" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39861 } } peers { permanent_uuid: "ae5214c78bc64887ad236150e281400b" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 40049 } } peers { permanent_uuid: "6ba51a559bd64e4b95ac7a31b675868d" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39585 } }
I20260811 16:38:07.104116 6838 tablet_replica.cc:439] T a68b081bff964ba6a2a8fbf4546a846c P 6ba51a559bd64e4b95ac7a31b675868d: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102e06f64abc4aa591d0697dce17c37d" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39861 } } peers { permanent_uuid: "ae5214c78bc64887ad236150e281400b" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 40049 } } peers { permanent_uuid: "6ba51a559bd64e4b95ac7a31b675868d" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39585 } } }
I20260811 16:38:07.104202 6838 tablet_replica.cc:442] T a68b081bff964ba6a2a8fbf4546a846c P 6ba51a559bd64e4b95ac7a31b675868d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 16:38:07.104250 6835 ts_tablet_manager.cc:1428] T a68b081bff964ba6a2a8fbf4546a846c P 102e06f64abc4aa591d0697dce17c37d: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:07.104352 6846 tablet_replica.cc:439] T a68b081bff964ba6a2a8fbf4546a846c P ae5214c78bc64887ad236150e281400b: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102e06f64abc4aa591d0697dce17c37d" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39861 } } peers { permanent_uuid: "ae5214c78bc64887ad236150e281400b" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 40049 } } peers { permanent_uuid: "6ba51a559bd64e4b95ac7a31b675868d" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39585 } } }
I20260811 16:38:07.104424 6846 tablet_replica.cc:442] T a68b081bff964ba6a2a8fbf4546a846c P ae5214c78bc64887ad236150e281400b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 16:38:07.104488 6843 tablet_replica.cc:439] T a68b081bff964ba6a2a8fbf4546a846c P 102e06f64abc4aa591d0697dce17c37d: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102e06f64abc4aa591d0697dce17c37d" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39861 } } peers { permanent_uuid: "ae5214c78bc64887ad236150e281400b" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 40049 } } peers { permanent_uuid: "6ba51a559bd64e4b95ac7a31b675868d" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39585 } } }
I20260811 16:38:07.104552 6843 tablet_replica.cc:442] T a68b081bff964ba6a2a8fbf4546a846c P 102e06f64abc4aa591d0697dce17c37d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 16:38:07.131220 6838 raft_consensus.cc:482] T a68b081bff964ba6a2a8fbf4546a846c P 6ba51a559bd64e4b95ac7a31b675868d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:38:07.131320 6838 raft_consensus.cc:504] T a68b081bff964ba6a2a8fbf4546a846c P 6ba51a559bd64e4b95ac7a31b675868d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102e06f64abc4aa591d0697dce17c37d" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39861 } } peers { permanent_uuid: "ae5214c78bc64887ad236150e281400b" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 40049 } } peers { permanent_uuid: "6ba51a559bd64e4b95ac7a31b675868d" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39585 } }
I20260811 16:38:07.131659 6838 leader_election.cc:288] T a68b081bff964ba6a2a8fbf4546a846c P 6ba51a559bd64e4b95ac7a31b675868d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 102e06f64abc4aa591d0697dce17c37d (127.24.175.193:39861), ae5214c78bc64887ad236150e281400b (127.24.175.194:40049)
I20260811 16:38:07.134524 6825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:07.132032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.195:54965 (local address 127.24.175.194:40049)
0811 16:38:07.132074 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:07.132076 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:07.132105 (+ 29us) server_negotiation.cc:407] Connection header received
0811 16:38:07.132166 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:07.132166 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:07.132174 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:07.132223 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:38:07.132365 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:07.132847 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:07.133841 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:07.134210 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:07.134278 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:07.134287 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:07.134417 (+ 130us) server_negotiation.cc:299] Negotiation successful
0811 16:38:07.134457 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 16:38:07.134531 6827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:07.131874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.195:56421 (local address 127.24.175.193:39861)
0811 16:38:07.131934 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:07.131936 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:07.131995 (+ 59us) server_negotiation.cc:407] Connection header received
0811 16:38:07.132115 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:07.132116 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:07.132127 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:07.132197 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:38:07.132358 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:07.132836 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:07.133824 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:07.134220 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:07.134283 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:07.134292 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:07.134429 (+ 137us) server_negotiation.cc:299] Negotiation successful
0811 16:38:07.134466 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 16:38:07.134555 6894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:07.131806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.193:39861 (local address 127.24.175.195:56421)
0811 16:38:07.131921 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:07.131933 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:07.132002 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:07.132208 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:07.132209 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:07.132211 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:38:07.132294 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:07.132297 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:07.132908 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:07.132909 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:07.133736 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:07.133738 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:07.134294 (+ 556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:07.134296 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:07.134363 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:07.134366 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:38:07.134415 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 16:38:07.134456 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":95,"mutex_wait_us":28,"thread_start_us":56,"threads_started":1}
I20260811 16:38:07.134564 6895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:07.131958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.194:40049 (local address 127.24.175.195:54965)
0811 16:38:07.132051 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:07.132061 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:07.132115 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:07.132228 (+ 113us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:07.132229 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:07.132231 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:38:07.132303 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:07.132305 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:07.132919 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:07.132920 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:07.133751 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:07.133754 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:07.134288 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:07.134289 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:07.134354 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:07.134357 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:38:07.134400 (+ 43us) client_negotiation.cc:240] Negotiation successful
0811 16:38:07.134438 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":79,"mutex_wait_us":30,"thread_start_us":59,"threads_started":1}
I20260811 16:38:07.134871 6466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a68b081bff964ba6a2a8fbf4546a846c" candidate_uuid: "6ba51a559bd64e4b95ac7a31b675868d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae5214c78bc64887ad236150e281400b" is_pre_election: true
I20260811 16:38:07.134902 6210 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a68b081bff964ba6a2a8fbf4546a846c" candidate_uuid: "6ba51a559bd64e4b95ac7a31b675868d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "102e06f64abc4aa591d0697dce17c37d" is_pre_election: true
I20260811 16:38:07.134958 6466 raft_consensus.cc:2454] T a68b081bff964ba6a2a8fbf4546a846c P ae5214c78bc64887ad236150e281400b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba51a559bd64e4b95ac7a31b675868d in term 0.
I20260811 16:38:07.134979 6210 raft_consensus.cc:2454] T a68b081bff964ba6a2a8fbf4546a846c P 102e06f64abc4aa591d0697dce17c37d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ba51a559bd64e4b95ac7a31b675868d in term 0.
I20260811 16:38:07.135143 6598 leader_election.cc:302] T a68b081bff964ba6a2a8fbf4546a846c P 6ba51a559bd64e4b95ac7a31b675868d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 102e06f64abc4aa591d0697dce17c37d, 6ba51a559bd64e4b95ac7a31b675868d; no voters:
I20260811 16:38:07.135298 6838 raft_consensus.cc:2781] T a68b081bff964ba6a2a8fbf4546a846c P 6ba51a559bd64e4b95ac7a31b675868d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:38:07.135358 6838 raft_consensus.cc:482] T a68b081bff964ba6a2a8fbf4546a846c P 6ba51a559bd64e4b95ac7a31b675868d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:38:07.135380 6838 raft_consensus.cc:3037] T a68b081bff964ba6a2a8fbf4546a846c P 6ba51a559bd64e4b95ac7a31b675868d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:38:07.136132 6838 raft_consensus.cc:504] T a68b081bff964ba6a2a8fbf4546a846c P 6ba51a559bd64e4b95ac7a31b675868d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102e06f64abc4aa591d0697dce17c37d" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39861 } } peers { permanent_uuid: "ae5214c78bc64887ad236150e281400b" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 40049 } } peers { permanent_uuid: "6ba51a559bd64e4b95ac7a31b675868d" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39585 } }
I20260811 16:38:07.136253 6838 leader_election.cc:288] T a68b081bff964ba6a2a8fbf4546a846c P 6ba51a559bd64e4b95ac7a31b675868d [CANDIDATE]: Term 1 election: Requested vote from peers 102e06f64abc4aa591d0697dce17c37d (127.24.175.193:39861), ae5214c78bc64887ad236150e281400b (127.24.175.194:40049)
I20260811 16:38:07.136432 6210 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a68b081bff964ba6a2a8fbf4546a846c" candidate_uuid: "6ba51a559bd64e4b95ac7a31b675868d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "102e06f64abc4aa591d0697dce17c37d"
I20260811 16:38:07.136430 6466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a68b081bff964ba6a2a8fbf4546a846c" candidate_uuid: "6ba51a559bd64e4b95ac7a31b675868d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae5214c78bc64887ad236150e281400b"
I20260811 16:38:07.136500 6466 raft_consensus.cc:3037] T a68b081bff964ba6a2a8fbf4546a846c P ae5214c78bc64887ad236150e281400b [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:38:07.136499 6210 raft_consensus.cc:3037] T a68b081bff964ba6a2a8fbf4546a846c P 102e06f64abc4aa591d0697dce17c37d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:38:07.137055 6466 raft_consensus.cc:2454] T a68b081bff964ba6a2a8fbf4546a846c P ae5214c78bc64887ad236150e281400b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba51a559bd64e4b95ac7a31b675868d in term 1.
I20260811 16:38:07.137107 6210 raft_consensus.cc:2454] T a68b081bff964ba6a2a8fbf4546a846c P 102e06f64abc4aa591d0697dce17c37d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ba51a559bd64e4b95ac7a31b675868d in term 1.
I20260811 16:38:07.137215 6598 leader_election.cc:302] T a68b081bff964ba6a2a8fbf4546a846c P 6ba51a559bd64e4b95ac7a31b675868d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ba51a559bd64e4b95ac7a31b675868d, ae5214c78bc64887ad236150e281400b; no voters:
I20260811 16:38:07.137305 6838 raft_consensus.cc:2781] T a68b081bff964ba6a2a8fbf4546a846c P 6ba51a559bd64e4b95ac7a31b675868d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:38:07.137424 6838 raft_consensus.cc:686] T a68b081bff964ba6a2a8fbf4546a846c P 6ba51a559bd64e4b95ac7a31b675868d [term 1 LEADER]: Becoming Leader. State: Replica: 6ba51a559bd64e4b95ac7a31b675868d, State: Running, Role: LEADER
I20260811 16:38:07.137498 6838 consensus_queue.cc:237] T a68b081bff964ba6a2a8fbf4546a846c P 6ba51a559bd64e4b95ac7a31b675868d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102e06f64abc4aa591d0697dce17c37d" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39861 } } peers { permanent_uuid: "ae5214c78bc64887ad236150e281400b" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 40049 } } peers { permanent_uuid: "6ba51a559bd64e4b95ac7a31b675868d" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39585 } }
I20260811 16:38:07.137820 6898 tablet_replica.cc:439] T a68b081bff964ba6a2a8fbf4546a846c P 6ba51a559bd64e4b95ac7a31b675868d: TxnStatusTablet state changed. Reason: New leader 6ba51a559bd64e4b95ac7a31b675868d. Latest consensus state: current_term: 1 leader_uuid: "6ba51a559bd64e4b95ac7a31b675868d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102e06f64abc4aa591d0697dce17c37d" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39861 } } peers { permanent_uuid: "ae5214c78bc64887ad236150e281400b" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 40049 } } peers { permanent_uuid: "6ba51a559bd64e4b95ac7a31b675868d" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39585 } } }
I20260811 16:38:07.137908 6898 tablet_replica.cc:442] T a68b081bff964ba6a2a8fbf4546a846c P 6ba51a559bd64e4b95ac7a31b675868d: This TxnStatusTablet replica's current role is: LEADER
I20260811 16:38:07.138168 6900 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 16:38:07.138284 6900 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 16:38:07.138206 5927 catalog_manager.cc:5495] T a68b081bff964ba6a2a8fbf4546a846c P 6ba51a559bd64e4b95ac7a31b675868d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ba51a559bd64e4b95ac7a31b675868d (127.24.175.195). New cstate: current_term: 1 leader_uuid: "6ba51a559bd64e4b95ac7a31b675868d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102e06f64abc4aa591d0697dce17c37d" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae5214c78bc64887ad236150e281400b" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 40049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba51a559bd64e4b95ac7a31b675868d" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39585 } health_report { overall_health: HEALTHY } } }
I20260811 16:38:07.152102 6829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:07.149851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58576 (local address 127.24.175.195:39585)
0811 16:38:07.149898 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:07.149900 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:07.149930 (+ 30us) server_negotiation.cc:407] Connection header received
0811 16:38:07.150004 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:07.150005 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:07.150022 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:07.150089 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:38:07.150229 (+ 140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:07.150718 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:07.151430 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:07.151608 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:07.151668 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:07.151818 (+ 150us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:38:07.151908 (+ 90us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:38:07.151968 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:07.152014 (+ 46us) server_negotiation.cc:299] Negotiation successful
0811 16:38:07.152034 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 16:38:07.152132 6889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:07.149803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.195:39585 (local address 127.0.0.1:58576)
0811 16:38:07.149881 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:07.149892 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:07.149948 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:07.150090 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:07.150090 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:07.150092 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 16:38:07.150138 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:07.150140 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:07.150793 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:07.150794 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:07.151360 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:07.151362 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:07.151669 (+ 307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:07.151670 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:07.151726 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:07.151741 (+ 15us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 16:38:07.151962 (+ 221us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 16:38:07.151970 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 16:38:07.152011 (+ 41us) client_negotiation.cc:240] Negotiation successful
0811 16:38:07.152069 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260811 16:38:07.153244 6210 raft_consensus.cc:1261] T a68b081bff964ba6a2a8fbf4546a846c P 102e06f64abc4aa591d0697dce17c37d [term 1 FOLLOWER]: Refusing update from remote peer 6ba51a559bd64e4b95ac7a31b675868d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:38:07.153280 6466 raft_consensus.cc:1261] T a68b081bff964ba6a2a8fbf4546a846c P ae5214c78bc64887ad236150e281400b [term 1 FOLLOWER]: Refusing update from remote peer 6ba51a559bd64e4b95ac7a31b675868d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:38:07.153504 6898 consensus_queue.cc:1035] T a68b081bff964ba6a2a8fbf4546a846c P 6ba51a559bd64e4b95ac7a31b675868d [LEADER]: Connected to new peer: Peer: permanent_uuid: "102e06f64abc4aa591d0697dce17c37d" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:38:07.153617 6838 consensus_queue.cc:1035] T a68b081bff964ba6a2a8fbf4546a846c P 6ba51a559bd64e4b95ac7a31b675868d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae5214c78bc64887ad236150e281400b" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 40049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:38:07.154173 6843 tablet_replica.cc:439] T a68b081bff964ba6a2a8fbf4546a846c P 102e06f64abc4aa591d0697dce17c37d: TxnStatusTablet state changed. Reason: New leader 6ba51a559bd64e4b95ac7a31b675868d. Latest consensus state: current_term: 1 leader_uuid: "6ba51a559bd64e4b95ac7a31b675868d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102e06f64abc4aa591d0697dce17c37d" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39861 } } peers { permanent_uuid: "ae5214c78bc64887ad236150e281400b" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 40049 } } peers { permanent_uuid: "6ba51a559bd64e4b95ac7a31b675868d" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39585 } } }
I20260811 16:38:07.154263 6843 tablet_replica.cc:442] T a68b081bff964ba6a2a8fbf4546a846c P 102e06f64abc4aa591d0697dce17c37d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 16:38:07.154507 6846 tablet_replica.cc:439] T a68b081bff964ba6a2a8fbf4546a846c P ae5214c78bc64887ad236150e281400b: TxnStatusTablet state changed. Reason: New leader 6ba51a559bd64e4b95ac7a31b675868d. Latest consensus state: current_term: 1 leader_uuid: "6ba51a559bd64e4b95ac7a31b675868d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102e06f64abc4aa591d0697dce17c37d" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39861 } } peers { permanent_uuid: "ae5214c78bc64887ad236150e281400b" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 40049 } } peers { permanent_uuid: "6ba51a559bd64e4b95ac7a31b675868d" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39585 } } }
I20260811 16:38:07.154601 6846 tablet_replica.cc:442] T a68b081bff964ba6a2a8fbf4546a846c P ae5214c78bc64887ad236150e281400b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 16:38:07.154781 6838 tablet_replica.cc:439] T a68b081bff964ba6a2a8fbf4546a846c P 6ba51a559bd64e4b95ac7a31b675868d: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6ba51a559bd64e4b95ac7a31b675868d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102e06f64abc4aa591d0697dce17c37d" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39861 } } peers { permanent_uuid: "ae5214c78bc64887ad236150e281400b" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 40049 } } peers { permanent_uuid: "6ba51a559bd64e4b95ac7a31b675868d" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39585 } } }
I20260811 16:38:07.154858 6838 tablet_replica.cc:442] T a68b081bff964ba6a2a8fbf4546a846c P 6ba51a559bd64e4b95ac7a31b675868d: This TxnStatusTablet replica's current role is: LEADER
I20260811 16:38:07.155300 6843 tablet_replica.cc:439] T a68b081bff964ba6a2a8fbf4546a846c P 102e06f64abc4aa591d0697dce17c37d: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6ba51a559bd64e4b95ac7a31b675868d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102e06f64abc4aa591d0697dce17c37d" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39861 } } peers { permanent_uuid: "ae5214c78bc64887ad236150e281400b" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 40049 } } peers { permanent_uuid: "6ba51a559bd64e4b95ac7a31b675868d" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39585 } } }
I20260811 16:38:07.155387 6843 tablet_replica.cc:442] T a68b081bff964ba6a2a8fbf4546a846c P 102e06f64abc4aa591d0697dce17c37d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 16:38:07.156431 6898 tablet_replica.cc:439] T a68b081bff964ba6a2a8fbf4546a846c P 6ba51a559bd64e4b95ac7a31b675868d: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6ba51a559bd64e4b95ac7a31b675868d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102e06f64abc4aa591d0697dce17c37d" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39861 } } peers { permanent_uuid: "ae5214c78bc64887ad236150e281400b" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 40049 } } peers { permanent_uuid: "6ba51a559bd64e4b95ac7a31b675868d" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39585 } } }
I20260811 16:38:07.156510 6898 tablet_replica.cc:442] T a68b081bff964ba6a2a8fbf4546a846c P 6ba51a559bd64e4b95ac7a31b675868d: This TxnStatusTablet replica's current role is: LEADER
I20260811 16:38:07.157220 6850 mvcc.cc:205] Tried to move back new op lower bound from 7317365912177893376 to 7317365912115867648. Current Snapshot: MvccSnapshot[applied={T|T < 7317365912177893376 or (T in {7317365912177893376})}]
I20260811 16:38:07.157356 6846 tablet_replica.cc:439] T a68b081bff964ba6a2a8fbf4546a846c P ae5214c78bc64887ad236150e281400b: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6ba51a559bd64e4b95ac7a31b675868d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102e06f64abc4aa591d0697dce17c37d" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39861 } } peers { permanent_uuid: "ae5214c78bc64887ad236150e281400b" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 40049 } } peers { permanent_uuid: "6ba51a559bd64e4b95ac7a31b675868d" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39585 } } }
I20260811 16:38:07.157430 6846 tablet_replica.cc:442] T a68b081bff964ba6a2a8fbf4546a846c P ae5214c78bc64887ad236150e281400b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 16:38:07.160058 6827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:07.156918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56266 (local address 127.24.175.193:39861)
0811 16:38:07.156959 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:07.156961 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:07.156968 (+ 7us) server_negotiation.cc:407] Connection header received
0811 16:38:07.156998 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:07.156999 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:07.157021 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:07.157086 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:38:07.157589 (+ 503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:07.158369 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:07.159413 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:07.159598 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:07.159652 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:07.159801 (+ 149us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:38:07.159894 (+ 93us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:38:07.159942 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:07.159992 (+ 50us) server_negotiation.cc:299] Negotiation successful
0811 16:38:07.160009 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 16:38:07.164682 6829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:07.162435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:34239 (local address 127.24.175.195:39585)
0811 16:38:07.162482 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:07.162484 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:07.162611 (+ 127us) server_negotiation.cc:407] Connection header received
0811 16:38:07.162664 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:07.162665 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:07.162674 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:07.162718 (+ 44us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:38:07.162843 (+ 125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:07.163291 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:07.164041 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:07.164246 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:07.164298 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:07.164446 (+ 148us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:38:07.164478 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:38:07.164522 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:07.164572 (+ 50us) server_negotiation.cc:299] Negotiation successful
0811 16:38:07.164592 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 16:38:07.164697 6910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:07.162374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.195:39585 (local address 127.24.175.193:34239)
0811 16:38:07.162548 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:07.162557 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:07.162609 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:07.162719 (+ 110us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:07.162720 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:07.162721 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 16:38:07.162791 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:07.162792 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:07.163357 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:07.163357 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:07.163964 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:07.163967 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:07.164304 (+ 337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:07.164305 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:07.164366 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:07.164381 (+ 15us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 16:38:07.164530 (+ 149us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 16:38:07.164532 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 16:38:07.164571 (+ 39us) client_negotiation.cc:240] Negotiation successful
0811 16:38:07.164607 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":80,"threads_started":1}
I20260811 16:38:07.166782 6466 raft_consensus.cc:1261] T 29a8d266e88c40c1a875545e4242a47e P ae5214c78bc64887ad236150e281400b [term 1 FOLLOWER]: Refusing update from remote peer 102e06f64abc4aa591d0697dce17c37d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:38:07.166924 6702 raft_consensus.cc:1261] T 29a8d266e88c40c1a875545e4242a47e P 6ba51a559bd64e4b95ac7a31b675868d [term 1 FOLLOWER]: Refusing update from remote peer 102e06f64abc4aa591d0697dce17c37d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:38:07.167120 6843 consensus_queue.cc:1035] T 29a8d266e88c40c1a875545e4242a47e P 102e06f64abc4aa591d0697dce17c37d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba51a559bd64e4b95ac7a31b675868d" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:38:07.167309 6879 consensus_queue.cc:1035] T 29a8d266e88c40c1a875545e4242a47e P 102e06f64abc4aa591d0697dce17c37d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae5214c78bc64887ad236150e281400b" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 40049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:38:07.175927 6827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:07.173383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.195:48981 (local address 127.24.175.193:39861)
0811 16:38:07.173427 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:07.173429 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:07.173511 (+ 82us) server_negotiation.cc:407] Connection header received
0811 16:38:07.173579 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:07.173580 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:07.173587 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:07.173624 (+ 37us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:38:07.173761 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:07.174268 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:07.175301 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:07.175481 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:07.175530 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:07.175698 (+ 168us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:38:07.175728 (+ 30us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:38:07.175768 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:07.175820 (+ 52us) server_negotiation.cc:299] Negotiation successful
0811 16:38:07.175853 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 16:38:07.175949 6919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:07.173308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.193:39861 (local address 127.24.175.195:48981)
0811 16:38:07.173456 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:07.173467 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:07.173525 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:07.173636 (+ 111us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:07.173637 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:07.173648 (+ 11us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 16:38:07.173704 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:07.173706 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:07.174326 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:07.174327 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:07.175230 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:07.175234 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:07.175551 (+ 317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:07.175551 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:07.175615 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:07.175631 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 16:38:07.175771 (+ 140us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 16:38:07.175772 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 16:38:07.175819 (+ 47us) client_negotiation.cc:240] Negotiation successful
0811 16:38:07.175860 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":78,"threads_started":1}
I20260811 16:38:07.184926 5927 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57866:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:38:07.185019 5927 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57866:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:38:07.185565 5927 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 045a6bde55b842b1a1bcede4c5b07c0c: Sending DeleteTablet for 3 replicas of tablet 29a8d266e88c40c1a875545e4242a47e
I20260811 16:38:07.185797 6671 tablet_service.cc:1514] Processing DeleteTablet for tablet 29a8d266e88c40c1a875545e4242a47e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:38:07 UTC) from {username='oryx', principal='oryx/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:58562
I20260811 16:38:07.185873 6174 tablet_service.cc:1514] Processing DeleteTablet for tablet 29a8d266e88c40c1a875545e4242a47e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:38:07 UTC) from {username='oryx', principal='oryx/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:56256
I20260811 16:38:07.185953 6869 tablet_replica.cc:330] T 29a8d266e88c40c1a875545e4242a47e P 6ba51a559bd64e4b95ac7a31b675868d: stopping tablet replica
I20260811 16:38:07.185998 6869 raft_consensus.cc:2229] T 29a8d266e88c40c1a875545e4242a47e P 6ba51a559bd64e4b95ac7a31b675868d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:38:07.186023 6869 raft_consensus.cc:2258] T 29a8d266e88c40c1a875545e4242a47e P 6ba51a559bd64e4b95ac7a31b675868d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:38:07.186079 6867 tablet_replica.cc:330] T 29a8d266e88c40c1a875545e4242a47e P 102e06f64abc4aa591d0697dce17c37d: stopping tablet replica
I20260811 16:38:07.186120 6867 raft_consensus.cc:2229] T 29a8d266e88c40c1a875545e4242a47e P 102e06f64abc4aa591d0697dce17c37d [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:38:07.186219 6867 raft_consensus.cc:2258] T 29a8d266e88c40c1a875545e4242a47e P 102e06f64abc4aa591d0697dce17c37d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:38:07.186441 6430 tablet_service.cc:1514] Processing DeleteTablet for tablet 29a8d266e88c40c1a875545e4242a47e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:38:07 UTC) from {username='oryx', principal='oryx/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:34386
I20260811 16:38:07.186522 6866 tablet_replica.cc:330] T 29a8d266e88c40c1a875545e4242a47e P ae5214c78bc64887ad236150e281400b: stopping tablet replica
I20260811 16:38:07.186558 6869 ts_tablet_manager.cc:1905] T 29a8d266e88c40c1a875545e4242a47e P 6ba51a559bd64e4b95ac7a31b675868d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:38:07.186573 6866 raft_consensus.cc:2229] T 29a8d266e88c40c1a875545e4242a47e P ae5214c78bc64887ad236150e281400b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:38:07.186605 6866 raft_consensus.cc:2258] T 29a8d266e88c40c1a875545e4242a47e P ae5214c78bc64887ad236150e281400b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:38:07.187994 6869 ts_tablet_manager.cc:1918] T 29a8d266e88c40c1a875545e4242a47e P 6ba51a559bd64e4b95ac7a31b675868d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 16:38:07.188026 6867 ts_tablet_manager.cc:1905] T 29a8d266e88c40c1a875545e4242a47e P 102e06f64abc4aa591d0697dce17c37d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:38:07.188051 6869 log.cc:1196] T 29a8d266e88c40c1a875545e4242a47e P 6ba51a559bd64e4b95ac7a31b675868d: Deleting WAL directory at /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/ts-2/wal/wals/29a8d266e88c40c1a875545e4242a47e
I20260811 16:38:07.188248 6869 ts_tablet_manager.cc:1939] T 29a8d266e88c40c1a875545e4242a47e P 6ba51a559bd64e4b95ac7a31b675868d: Deleting consensus metadata
I20260811 16:38:07.188519 5901 catalog_manager.cc:4841] TS 6ba51a559bd64e4b95ac7a31b675868d (127.24.175.195:39585): tablet 29a8d266e88c40c1a875545e4242a47e (table test-table [id=261ce61b504c4545a3622eddbdfc95c6]) successfully deleted
I20260811 16:38:07.189325 6867 ts_tablet_manager.cc:1918] T 29a8d266e88c40c1a875545e4242a47e P 102e06f64abc4aa591d0697dce17c37d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 16:38:07.189378 6867 log.cc:1196] T 29a8d266e88c40c1a875545e4242a47e P 102e06f64abc4aa591d0697dce17c37d: Deleting WAL directory at /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/ts-0/wal/wals/29a8d266e88c40c1a875545e4242a47e
I20260811 16:38:07.189558 6867 ts_tablet_manager.cc:1939] T 29a8d266e88c40c1a875545e4242a47e P 102e06f64abc4aa591d0697dce17c37d: Deleting consensus metadata
I20260811 16:38:07.189845 5902 catalog_manager.cc:4841] TS 102e06f64abc4aa591d0697dce17c37d (127.24.175.193:39861): tablet 29a8d266e88c40c1a875545e4242a47e (table test-table [id=261ce61b504c4545a3622eddbdfc95c6]) successfully deleted
I20260811 16:38:07.190001 6866 ts_tablet_manager.cc:1905] T 29a8d266e88c40c1a875545e4242a47e P ae5214c78bc64887ad236150e281400b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:38:07.191324 6866 ts_tablet_manager.cc:1918] T 29a8d266e88c40c1a875545e4242a47e P ae5214c78bc64887ad236150e281400b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 16:38:07.191368 6866 log.cc:1196] T 29a8d266e88c40c1a875545e4242a47e P ae5214c78bc64887ad236150e281400b: Deleting WAL directory at /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/ts-1/wal/wals/29a8d266e88c40c1a875545e4242a47e
I20260811 16:38:07.191524 6866 ts_tablet_manager.cc:1939] T 29a8d266e88c40c1a875545e4242a47e P ae5214c78bc64887ad236150e281400b: Deleting consensus metadata
I20260811 16:38:07.192948 5902 catalog_manager.cc:4841] TS ae5214c78bc64887ad236150e281400b (127.24.175.194:40049): tablet 29a8d266e88c40c1a875545e4242a47e (table test-table [id=261ce61b504c4545a3622eddbdfc95c6]) successfully deleted
Aug 11 16:38:07 dist-test-slave-zj8q krb5kdc[5849](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466287, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 16:38:07 dist-test-slave-zj8q krb5kdc[5849](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:38:07 dist-test-slave-zj8q krb5kdc[5849](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
W20260811 16:38:07.214691 6016 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:38:07.208549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57876 (local address 127.24.175.254:33029)
0811 16:38:07.208619 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:07.208621 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:07.208720 (+ 99us) server_negotiation.cc:407] Connection header received
0811 16:38:07.208802 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:07.208803 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:07.208815 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:07.208889 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:07.209585 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:07.210376 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:07.211402 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:07.211721 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:07.211783 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:07.214629 (+ 2846us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57876: BlockingRecv error: recv got EOF from 127.0.0.1:57876 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
Aug 11 16:38:07 dist-test-slave-zj8q krb5kdc[5849](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466287, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM
I20260811 16:38:07.229535 6016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:07.223042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57884 (local address 127.24.175.254:33029)
0811 16:38:07.223079 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:07.223082 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:07.223268 (+ 186us) server_negotiation.cc:407] Connection header received
0811 16:38:07.223332 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:07.223333 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:07.223342 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:07.223385 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:07.223828 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:07.224293 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:07.224951 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:07.225132 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:07.225193 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:07.227321 (+ 2128us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:38:07.227322 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:38:07.227323 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:38:07.227330 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:38:07.228582 (+ 1252us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:07.228875 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:07.228877 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:07.228877 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:07.228930 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:07.229089 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:07.229090 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:07.229090 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:07.229194 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:38:07.229281 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:07.229376 (+ 95us) server_negotiation.cc:299] Negotiation successful
0811 16:38:07.229448 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 16:38:07.230957 5927 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57884:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:38:07.231114 5927 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:38:07.232416 6671 tablet_service.cc:1467] Processing CreateTablet for tablet cd978ac165e845d68027acf3b221c36d (DEFAULT_TABLE table=test-table [id=03085afd0af246939cce301e7ba68b79]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:38:07.232498 6174 tablet_service.cc:1467] Processing CreateTablet for tablet cd978ac165e845d68027acf3b221c36d (DEFAULT_TABLE table=test-table [id=03085afd0af246939cce301e7ba68b79]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:38:07.232553 6671 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd978ac165e845d68027acf3b221c36d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:38:07.232599 6174 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd978ac165e845d68027acf3b221c36d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:38:07.233819 6830 tablet_bootstrap.cc:492] T cd978ac165e845d68027acf3b221c36d P 6ba51a559bd64e4b95ac7a31b675868d: Bootstrap starting.
I20260811 16:38:07.233866 6430 tablet_service.cc:1467] Processing CreateTablet for tablet cd978ac165e845d68027acf3b221c36d (DEFAULT_TABLE table=test-table [id=03085afd0af246939cce301e7ba68b79]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:38:07.233979 6430 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd978ac165e845d68027acf3b221c36d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:38:07.234210 6830 tablet_bootstrap.cc:654] T cd978ac165e845d68027acf3b221c36d P 6ba51a559bd64e4b95ac7a31b675868d: Neither blocks nor log segments found. Creating new log.
I20260811 16:38:07.235164 6832 tablet_bootstrap.cc:492] T cd978ac165e845d68027acf3b221c36d P ae5214c78bc64887ad236150e281400b: Bootstrap starting.
I20260811 16:38:07.235185 6835 tablet_bootstrap.cc:492] T cd978ac165e845d68027acf3b221c36d P 102e06f64abc4aa591d0697dce17c37d: Bootstrap starting.
I20260811 16:38:07.235522 6832 tablet_bootstrap.cc:654] T cd978ac165e845d68027acf3b221c36d P ae5214c78bc64887ad236150e281400b: Neither blocks nor log segments found. Creating new log.
I20260811 16:38:07.235569 6835 tablet_bootstrap.cc:654] T cd978ac165e845d68027acf3b221c36d P 102e06f64abc4aa591d0697dce17c37d: Neither blocks nor log segments found. Creating new log.
I20260811 16:38:07.236157 6835 tablet_bootstrap.cc:492] T cd978ac165e845d68027acf3b221c36d P 102e06f64abc4aa591d0697dce17c37d: No bootstrap required, opened a new log
I20260811 16:38:07.236207 6835 ts_tablet_manager.cc:1397] T cd978ac165e845d68027acf3b221c36d P 102e06f64abc4aa591d0697dce17c37d: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 16:38:07.236358 6835 raft_consensus.cc:348] T cd978ac165e845d68027acf3b221c36d P 102e06f64abc4aa591d0697dce17c37d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102e06f64abc4aa591d0697dce17c37d" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39861 } } peers { permanent_uuid: "ae5214c78bc64887ad236150e281400b" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 40049 } } peers { permanent_uuid: "6ba51a559bd64e4b95ac7a31b675868d" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39585 } }
I20260811 16:38:07.236429 6835 raft_consensus.cc:374] T cd978ac165e845d68027acf3b221c36d P 102e06f64abc4aa591d0697dce17c37d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:38:07.236449 6835 raft_consensus.cc:729] T cd978ac165e845d68027acf3b221c36d P 102e06f64abc4aa591d0697dce17c37d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 102e06f64abc4aa591d0697dce17c37d, State: Initialized, Role: FOLLOWER
I20260811 16:38:07.236491 6835 consensus_queue.cc:260] T cd978ac165e845d68027acf3b221c36d P 102e06f64abc4aa591d0697dce17c37d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102e06f64abc4aa591d0697dce17c37d" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39861 } } peers { permanent_uuid: "ae5214c78bc64887ad236150e281400b" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 40049 } } peers { permanent_uuid: "6ba51a559bd64e4b95ac7a31b675868d" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39585 } }
I20260811 16:38:07.236575 6835 ts_tablet_manager.cc:1428] T cd978ac165e845d68027acf3b221c36d P 102e06f64abc4aa591d0697dce17c37d: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:07.238598 6830 tablet_bootstrap.cc:492] T cd978ac165e845d68027acf3b221c36d P 6ba51a559bd64e4b95ac7a31b675868d: No bootstrap required, opened a new log
I20260811 16:38:07.238651 6830 ts_tablet_manager.cc:1397] T cd978ac165e845d68027acf3b221c36d P 6ba51a559bd64e4b95ac7a31b675868d: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20260811 16:38:07.238755 6832 tablet_bootstrap.cc:492] T cd978ac165e845d68027acf3b221c36d P ae5214c78bc64887ad236150e281400b: No bootstrap required, opened a new log
I20260811 16:38:07.238795 6832 ts_tablet_manager.cc:1397] T cd978ac165e845d68027acf3b221c36d P ae5214c78bc64887ad236150e281400b: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260811 16:38:07.238801 6830 raft_consensus.cc:348] T cd978ac165e845d68027acf3b221c36d P 6ba51a559bd64e4b95ac7a31b675868d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102e06f64abc4aa591d0697dce17c37d" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39861 } } peers { permanent_uuid: "ae5214c78bc64887ad236150e281400b" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 40049 } } peers { permanent_uuid: "6ba51a559bd64e4b95ac7a31b675868d" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39585 } }
I20260811 16:38:07.238920 6830 raft_consensus.cc:374] T cd978ac165e845d68027acf3b221c36d P 6ba51a559bd64e4b95ac7a31b675868d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:38:07.238893 6832 raft_consensus.cc:348] T cd978ac165e845d68027acf3b221c36d P ae5214c78bc64887ad236150e281400b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102e06f64abc4aa591d0697dce17c37d" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39861 } } peers { permanent_uuid: "ae5214c78bc64887ad236150e281400b" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 40049 } } peers { permanent_uuid: "6ba51a559bd64e4b95ac7a31b675868d" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39585 } }
I20260811 16:38:07.238943 6830 raft_consensus.cc:729] T cd978ac165e845d68027acf3b221c36d P 6ba51a559bd64e4b95ac7a31b675868d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba51a559bd64e4b95ac7a31b675868d, State: Initialized, Role: FOLLOWER
I20260811 16:38:07.238951 6832 raft_consensus.cc:374] T cd978ac165e845d68027acf3b221c36d P ae5214c78bc64887ad236150e281400b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:38:07.238969 6832 raft_consensus.cc:729] T cd978ac165e845d68027acf3b221c36d P ae5214c78bc64887ad236150e281400b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae5214c78bc64887ad236150e281400b, State: Initialized, Role: FOLLOWER
I20260811 16:38:07.238986 6830 consensus_queue.cc:260] T cd978ac165e845d68027acf3b221c36d P 6ba51a559bd64e4b95ac7a31b675868d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102e06f64abc4aa591d0697dce17c37d" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39861 } } peers { permanent_uuid: "ae5214c78bc64887ad236150e281400b" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 40049 } } peers { permanent_uuid: "6ba51a559bd64e4b95ac7a31b675868d" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39585 } }
I20260811 16:38:07.239004 6832 consensus_queue.cc:260] T cd978ac165e845d68027acf3b221c36d P ae5214c78bc64887ad236150e281400b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102e06f64abc4aa591d0697dce17c37d" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39861 } } peers { permanent_uuid: "ae5214c78bc64887ad236150e281400b" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 40049 } } peers { permanent_uuid: "6ba51a559bd64e4b95ac7a31b675868d" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39585 } }
I20260811 16:38:07.239086 6830 ts_tablet_manager.cc:1428] T cd978ac165e845d68027acf3b221c36d P 6ba51a559bd64e4b95ac7a31b675868d: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:07.239090 6832 ts_tablet_manager.cc:1428] T cd978ac165e845d68027acf3b221c36d P ae5214c78bc64887ad236150e281400b: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:07.317528 6843 raft_consensus.cc:482] T cd978ac165e845d68027acf3b221c36d P 102e06f64abc4aa591d0697dce17c37d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:38:07.317646 6843 raft_consensus.cc:504] T cd978ac165e845d68027acf3b221c36d P 102e06f64abc4aa591d0697dce17c37d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102e06f64abc4aa591d0697dce17c37d" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39861 } } peers { permanent_uuid: "ae5214c78bc64887ad236150e281400b" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 40049 } } peers { permanent_uuid: "6ba51a559bd64e4b95ac7a31b675868d" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39585 } }
I20260811 16:38:07.317812 6843 leader_election.cc:288] T cd978ac165e845d68027acf3b221c36d P 102e06f64abc4aa591d0697dce17c37d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae5214c78bc64887ad236150e281400b (127.24.175.194:40049), 6ba51a559bd64e4b95ac7a31b675868d (127.24.175.195:39585)
I20260811 16:38:07.317986 6702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd978ac165e845d68027acf3b221c36d" candidate_uuid: "102e06f64abc4aa591d0697dce17c37d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba51a559bd64e4b95ac7a31b675868d" is_pre_election: true
I20260811 16:38:07.318009 6466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd978ac165e845d68027acf3b221c36d" candidate_uuid: "102e06f64abc4aa591d0697dce17c37d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae5214c78bc64887ad236150e281400b" is_pre_election: true
I20260811 16:38:07.318097 6702 raft_consensus.cc:2454] T cd978ac165e845d68027acf3b221c36d P 6ba51a559bd64e4b95ac7a31b675868d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 102e06f64abc4aa591d0697dce17c37d in term 0.
I20260811 16:38:07.318097 6466 raft_consensus.cc:2454] T cd978ac165e845d68027acf3b221c36d P ae5214c78bc64887ad236150e281400b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 102e06f64abc4aa591d0697dce17c37d in term 0.
I20260811 16:38:07.318272 6092 leader_election.cc:302] T cd978ac165e845d68027acf3b221c36d P 102e06f64abc4aa591d0697dce17c37d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 102e06f64abc4aa591d0697dce17c37d, 6ba51a559bd64e4b95ac7a31b675868d; no voters:
I20260811 16:38:07.318382 6843 raft_consensus.cc:2781] T cd978ac165e845d68027acf3b221c36d P 102e06f64abc4aa591d0697dce17c37d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:38:07.318418 6843 raft_consensus.cc:482] T cd978ac165e845d68027acf3b221c36d P 102e06f64abc4aa591d0697dce17c37d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:38:07.318444 6843 raft_consensus.cc:3037] T cd978ac165e845d68027acf3b221c36d P 102e06f64abc4aa591d0697dce17c37d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:38:07.319101 6843 raft_consensus.cc:504] T cd978ac165e845d68027acf3b221c36d P 102e06f64abc4aa591d0697dce17c37d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102e06f64abc4aa591d0697dce17c37d" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39861 } } peers { permanent_uuid: "ae5214c78bc64887ad236150e281400b" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 40049 } } peers { permanent_uuid: "6ba51a559bd64e4b95ac7a31b675868d" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39585 } }
I20260811 16:38:07.319228 6843 leader_election.cc:288] T cd978ac165e845d68027acf3b221c36d P 102e06f64abc4aa591d0697dce17c37d [CANDIDATE]: Term 1 election: Requested vote from peers ae5214c78bc64887ad236150e281400b (127.24.175.194:40049), 6ba51a559bd64e4b95ac7a31b675868d (127.24.175.195:39585)
I20260811 16:38:07.319371 6466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd978ac165e845d68027acf3b221c36d" candidate_uuid: "102e06f64abc4aa591d0697dce17c37d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae5214c78bc64887ad236150e281400b"
I20260811 16:38:07.319449 6466 raft_consensus.cc:3037] T cd978ac165e845d68027acf3b221c36d P ae5214c78bc64887ad236150e281400b [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:38:07.319430 6702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd978ac165e845d68027acf3b221c36d" candidate_uuid: "102e06f64abc4aa591d0697dce17c37d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba51a559bd64e4b95ac7a31b675868d"
I20260811 16:38:07.319528 6702 raft_consensus.cc:3037] T cd978ac165e845d68027acf3b221c36d P 6ba51a559bd64e4b95ac7a31b675868d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:38:07.320060 6466 raft_consensus.cc:2454] T cd978ac165e845d68027acf3b221c36d P ae5214c78bc64887ad236150e281400b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 102e06f64abc4aa591d0697dce17c37d in term 1.
I20260811 16:38:07.320225 6093 leader_election.cc:302] T cd978ac165e845d68027acf3b221c36d P 102e06f64abc4aa591d0697dce17c37d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 102e06f64abc4aa591d0697dce17c37d, ae5214c78bc64887ad236150e281400b; no voters:
I20260811 16:38:07.320303 6843 raft_consensus.cc:2781] T cd978ac165e845d68027acf3b221c36d P 102e06f64abc4aa591d0697dce17c37d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:38:07.320344 6843 raft_consensus.cc:686] T cd978ac165e845d68027acf3b221c36d P 102e06f64abc4aa591d0697dce17c37d [term 1 LEADER]: Becoming Leader. State: Replica: 102e06f64abc4aa591d0697dce17c37d, State: Running, Role: LEADER
I20260811 16:38:07.320363 6702 raft_consensus.cc:2454] T cd978ac165e845d68027acf3b221c36d P 6ba51a559bd64e4b95ac7a31b675868d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 102e06f64abc4aa591d0697dce17c37d in term 1.
I20260811 16:38:07.320412 6843 consensus_queue.cc:237] T cd978ac165e845d68027acf3b221c36d P 102e06f64abc4aa591d0697dce17c37d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102e06f64abc4aa591d0697dce17c37d" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39861 } } peers { permanent_uuid: "ae5214c78bc64887ad236150e281400b" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 40049 } } peers { permanent_uuid: "6ba51a559bd64e4b95ac7a31b675868d" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39585 } }
I20260811 16:38:07.321004 5927 catalog_manager.cc:5495] T cd978ac165e845d68027acf3b221c36d P 102e06f64abc4aa591d0697dce17c37d reported cstate change: term changed from 0 to 1, leader changed from <none> to 102e06f64abc4aa591d0697dce17c37d (127.24.175.193). New cstate: current_term: 1 leader_uuid: "102e06f64abc4aa591d0697dce17c37d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102e06f64abc4aa591d0697dce17c37d" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39861 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae5214c78bc64887ad236150e281400b" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 40049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba51a559bd64e4b95ac7a31b675868d" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39585 } health_report { overall_health: UNKNOWN } } }
I20260811 16:38:07.331054 6827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:07.328639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56278 (local address 127.24.175.193:39861)
0811 16:38:07.328695 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:07.328697 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:07.328705 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:38:07.328775 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:07.328776 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:07.328785 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:07.328829 (+ 44us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:38:07.328950 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:07.329416 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:07.330513 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:07.330694 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:07.330740 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:07.330880 (+ 140us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:38:07.330904 (+ 24us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:38:07.330934 (+ 30us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:07.330982 (+ 48us) server_negotiation.cc:299] Negotiation successful
0811 16:38:07.331000 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 16:38:07.331796 6702 raft_consensus.cc:1261] T cd978ac165e845d68027acf3b221c36d P 6ba51a559bd64e4b95ac7a31b675868d [term 1 FOLLOWER]: Refusing update from remote peer 102e06f64abc4aa591d0697dce17c37d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:38:07.331806 6466 raft_consensus.cc:1261] T cd978ac165e845d68027acf3b221c36d P ae5214c78bc64887ad236150e281400b [term 1 FOLLOWER]: Refusing update from remote peer 102e06f64abc4aa591d0697dce17c37d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:38:07.332008 6843 consensus_queue.cc:1035] T cd978ac165e845d68027acf3b221c36d P 102e06f64abc4aa591d0697dce17c37d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba51a559bd64e4b95ac7a31b675868d" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:38:07.332134 6916 consensus_queue.cc:1035] T cd978ac165e845d68027acf3b221c36d P 102e06f64abc4aa591d0697dce17c37d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae5214c78bc64887ad236150e281400b" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 40049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:38:07.334434 5927 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57884:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:38:07.334534 5927 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57884:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:38:07.335206 5927 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 045a6bde55b842b1a1bcede4c5b07c0c: Sending DeleteTablet for 3 replicas of tablet cd978ac165e845d68027acf3b221c36d
I20260811 16:38:07.335587 6671 tablet_service.cc:1514] Processing DeleteTablet for tablet cd978ac165e845d68027acf3b221c36d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:38:07 UTC) from {username='oryx', principal='oryx/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:58562
I20260811 16:38:07.335593 6430 tablet_service.cc:1514] Processing DeleteTablet for tablet cd978ac165e845d68027acf3b221c36d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:38:07 UTC) from {username='oryx', principal='oryx/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:34386
I20260811 16:38:07.335605 6427 tablet_service.cc:1514] Processing DeleteTablet for tablet cd978ac165e845d68027acf3b221c36d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:38:07 UTC) from {username='oryx', principal='oryx/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:34386
I20260811 16:38:07.335784 6869 tablet_replica.cc:330] T cd978ac165e845d68027acf3b221c36d P 6ba51a559bd64e4b95ac7a31b675868d: stopping tablet replica
I20260811 16:38:07.335681 6866 tablet_replica.cc:330] T cd978ac165e845d68027acf3b221c36d P ae5214c78bc64887ad236150e281400b: stopping tablet replica
I20260811 16:38:07.335844 6869 raft_consensus.cc:2229] T cd978ac165e845d68027acf3b221c36d P 6ba51a559bd64e4b95ac7a31b675868d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:38:07.335867 6866 raft_consensus.cc:2229] T cd978ac165e845d68027acf3b221c36d P ae5214c78bc64887ad236150e281400b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:38:07.335883 6869 raft_consensus.cc:2258] T cd978ac165e845d68027acf3b221c36d P 6ba51a559bd64e4b95ac7a31b675868d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:38:07.335913 6866 raft_consensus.cc:2258] T cd978ac165e845d68027acf3b221c36d P ae5214c78bc64887ad236150e281400b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:38:07.336174 6174 tablet_service.cc:1514] Processing DeleteTablet for tablet cd978ac165e845d68027acf3b221c36d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:38:07 UTC) from {username='oryx', principal='oryx/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:56256
I20260811 16:38:07.336248 6867 tablet_replica.cc:330] T cd978ac165e845d68027acf3b221c36d P 102e06f64abc4aa591d0697dce17c37d: stopping tablet replica
I20260811 16:38:07.336270 6869 ts_tablet_manager.cc:1905] T cd978ac165e845d68027acf3b221c36d P 6ba51a559bd64e4b95ac7a31b675868d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:38:07.336287 6867 raft_consensus.cc:2229] T cd978ac165e845d68027acf3b221c36d P 102e06f64abc4aa591d0697dce17c37d [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:38:07.336335 6867 raft_consensus.cc:2258] T cd978ac165e845d68027acf3b221c36d P 102e06f64abc4aa591d0697dce17c37d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:38:07.336604 6867 ts_tablet_manager.cc:1905] T cd978ac165e845d68027acf3b221c36d P 102e06f64abc4aa591d0697dce17c37d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:38:07.337756 6869 ts_tablet_manager.cc:1918] T cd978ac165e845d68027acf3b221c36d P 6ba51a559bd64e4b95ac7a31b675868d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:38:07.337824 6869 log.cc:1196] T cd978ac165e845d68027acf3b221c36d P 6ba51a559bd64e4b95ac7a31b675868d: Deleting WAL directory at /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/ts-2/wal/wals/cd978ac165e845d68027acf3b221c36d
I20260811 16:38:07.337988 6867 ts_tablet_manager.cc:1918] T cd978ac165e845d68027acf3b221c36d P 102e06f64abc4aa591d0697dce17c37d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:38:07.338021 6869 ts_tablet_manager.cc:1939] T cd978ac165e845d68027acf3b221c36d P 6ba51a559bd64e4b95ac7a31b675868d: Deleting consensus metadata
I20260811 16:38:07.338047 6867 log.cc:1196] T cd978ac165e845d68027acf3b221c36d P 102e06f64abc4aa591d0697dce17c37d: Deleting WAL directory at /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/ts-0/wal/wals/cd978ac165e845d68027acf3b221c36d
I20260811 16:38:07.338232 6173 tablet_service.cc:1514] Processing DeleteTablet for tablet cd978ac165e845d68027acf3b221c36d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:38:07 UTC) from {username='oryx', principal='oryx/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:56256
I20260811 16:38:07.338253 6867 ts_tablet_manager.cc:1939] T cd978ac165e845d68027acf3b221c36d P 102e06f64abc4aa591d0697dce17c37d: Deleting consensus metadata
I20260811 16:38:07.338361 5901 catalog_manager.cc:4841] TS 6ba51a559bd64e4b95ac7a31b675868d (127.24.175.195:39585): tablet cd978ac165e845d68027acf3b221c36d (table test-table [id=03085afd0af246939cce301e7ba68b79]) successfully deleted
I20260811 16:38:07.338562 5902 catalog_manager.cc:4841] TS 102e06f64abc4aa591d0697dce17c37d (127.24.175.193:39861): tablet cd978ac165e845d68027acf3b221c36d (table test-table [id=03085afd0af246939cce301e7ba68b79]) successfully deleted
W20260811 16:38:07.338691 5902 catalog_manager.cc:4808] TS 102e06f64abc4aa591d0697dce17c37d (127.24.175.193:39861): delete failed for tablet cd978ac165e845d68027acf3b221c36d because the tablet was not found. No further retry: Not found: Tablet not found: cd978ac165e845d68027acf3b221c36d
I20260811 16:38:07.338706 5926 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57884:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:38:07.338861 5926 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:38:07.339174 6866 ts_tablet_manager.cc:1905] T cd978ac165e845d68027acf3b221c36d P ae5214c78bc64887ad236150e281400b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:38:07.340032 6671 tablet_service.cc:1467] Processing CreateTablet for tablet b3b7931720544594a518eba8b5fc3618 (DEFAULT_TABLE table=test-table [id=5401f9a6319c413ea9053c6a6ba46cf5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:38:07.340031 6173 tablet_service.cc:1467] Processing CreateTablet for tablet b3b7931720544594a518eba8b5fc3618 (DEFAULT_TABLE table=test-table [id=5401f9a6319c413ea9053c6a6ba46cf5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:38:07.340135 6671 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b3b7931720544594a518eba8b5fc3618. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:38:07.340159 6173 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b3b7931720544594a518eba8b5fc3618. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:38:07.340608 6866 ts_tablet_manager.cc:1918] T cd978ac165e845d68027acf3b221c36d P ae5214c78bc64887ad236150e281400b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:38:07.340659 6866 log.cc:1196] T cd978ac165e845d68027acf3b221c36d P ae5214c78bc64887ad236150e281400b: Deleting WAL directory at /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/ts-1/wal/wals/cd978ac165e845d68027acf3b221c36d
I20260811 16:38:07.340852 6866 ts_tablet_manager.cc:1939] T cd978ac165e845d68027acf3b221c36d P ae5214c78bc64887ad236150e281400b: Deleting consensus metadata
I20260811 16:38:07.341259 6830 tablet_bootstrap.cc:492] T b3b7931720544594a518eba8b5fc3618 P 6ba51a559bd64e4b95ac7a31b675868d: Bootstrap starting.
I20260811 16:38:07.341279 6427 tablet_service.cc:1467] Processing CreateTablet for tablet b3b7931720544594a518eba8b5fc3618 (DEFAULT_TABLE table=test-table [id=5401f9a6319c413ea9053c6a6ba46cf5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:38:07.341365 6427 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b3b7931720544594a518eba8b5fc3618. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:38:07.341544 6830 tablet_bootstrap.cc:654] T b3b7931720544594a518eba8b5fc3618 P 6ba51a559bd64e4b95ac7a31b675868d: Neither blocks nor log segments found. Creating new log.
I20260811 16:38:07.341799 6835 tablet_bootstrap.cc:492] T b3b7931720544594a518eba8b5fc3618 P 102e06f64abc4aa591d0697dce17c37d: Bootstrap starting.
I20260811 16:38:07.342072 6835 tablet_bootstrap.cc:654] T b3b7931720544594a518eba8b5fc3618 P 102e06f64abc4aa591d0697dce17c37d: Neither blocks nor log segments found. Creating new log.
I20260811 16:38:07.342485 6830 tablet_bootstrap.cc:492] T b3b7931720544594a518eba8b5fc3618 P 6ba51a559bd64e4b95ac7a31b675868d: No bootstrap required, opened a new log
I20260811 16:38:07.342542 6830 ts_tablet_manager.cc:1397] T b3b7931720544594a518eba8b5fc3618 P 6ba51a559bd64e4b95ac7a31b675868d: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 16:38:07.342650 6832 tablet_bootstrap.cc:492] T b3b7931720544594a518eba8b5fc3618 P ae5214c78bc64887ad236150e281400b: Bootstrap starting.
I20260811 16:38:07.342670 6830 raft_consensus.cc:348] T b3b7931720544594a518eba8b5fc3618 P 6ba51a559bd64e4b95ac7a31b675868d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102e06f64abc4aa591d0697dce17c37d" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39861 } } peers { permanent_uuid: "ae5214c78bc64887ad236150e281400b" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 40049 } } peers { permanent_uuid: "6ba51a559bd64e4b95ac7a31b675868d" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39585 } }
I20260811 16:38:07.342737 6830 raft_consensus.cc:374] T b3b7931720544594a518eba8b5fc3618 P 6ba51a559bd64e4b95ac7a31b675868d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:38:07.342756 6830 raft_consensus.cc:729] T b3b7931720544594a518eba8b5fc3618 P 6ba51a559bd64e4b95ac7a31b675868d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba51a559bd64e4b95ac7a31b675868d, State: Initialized, Role: FOLLOWER
I20260811 16:38:07.342752 5902 catalog_manager.cc:4841] TS ae5214c78bc64887ad236150e281400b (127.24.175.194:40049): tablet cd978ac165e845d68027acf3b221c36d (table test-table [id=03085afd0af246939cce301e7ba68b79]) successfully deleted
W20260811 16:38:07.342803 5902 catalog_manager.cc:4808] TS ae5214c78bc64887ad236150e281400b (127.24.175.194:40049): delete failed for tablet cd978ac165e845d68027acf3b221c36d because the tablet was not found. No further retry: Not found: Tablet not found: cd978ac165e845d68027acf3b221c36d
I20260811 16:38:07.342796 6830 consensus_queue.cc:260] T b3b7931720544594a518eba8b5fc3618 P 6ba51a559bd64e4b95ac7a31b675868d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102e06f64abc4aa591d0697dce17c37d" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39861 } } peers { permanent_uuid: "ae5214c78bc64887ad236150e281400b" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 40049 } } peers { permanent_uuid: "6ba51a559bd64e4b95ac7a31b675868d" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39585 } }
I20260811 16:38:07.342888 6830 ts_tablet_manager.cc:1428] T b3b7931720544594a518eba8b5fc3618 P 6ba51a559bd64e4b95ac7a31b675868d: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:07.342948 6832 tablet_bootstrap.cc:654] T b3b7931720544594a518eba8b5fc3618 P ae5214c78bc64887ad236150e281400b: Neither blocks nor log segments found. Creating new log.
I20260811 16:38:07.343510 6835 tablet_bootstrap.cc:492] T b3b7931720544594a518eba8b5fc3618 P 102e06f64abc4aa591d0697dce17c37d: No bootstrap required, opened a new log
I20260811 16:38:07.343549 6835 ts_tablet_manager.cc:1397] T b3b7931720544594a518eba8b5fc3618 P 102e06f64abc4aa591d0697dce17c37d: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 16:38:07.343619 6835 raft_consensus.cc:348] T b3b7931720544594a518eba8b5fc3618 P 102e06f64abc4aa591d0697dce17c37d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102e06f64abc4aa591d0697dce17c37d" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39861 } } peers { permanent_uuid: "ae5214c78bc64887ad236150e281400b" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 40049 } } peers { permanent_uuid: "6ba51a559bd64e4b95ac7a31b675868d" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39585 } }
I20260811 16:38:07.343669 6835 raft_consensus.cc:374] T b3b7931720544594a518eba8b5fc3618 P 102e06f64abc4aa591d0697dce17c37d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:38:07.343680 6835 raft_consensus.cc:729] T b3b7931720544594a518eba8b5fc3618 P 102e06f64abc4aa591d0697dce17c37d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 102e06f64abc4aa591d0697dce17c37d, State: Initialized, Role: FOLLOWER
I20260811 16:38:07.343668 6832 tablet_bootstrap.cc:492] T b3b7931720544594a518eba8b5fc3618 P ae5214c78bc64887ad236150e281400b: No bootstrap required, opened a new log
I20260811 16:38:07.343708 6832 ts_tablet_manager.cc:1397] T b3b7931720544594a518eba8b5fc3618 P ae5214c78bc64887ad236150e281400b: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 16:38:07.343712 6835 consensus_queue.cc:260] T b3b7931720544594a518eba8b5fc3618 P 102e06f64abc4aa591d0697dce17c37d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102e06f64abc4aa591d0697dce17c37d" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39861 } } peers { permanent_uuid: "ae5214c78bc64887ad236150e281400b" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 40049 } } peers { permanent_uuid: "6ba51a559bd64e4b95ac7a31b675868d" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39585 } }
I20260811 16:38:07.343791 6835 ts_tablet_manager.cc:1428] T b3b7931720544594a518eba8b5fc3618 P 102e06f64abc4aa591d0697dce17c37d: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:07.343796 6832 raft_consensus.cc:348] T b3b7931720544594a518eba8b5fc3618 P ae5214c78bc64887ad236150e281400b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102e06f64abc4aa591d0697dce17c37d" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39861 } } peers { permanent_uuid: "ae5214c78bc64887ad236150e281400b" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 40049 } } peers { permanent_uuid: "6ba51a559bd64e4b95ac7a31b675868d" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39585 } }
I20260811 16:38:07.343854 6832 raft_consensus.cc:374] T b3b7931720544594a518eba8b5fc3618 P ae5214c78bc64887ad236150e281400b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:38:07.343871 6832 raft_consensus.cc:729] T b3b7931720544594a518eba8b5fc3618 P ae5214c78bc64887ad236150e281400b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae5214c78bc64887ad236150e281400b, State: Initialized, Role: FOLLOWER
I20260811 16:38:07.343914 6832 consensus_queue.cc:260] T b3b7931720544594a518eba8b5fc3618 P ae5214c78bc64887ad236150e281400b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102e06f64abc4aa591d0697dce17c37d" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39861 } } peers { permanent_uuid: "ae5214c78bc64887ad236150e281400b" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 40049 } } peers { permanent_uuid: "6ba51a559bd64e4b95ac7a31b675868d" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39585 } }
I20260811 16:38:07.343991 6832 ts_tablet_manager.cc:1428] T b3b7931720544594a518eba8b5fc3618 P ae5214c78bc64887ad236150e281400b: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:07.437433 6879 raft_consensus.cc:482] T b3b7931720544594a518eba8b5fc3618 P 102e06f64abc4aa591d0697dce17c37d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:38:07.437531 6879 raft_consensus.cc:504] T b3b7931720544594a518eba8b5fc3618 P 102e06f64abc4aa591d0697dce17c37d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102e06f64abc4aa591d0697dce17c37d" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39861 } } peers { permanent_uuid: "ae5214c78bc64887ad236150e281400b" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 40049 } } peers { permanent_uuid: "6ba51a559bd64e4b95ac7a31b675868d" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39585 } }
I20260811 16:38:07.437690 6879 leader_election.cc:288] T b3b7931720544594a518eba8b5fc3618 P 102e06f64abc4aa591d0697dce17c37d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae5214c78bc64887ad236150e281400b (127.24.175.194:40049), 6ba51a559bd64e4b95ac7a31b675868d (127.24.175.195:39585)
I20260811 16:38:07.437870 6466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3b7931720544594a518eba8b5fc3618" candidate_uuid: "102e06f64abc4aa591d0697dce17c37d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae5214c78bc64887ad236150e281400b" is_pre_election: true
I20260811 16:38:07.437875 6702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3b7931720544594a518eba8b5fc3618" candidate_uuid: "102e06f64abc4aa591d0697dce17c37d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba51a559bd64e4b95ac7a31b675868d" is_pre_election: true
I20260811 16:38:07.437956 6466 raft_consensus.cc:2454] T b3b7931720544594a518eba8b5fc3618 P ae5214c78bc64887ad236150e281400b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 102e06f64abc4aa591d0697dce17c37d in term 0.
I20260811 16:38:07.437970 6702 raft_consensus.cc:2454] T b3b7931720544594a518eba8b5fc3618 P 6ba51a559bd64e4b95ac7a31b675868d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 102e06f64abc4aa591d0697dce17c37d in term 0.
I20260811 16:38:07.438129 6093 leader_election.cc:302] T b3b7931720544594a518eba8b5fc3618 P 102e06f64abc4aa591d0697dce17c37d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 102e06f64abc4aa591d0697dce17c37d, ae5214c78bc64887ad236150e281400b; no voters:
I20260811 16:38:07.438249 6879 raft_consensus.cc:2781] T b3b7931720544594a518eba8b5fc3618 P 102e06f64abc4aa591d0697dce17c37d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:38:07.438294 6879 raft_consensus.cc:482] T b3b7931720544594a518eba8b5fc3618 P 102e06f64abc4aa591d0697dce17c37d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:38:07.438308 6879 raft_consensus.cc:3037] T b3b7931720544594a518eba8b5fc3618 P 102e06f64abc4aa591d0697dce17c37d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:38:07.439023 6879 raft_consensus.cc:504] T b3b7931720544594a518eba8b5fc3618 P 102e06f64abc4aa591d0697dce17c37d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102e06f64abc4aa591d0697dce17c37d" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39861 } } peers { permanent_uuid: "ae5214c78bc64887ad236150e281400b" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 40049 } } peers { permanent_uuid: "6ba51a559bd64e4b95ac7a31b675868d" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39585 } }
I20260811 16:38:07.439195 6879 leader_election.cc:288] T b3b7931720544594a518eba8b5fc3618 P 102e06f64abc4aa591d0697dce17c37d [CANDIDATE]: Term 1 election: Requested vote from peers ae5214c78bc64887ad236150e281400b (127.24.175.194:40049), 6ba51a559bd64e4b95ac7a31b675868d (127.24.175.195:39585)
I20260811 16:38:07.439338 6702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3b7931720544594a518eba8b5fc3618" candidate_uuid: "102e06f64abc4aa591d0697dce17c37d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba51a559bd64e4b95ac7a31b675868d"
I20260811 16:38:07.439363 6466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3b7931720544594a518eba8b5fc3618" candidate_uuid: "102e06f64abc4aa591d0697dce17c37d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae5214c78bc64887ad236150e281400b"
I20260811 16:38:07.439407 6702 raft_consensus.cc:3037] T b3b7931720544594a518eba8b5fc3618 P 6ba51a559bd64e4b95ac7a31b675868d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:38:07.439429 6466 raft_consensus.cc:3037] T b3b7931720544594a518eba8b5fc3618 P ae5214c78bc64887ad236150e281400b [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:38:07.439996 6702 raft_consensus.cc:2454] T b3b7931720544594a518eba8b5fc3618 P 6ba51a559bd64e4b95ac7a31b675868d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 102e06f64abc4aa591d0697dce17c37d in term 1.
I20260811 16:38:07.440024 6466 raft_consensus.cc:2454] T b3b7931720544594a518eba8b5fc3618 P ae5214c78bc64887ad236150e281400b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 102e06f64abc4aa591d0697dce17c37d in term 1.
I20260811 16:38:07.440199 6093 leader_election.cc:302] T b3b7931720544594a518eba8b5fc3618 P 102e06f64abc4aa591d0697dce17c37d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 102e06f64abc4aa591d0697dce17c37d, ae5214c78bc64887ad236150e281400b; no voters:
I20260811 16:38:07.440305 6879 raft_consensus.cc:2781] T b3b7931720544594a518eba8b5fc3618 P 102e06f64abc4aa591d0697dce17c37d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:38:07.440371 6879 raft_consensus.cc:686] T b3b7931720544594a518eba8b5fc3618 P 102e06f64abc4aa591d0697dce17c37d [term 1 LEADER]: Becoming Leader. State: Replica: 102e06f64abc4aa591d0697dce17c37d, State: Running, Role: LEADER
I20260811 16:38:07.440421 6879 consensus_queue.cc:237] T b3b7931720544594a518eba8b5fc3618 P 102e06f64abc4aa591d0697dce17c37d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102e06f64abc4aa591d0697dce17c37d" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39861 } } peers { permanent_uuid: "ae5214c78bc64887ad236150e281400b" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 40049 } } peers { permanent_uuid: "6ba51a559bd64e4b95ac7a31b675868d" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39585 } }
I20260811 16:38:07.440974 5926 catalog_manager.cc:5495] T b3b7931720544594a518eba8b5fc3618 P 102e06f64abc4aa591d0697dce17c37d reported cstate change: term changed from 0 to 1, leader changed from <none> to 102e06f64abc4aa591d0697dce17c37d (127.24.175.193). New cstate: current_term: 1 leader_uuid: "102e06f64abc4aa591d0697dce17c37d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "102e06f64abc4aa591d0697dce17c37d" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 39861 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae5214c78bc64887ad236150e281400b" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 40049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ba51a559bd64e4b95ac7a31b675868d" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39585 } health_report { overall_health: UNKNOWN } } }
I20260811 16:38:07.461620 6702 raft_consensus.cc:1261] T b3b7931720544594a518eba8b5fc3618 P 6ba51a559bd64e4b95ac7a31b675868d [term 1 FOLLOWER]: Refusing update from remote peer 102e06f64abc4aa591d0697dce17c37d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:38:07.461632 6466 raft_consensus.cc:1261] T b3b7931720544594a518eba8b5fc3618 P ae5214c78bc64887ad236150e281400b [term 1 FOLLOWER]: Refusing update from remote peer 102e06f64abc4aa591d0697dce17c37d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:38:07.461862 6916 consensus_queue.cc:1035] T b3b7931720544594a518eba8b5fc3618 P 102e06f64abc4aa591d0697dce17c37d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae5214c78bc64887ad236150e281400b" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 40049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:38:07.461971 6879 consensus_queue.cc:1035] T b3b7931720544594a518eba8b5fc3618 P 102e06f64abc4aa591d0697dce17c37d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba51a559bd64e4b95ac7a31b675868d" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:38:07.471376 5927 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57884:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:38:07.471460 5927 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57884:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:38:07.472008 5927 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 045a6bde55b842b1a1bcede4c5b07c0c: Sending DeleteTablet for 3 replicas of tablet b3b7931720544594a518eba8b5fc3618
I20260811 16:38:07.472215 6173 tablet_service.cc:1514] Processing DeleteTablet for tablet b3b7931720544594a518eba8b5fc3618 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:38:07 UTC) from {username='oryx', principal='oryx/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:56256
I20260811 16:38:07.472231 6427 tablet_service.cc:1514] Processing DeleteTablet for tablet b3b7931720544594a518eba8b5fc3618 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:38:07 UTC) from {username='oryx', principal='oryx/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:34386
I20260811 16:38:07.472229 6671 tablet_service.cc:1514] Processing DeleteTablet for tablet b3b7931720544594a518eba8b5fc3618 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:38:07 UTC) from {username='oryx', principal='oryx/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:58562
I20260811 16:38:07.472304 6867 tablet_replica.cc:330] T b3b7931720544594a518eba8b5fc3618 P 102e06f64abc4aa591d0697dce17c37d: stopping tablet replica
I20260811 16:38:07.472303 6866 tablet_replica.cc:330] T b3b7931720544594a518eba8b5fc3618 P ae5214c78bc64887ad236150e281400b: stopping tablet replica
I20260811 16:38:07.472316 6869 tablet_replica.cc:330] T b3b7931720544594a518eba8b5fc3618 P 6ba51a559bd64e4b95ac7a31b675868d: stopping tablet replica
I20260811 16:38:07.472349 6867 raft_consensus.cc:2229] T b3b7931720544594a518eba8b5fc3618 P 102e06f64abc4aa591d0697dce17c37d [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:38:07.472352 6866 raft_consensus.cc:2229] T b3b7931720544594a518eba8b5fc3618 P ae5214c78bc64887ad236150e281400b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:38:07.472358 6869 raft_consensus.cc:2229] T b3b7931720544594a518eba8b5fc3618 P 6ba51a559bd64e4b95ac7a31b675868d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:38:07.472384 6866 raft_consensus.cc:2258] T b3b7931720544594a518eba8b5fc3618 P ae5214c78bc64887ad236150e281400b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:38:07.472386 6869 raft_consensus.cc:2258] T b3b7931720544594a518eba8b5fc3618 P 6ba51a559bd64e4b95ac7a31b675868d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:38:07.472402 6867 raft_consensus.cc:2258] T b3b7931720544594a518eba8b5fc3618 P 102e06f64abc4aa591d0697dce17c37d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:38:07.472690 6867 ts_tablet_manager.cc:1905] T b3b7931720544594a518eba8b5fc3618 P 102e06f64abc4aa591d0697dce17c37d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:38:07.472719 6869 ts_tablet_manager.cc:1905] T b3b7931720544594a518eba8b5fc3618 P 6ba51a559bd64e4b95ac7a31b675868d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:38:07.472735 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 6061
I20260811 16:38:07.479992 6869 ts_tablet_manager.cc:1918] T b3b7931720544594a518eba8b5fc3618 P 6ba51a559bd64e4b95ac7a31b675868d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 16:38:07.480036 6869 log.cc:1196] T b3b7931720544594a518eba8b5fc3618 P 6ba51a559bd64e4b95ac7a31b675868d: Deleting WAL directory at /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/ts-2/wal/wals/b3b7931720544594a518eba8b5fc3618
I20260811 16:38:07.480193 6869 ts_tablet_manager.cc:1939] T b3b7931720544594a518eba8b5fc3618 P 6ba51a559bd64e4b95ac7a31b675868d: Deleting consensus metadata
I20260811 16:38:07.480451 5901 catalog_manager.cc:4841] TS 6ba51a559bd64e4b95ac7a31b675868d (127.24.175.195:39585): tablet b3b7931720544594a518eba8b5fc3618 (table test-table [id=5401f9a6319c413ea9053c6a6ba46cf5]) successfully deleted
I20260811 16:38:07.482402 6866 ts_tablet_manager.cc:1905] T b3b7931720544594a518eba8b5fc3618 P ae5214c78bc64887ad236150e281400b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:38:07.483464 6866 ts_tablet_manager.cc:1918] T b3b7931720544594a518eba8b5fc3618 P ae5214c78bc64887ad236150e281400b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 16:38:07.483516 6866 log.cc:1196] T b3b7931720544594a518eba8b5fc3618 P ae5214c78bc64887ad236150e281400b: Deleting WAL directory at /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466249441839-25279-0/minicluster-data/ts-1/wal/wals/b3b7931720544594a518eba8b5fc3618
I20260811 16:38:07.483675 6866 ts_tablet_manager.cc:1939] T b3b7931720544594a518eba8b5fc3618 P ae5214c78bc64887ad236150e281400b: Deleting consensus metadata
I20260811 16:38:07.483951 5902 catalog_manager.cc:4841] TS ae5214c78bc64887ad236150e281400b (127.24.175.194:40049): tablet b3b7931720544594a518eba8b5fc3618 (table test-table [id=5401f9a6319c413ea9053c6a6ba46cf5]) successfully deleted
W20260811 16:38:07.487020 5902 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.24.175.193:39861 (error 108)
I20260811 16:38:07.487226 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 6307
I20260811 16:38:07.492615 6991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:07.487357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.193:39861 (local address 127.0.0.1:56290)
0811 16:38:07.492531 (+ 5174us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:07.492580 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.193:39861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":5156,"thread_start_us":41,"threads_started":1}
W20260811 16:38:07.492745 5902 catalog_manager.cc:4584] TS 102e06f64abc4aa591d0697dce17c37d (127.24.175.193:39861): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b3b7931720544594a518eba8b5fc3618: Network error: Client connection negotiation failed: client connection to 127.24.175.193:39861: connect: Connection refused (error 111)
I20260811 16:38:07.498211 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 6572
I20260811 16:38:07.507871 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 5871
2026-08-11T16:38:07Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (2869 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786466249441839-25279-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:38:07 dist-test-slave-zj8q krb5kdc[6995](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:38:07 dist-test-slave-zj8q krb5kdc[6995](info): set up 2 sockets
Aug 11 16:38:07 dist-test-slave-zj8q krb5kdc[6995](info): commencing operation
krb5kdc: starting...
W20260811 16:38:08.677421 25279 mini_kdc.cc:121] Time spent starting KDC: real 1.141s user 0.002s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Aug 11 16:38:08 dist-test-slave-zj8q krb5kdc[6995](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466288, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:38:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:38:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab.
Entry for principal kudu/127.24.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab.
I20260811 16:38:08.788695 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786466249441839-25279-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786466249441839-25279-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786466249441839-25279-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:42779
--webserver_interface=127.24.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:39981
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.175.254:42779
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:38:08.868999 7014 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:38:08.869189 7014 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:38:08.869208 7014 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:38:08.870293 7014 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:38:08.870324 7014 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:38:08.870337 7014 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:38:08.870348 7014 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:38:08.870362 7014 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:38:08.871763 7014 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:39981
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786466249441839-25279-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786466249441839-25279-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.175.254:42779
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:42779
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7014
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786466249441839-25279-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:38:08.871948 7014 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:38:08.872112 7014 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:38:08.876689 7028 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:38:08.876677 7022 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:38:08.876677 7021 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:38:08.876873 7014 server_base.cc:1034] running on GCE node
I20260811 16:38:08.877177 7014 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:38:08.877482 7014 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:38:08.878609 7014 hybrid_clock.cc:648] HybridClock initialized: now 1786466288878599 us; error 27 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-11T16:38:08Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1368 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:38:08 dist-test-slave-zj8q krb5kdc[7035](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:38:08 dist-test-slave-zj8q krb5kdc[7035](info): set up 2 sockets
Aug 11 16:38:08 dist-test-slave-zj8q krb5kdc[7035](info): commencing operation
krb5kdc: starting...
W20260811 16:38:10.042346 25279 mini_kdc.cc:121] Time spent starting KDC: real 1.137s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Aug 11 16:38:10 dist-test-slave-zj8q krb5kdc[7035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466290, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:38:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:38:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab.
Entry for principal kudu/127.24.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab.
I20260811 16:38:10.154484 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:44597
--webserver_interface=127.24.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:40167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.175.254:44597
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:38:10.235608 7053 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:38:10.235812 7053 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:38:10.235833 7053 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:38:10.236987 7053 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:38:10.237031 7053 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:38:10.237044 7053 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:38:10.237067 7053 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:38:10.237083 7053 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:38:10.238659 7053 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:40167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.175.254:44597
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:44597
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7053
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:38:10.238888 7053 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:38:10.239109 7053 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:38:10.243932 7068 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:38:10.244055 7053 server_base.cc:1034] running on GCE node
W20260811 16:38:10.244014 7064 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:38:10.243958 7062 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:38:10.244421 7053 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:38:10.244735 7053 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:38:10.245893 7053 hybrid_clock.cc:648] HybridClock initialized: now 1786466290245873 us; error 34 us; skew 500 ppm
Aug 11 16:38:10 dist-test-slave-zj8q krb5kdc[7035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466290, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:38:10.248379 7053 init.cc:377] Logged in from keytab as kudu/127.24.175.254@KRBTEST.COM (short username kudu)
I20260811 16:38:10.248809 7053 webserver.cc:460] Webserver started at http://127.24.175.254:36757/ using document root <none> and password file <none>
I20260811 16:38:10.249034 7053 fs_manager.cc:359] Metadata directory not provided
I20260811 16:38:10.249092 7053 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:38:10.249221 7053 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:38:10.250312 7053 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/master-0/data/instance:
uuid: "c2f8be7883d74a3992f8b745fe51477c"
format_stamp: "Formatted at 2026-08-11 16:38:10 on dist-test-slave-zj8q"
server_key: "da79fb67e10a20d85d34bf86c2486609"
server_key_iv: "69da94345fc6a4cf62dd54a9d8a68e63"
server_key_version: "encryptionkey@0"
I20260811 16:38:10.250638 7053 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/master-0/wal/instance:
uuid: "c2f8be7883d74a3992f8b745fe51477c"
format_stamp: "Formatted at 2026-08-11 16:38:10 on dist-test-slave-zj8q"
server_key: "da79fb67e10a20d85d34bf86c2486609"
server_key_iv: "69da94345fc6a4cf62dd54a9d8a68e63"
server_key_version: "encryptionkey@0"
I20260811 16:38:10.251858 7053 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:38:10.252517 7085 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:10.252667 7053 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:38:10.252754 7053 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/master-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/master-0/wal
uuid: "c2f8be7883d74a3992f8b745fe51477c"
format_stamp: "Formatted at 2026-08-11 16:38:10 on dist-test-slave-zj8q"
server_key: "da79fb67e10a20d85d34bf86c2486609"
server_key_iv: "69da94345fc6a4cf62dd54a9d8a68e63"
server_key_version: "encryptionkey@0"
I20260811 16:38:10.252817 7053 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:38:10.265552 7053 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:38:10.267225 7053 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:38:10.267355 7053 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:38:10.271157 7053 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.254:44597
I20260811 16:38:10.271190 7174 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.254:44597 every 8 connection(s)
I20260811 16:38:10.271488 7053 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
I20260811 16:38:10.272300 7175 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:38:10.274585 7175 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2f8be7883d74a3992f8b745fe51477c: Bootstrap starting.
I20260811 16:38:10.275116 7175 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c2f8be7883d74a3992f8b745fe51477c: Neither blocks nor log segments found. Creating new log.
I20260811 16:38:10.275404 7175 log.cc:824] T 00000000000000000000000000000000 P c2f8be7883d74a3992f8b745fe51477c: Log is configured to *not* fsync() on all Append() calls
I20260811 16:38:10.276013 7175 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2f8be7883d74a3992f8b745fe51477c: No bootstrap required, opened a new log
I20260811 16:38:10.277647 7175 raft_consensus.cc:348] T 00000000000000000000000000000000 P c2f8be7883d74a3992f8b745fe51477c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2f8be7883d74a3992f8b745fe51477c" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 44597 } }
I20260811 16:38:10.277783 7175 raft_consensus.cc:374] T 00000000000000000000000000000000 P c2f8be7883d74a3992f8b745fe51477c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:38:10.277804 7175 raft_consensus.cc:729] T 00000000000000000000000000000000 P c2f8be7883d74a3992f8b745fe51477c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2f8be7883d74a3992f8b745fe51477c, State: Initialized, Role: FOLLOWER
I20260811 16:38:10.277937 7175 consensus_queue.cc:260] T 00000000000000000000000000000000 P c2f8be7883d74a3992f8b745fe51477c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2f8be7883d74a3992f8b745fe51477c" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 44597 } }
I20260811 16:38:10.277999 7175 raft_consensus.cc:388] T 00000000000000000000000000000000 P c2f8be7883d74a3992f8b745fe51477c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:38:10.278019 7175 raft_consensus.cc:482] T 00000000000000000000000000000000 P c2f8be7883d74a3992f8b745fe51477c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:38:10.278047 7175 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c2f8be7883d74a3992f8b745fe51477c [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:38:10.278611 7175 raft_consensus.cc:504] T 00000000000000000000000000000000 P c2f8be7883d74a3992f8b745fe51477c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2f8be7883d74a3992f8b745fe51477c" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 44597 } }
I20260811 16:38:10.278728 7175 leader_election.cc:302] T 00000000000000000000000000000000 P c2f8be7883d74a3992f8b745fe51477c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c2f8be7883d74a3992f8b745fe51477c; no voters:
I20260811 16:38:10.278854 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 7053
I20260811 16:38:10.278878 7175 leader_election.cc:288] T 00000000000000000000000000000000 P c2f8be7883d74a3992f8b745fe51477c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:38:10.278916 7180 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c2f8be7883d74a3992f8b745fe51477c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:38:10.278949 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/master-0/wal/instance
I20260811 16:38:10.279134 25279 external_mini_cluster.cc:1428] Setting key f053d14dcb200af2771e95ace8624c23
I20260811 16:38:10.279127 7175 sys_catalog.cc:564] T 00000000000000000000000000000000 P c2f8be7883d74a3992f8b745fe51477c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:38:10.279266 7180 raft_consensus.cc:686] T 00000000000000000000000000000000 P c2f8be7883d74a3992f8b745fe51477c [term 1 LEADER]: Becoming Leader. State: Replica: c2f8be7883d74a3992f8b745fe51477c, State: Running, Role: LEADER
I20260811 16:38:10.279392 7180 consensus_queue.cc:237] T 00000000000000000000000000000000 P c2f8be7883d74a3992f8b745fe51477c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2f8be7883d74a3992f8b745fe51477c" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 44597 } }
I20260811 16:38:10.279722 7183 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2f8be7883d74a3992f8b745fe51477c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c2f8be7883d74a3992f8b745fe51477c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2f8be7883d74a3992f8b745fe51477c" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 44597 } } }
I20260811 16:38:10.279800 7183 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2f8be7883d74a3992f8b745fe51477c [sys.catalog]: This master's current role is: LEADER
I20260811 16:38:10.279945 7183 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2f8be7883d74a3992f8b745fe51477c [sys.catalog]: SysCatalogTable state changed. Reason: New leader c2f8be7883d74a3992f8b745fe51477c. Latest consensus state: current_term: 1 leader_uuid: "c2f8be7883d74a3992f8b745fe51477c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2f8be7883d74a3992f8b745fe51477c" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 44597 } } }
I20260811 16:38:10.280052 7183 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2f8be7883d74a3992f8b745fe51477c [sys.catalog]: This master's current role is: LEADER
I20260811 16:38:10.280422 7190 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:38:10.280927 7190 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:38:10.282630 7190 catalog_manager.cc:1347] Generated new cluster ID: cb731c7456bd44aea4f29521953d7304
I20260811 16:38:10.282687 7190 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 16:38:10 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466290, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:38:10.290226 7189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:10.279733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45516 (local address 127.24.175.254:44597)
0811 16:38:10.279937 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:10.279946 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:10.279978 (+ 32us) server_negotiation.cc:407] Connection header received
0811 16:38:10.280089 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:10.280096 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:10.280151 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:10.281110 (+ 959us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:10.281205 (+ 95us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:10.282389 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:10.283428 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:10.284048 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:10.284409 (+ 361us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:10.286814 (+ 2405us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:38:10.286818 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:38:10.286818 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:38:10.286830 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:38:10.288654 (+ 1824us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:10.289036 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:10.289043 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:10.289044 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:10.289139 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:10.289328 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:10.289329 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:10.289329 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:10.289603 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:38:10.289751 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:10.289857 (+ 106us) server_negotiation.cc:299] Negotiation successful
0811 16:38:10.289985 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":72,"threads_started":1}
I20260811 16:38:10.291606 7190 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:38:10.292055 7190 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:38:10.299752 7190 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c2f8be7883d74a3992f8b745fe51477c: Generated new TSK 0
I20260811 16:38:10.299909 7190 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.175.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab.
Entry for principal kudu/127.24.175.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab.
I20260811 16:38:10.326601 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.193:0
--local_ip_for_outbound_sockets=127.24.175.193
--webserver_interface=127.24.175.193
--webserver_port=0
--tserver_master_addrs=127.24.175.254:44597
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab
--principal=kudu/127.24.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:40167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:38:10.407389 7211 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:38:10.407589 7211 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:38:10.407612 7211 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:38:10.408666 7211 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:38:10.408700 7211 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:38:10.408725 7211 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.193
I20260811 16:38:10.410063 7211 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:40167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab
--principal=kudu/127.24.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.175.193
--webserver_port=0
--tserver_master_addrs=127.24.175.254:44597
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7211
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.193
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:38:10.410279 7211 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:38:10.410456 7211 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:38:10.415277 7226 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:38:10.415287 7220 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:38:10.415292 7221 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:38:10.415309 7211 server_base.cc:1034] running on GCE node
I20260811 16:38:10.415678 7211 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:38:10.415922 7211 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:38:10.417052 7211 hybrid_clock.cc:648] HybridClock initialized: now 1786466290417043 us; error 28 us; skew 500 ppm
Aug 11 16:38:10 dist-test-slave-zj8q krb5kdc[7035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466290, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:38:10.419502 7211 init.cc:377] Logged in from keytab as kudu/127.24.175.193@KRBTEST.COM (short username kudu)
I20260811 16:38:10.419868 7211 webserver.cc:460] Webserver started at http://127.24.175.193:46855/ using document root <none> and password file <none>
I20260811 16:38:10.420058 7211 fs_manager.cc:359] Metadata directory not provided
I20260811 16:38:10.420096 7211 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:38:10.420193 7211 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:38:10.421105 7211 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-0/data/instance:
uuid: "9292bac464c4479d95ad2065375b9f73"
format_stamp: "Formatted at 2026-08-11 16:38:10 on dist-test-slave-zj8q"
server_key: "766f3dda09941d8d863fa6fc06904855"
server_key_iv: "3e43390c26e04471187aa94c341cf275"
server_key_version: "encryptionkey@0"
I20260811 16:38:10.421401 7211 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-0/wal/instance:
uuid: "9292bac464c4479d95ad2065375b9f73"
format_stamp: "Formatted at 2026-08-11 16:38:10 on dist-test-slave-zj8q"
server_key: "766f3dda09941d8d863fa6fc06904855"
server_key_iv: "3e43390c26e04471187aa94c341cf275"
server_key_version: "encryptionkey@0"
I20260811 16:38:10.422578 7211 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260811 16:38:10.423237 7235 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:10.423388 7211 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:10.423462 7211 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-0/wal
uuid: "9292bac464c4479d95ad2065375b9f73"
format_stamp: "Formatted at 2026-08-11 16:38:10 on dist-test-slave-zj8q"
server_key: "766f3dda09941d8d863fa6fc06904855"
server_key_iv: "3e43390c26e04471187aa94c341cf275"
server_key_version: "encryptionkey@0"
I20260811 16:38:10.423524 7211 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:38:10.443645 7211 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:38:10.445677 7211 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:38:10.445808 7211 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:38:10.446014 7211 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:38:10.446336 7211 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:38:10.446372 7211 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:10.446400 7211 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:38:10.446424 7211 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:10.451879 7211 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.193:41353
I20260811 16:38:10.451925 7426 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.193:41353 every 8 connection(s)
I20260811 16:38:10.452217 7211 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
Aug 11 16:38:10 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466290, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.193@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:38:10.460384 7189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:10.452960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:43651 (local address 127.24.175.254:44597)
0811 16:38:10.453040 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:10.453043 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:10.453201 (+ 158us) server_negotiation.cc:407] Connection header received
0811 16:38:10.453648 (+ 447us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:10.453649 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:10.453663 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:10.453715 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:10.454599 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:10.455112 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:10.456096 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:10.456309 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:10.456364 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:10.458272 (+ 1908us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:38:10.458274 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:38:10.458274 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:38:10.458283 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:38:10.459342 (+ 1059us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:10.459670 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:10.459671 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:10.459671 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:10.459716 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:10.459889 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:10.459889 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:10.459889 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:10.459990 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:38:10.460035 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:10.460258 (+ 223us) server_negotiation.cc:299] Negotiation successful
0811 16:38:10.460320 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 16:38:10.460528 7437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:10.452928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:44597 (local address 127.24.175.193:43651)
0811 16:38:10.453090 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:10.453124 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:10.453574 (+ 450us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:10.453766 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:10.453770 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:10.454344 (+ 574us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:10.454527 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:10.454532 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:10.455185 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:10.455186 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:10.456024 (+ 838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:10.456026 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:10.456375 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:10.456376 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:10.456490 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:10.456879 (+ 389us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:10.456887 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:10.458185 (+ 1298us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:38:10.459406 (+ 1221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:10.459411 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:10.459413 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:10.459609 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:10.459758 (+ 149us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:10.459759 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:10.459759 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:10.459846 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:10.460032 (+ 186us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:38:10.460034 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:38:10.460157 (+ 123us) client_negotiation.cc:769] Sending connection context
0811 16:38:10.460231 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 16:38:10.460343 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":86,"threads_started":1}
I20260811 16:38:10.461009 7430 heartbeater.cc:347] Connected to a master server at 127.24.175.254:44597
I20260811 16:38:10.461095 7430 heartbeater.cc:464] Registering TS with master...
I20260811 16:38:10.461237 7430 heartbeater.cc:511] Master 127.24.175.254:44597 requested a full tablet report, sending...
I20260811 16:38:10.461606 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 7211
I20260811 16:38:10.461704 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-0/wal/instance
I20260811 16:38:10.461730 7109 ts_manager.cc:194] Registered new tserver with Master: 9292bac464c4479d95ad2065375b9f73 (127.24.175.193:41353)
I20260811 16:38:10.461895 25279 external_mini_cluster.cc:1428] Setting key 5c4517f023be37a7ac158cd62cba627f
I20260811 16:38:10.462446 7109 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.175.193@KRBTEST.COM'} at 127.24.175.193:43651
WARNING: no policy specified for kudu/127.24.175.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab.
Entry for principal kudu/127.24.175.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab.
I20260811 16:38:10.485965 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.194:0
--local_ip_for_outbound_sockets=127.24.175.194
--webserver_interface=127.24.175.194
--webserver_port=0
--tserver_master_addrs=127.24.175.254:44597
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab
--principal=kudu/127.24.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:40167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:38:10.565474 7447 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:38:10.565693 7447 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:38:10.565723 7447 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:38:10.566879 7447 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:38:10.566919 7447 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:38:10.566952 7447 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.194
I20260811 16:38:10.568392 7447 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:40167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab
--principal=kudu/127.24.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.175.194
--webserver_port=0
--tserver_master_addrs=127.24.175.254:44597
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7447
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.194
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:38:10.568624 7447 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:38:10.568825 7447 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:38:10.573611 7461 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:38:10.573601 7453 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:38:10.573697 7447 server_base.cc:1034] running on GCE node
W20260811 16:38:10.573611 7457 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:38:10.574020 7447 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:38:10.574295 7447 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:38:10.575464 7447 hybrid_clock.cc:648] HybridClock initialized: now 1786466290575447 us; error 30 us; skew 500 ppm
Aug 11 16:38:10 dist-test-slave-zj8q krb5kdc[7035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466290, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:38:10.577942 7447 init.cc:377] Logged in from keytab as kudu/127.24.175.194@KRBTEST.COM (short username kudu)
I20260811 16:38:10.578382 7447 webserver.cc:460] Webserver started at http://127.24.175.194:43319/ using document root <none> and password file <none>
I20260811 16:38:10.578573 7447 fs_manager.cc:359] Metadata directory not provided
I20260811 16:38:10.578614 7447 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:38:10.578723 7447 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:38:10.579746 7447 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-1/data/instance:
uuid: "5fd57787d4c54cd1960a23e619990533"
format_stamp: "Formatted at 2026-08-11 16:38:10 on dist-test-slave-zj8q"
server_key: "440dd29b96eb40be94f42e9858f56725"
server_key_iv: "565503d48bb98e3f945ba70a6c82e26c"
server_key_version: "encryptionkey@0"
I20260811 16:38:10.580111 7447 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-1/wal/instance:
uuid: "5fd57787d4c54cd1960a23e619990533"
format_stamp: "Formatted at 2026-08-11 16:38:10 on dist-test-slave-zj8q"
server_key: "440dd29b96eb40be94f42e9858f56725"
server_key_iv: "565503d48bb98e3f945ba70a6c82e26c"
server_key_version: "encryptionkey@0"
I20260811 16:38:10.581435 7447 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:38:10.582113 7471 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:10.582293 7447 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:38:10.582371 7447 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-1/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-1/wal
uuid: "5fd57787d4c54cd1960a23e619990533"
format_stamp: "Formatted at 2026-08-11 16:38:10 on dist-test-slave-zj8q"
server_key: "440dd29b96eb40be94f42e9858f56725"
server_key_iv: "565503d48bb98e3f945ba70a6c82e26c"
server_key_version: "encryptionkey@0"
I20260811 16:38:10.582422 7447 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:38:10.600418 7447 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:38:10.602104 7447 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:38:10.602268 7447 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:38:10.602478 7447 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:38:10.602772 7447 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:38:10.602805 7447 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:10.602828 7447 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:38:10.602850 7447 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:10.608186 7447 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.194:35291
I20260811 16:38:10.608237 7672 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.194:35291 every 8 connection(s)
I20260811 16:38:10.608525 7447 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
I20260811 16:38:10.610119 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 7447
I20260811 16:38:10.610226 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-1/wal/instance
I20260811 16:38:10.610399 25279 external_mini_cluster.cc:1428] Setting key 6e27f8b1bcc16a94bede04b272df4d0f
Aug 11 16:38:10 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466290, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.194@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:38:10.617508 7189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:10.609182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:49679 (local address 127.24.175.254:44597)
0811 16:38:10.609249 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:10.609251 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:10.609403 (+ 152us) server_negotiation.cc:407] Connection header received
0811 16:38:10.609900 (+ 497us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:10.609901 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:10.609915 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:10.609968 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:10.611033 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:10.611531 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:10.612619 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:10.612867 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:10.612924 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:10.615009 (+ 2085us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:38:10.615011 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:38:10.615011 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:38:10.615019 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:38:10.616218 (+ 1199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:10.616627 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:10.616628 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:10.616629 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:10.616685 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:10.616900 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:10.616901 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:10.616902 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:10.617009 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:38:10.617066 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:10.617331 (+ 265us) server_negotiation.cc:299] Negotiation successful
0811 16:38:10.617422 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 16:38:10.617645 7677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:10.609128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:44597 (local address 127.24.175.194:49679)
0811 16:38:10.609290 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:10.609324 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:10.609798 (+ 474us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:10.610037 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:10.610041 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:10.610685 (+ 644us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:10.610947 (+ 262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:10.610954 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:10.611613 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:10.611614 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:10.612529 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:10.612532 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:10.612945 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:10.612946 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:10.613085 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:10.613549 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:10.613560 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:10.614926 (+ 1366us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:38:10.616289 (+ 1363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:10.616296 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:10.616298 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:10.616558 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:10.616740 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:10.616741 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:10.616741 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:10.616845 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:10.617062 (+ 217us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:38:10.617069 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:38:10.617200 (+ 131us) client_negotiation.cc:769] Sending connection context
0811 16:38:10.617297 (+ 97us) client_negotiation.cc:240] Negotiation successful
0811 16:38:10.617444 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":80,"threads_started":1}
I20260811 16:38:10.618060 7674 heartbeater.cc:347] Connected to a master server at 127.24.175.254:44597
I20260811 16:38:10.618187 7674 heartbeater.cc:464] Registering TS with master...
I20260811 16:38:10.618377 7674 heartbeater.cc:511] Master 127.24.175.254:44597 requested a full tablet report, sending...
I20260811 16:38:10.618736 7109 ts_manager.cc:194] Registered new tserver with Master: 5fd57787d4c54cd1960a23e619990533 (127.24.175.194:35291)
I20260811 16:38:10.619086 7109 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.175.194@KRBTEST.COM'} at 127.24.175.194:49679
WARNING: no policy specified for kudu/127.24.175.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab.
Entry for principal kudu/127.24.175.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab.
I20260811 16:38:10.636113 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.195:0
--local_ip_for_outbound_sockets=127.24.175.195
--webserver_interface=127.24.175.195
--webserver_port=0
--tserver_master_addrs=127.24.175.254:44597
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab
--principal=kudu/127.24.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:40167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:38:10.717381 7685 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:38:10.717566 7685 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:38:10.717586 7685 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:38:10.718755 7685 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:38:10.718796 7685 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:38:10.718823 7685 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.195
I20260811 16:38:10.720237 7685 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:40167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab
--principal=kudu/127.24.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.175.195
--webserver_port=0
--tserver_master_addrs=127.24.175.254:44597
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7685
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.195
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:38:10.720458 7685 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:38:10.720654 7685 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:38:10.725293 7694 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:38:10.725358 7697 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:38:10.725278 7699 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:38:10.725459 7685 server_base.cc:1034] running on GCE node
I20260811 16:38:10.725658 7685 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:38:10.725874 7685 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:38:10.727006 7685 hybrid_clock.cc:648] HybridClock initialized: now 1786466290726991 us; error 29 us; skew 500 ppm
Aug 11 16:38:10 dist-test-slave-zj8q krb5kdc[7035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466290, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:38:10.729249 7685 init.cc:377] Logged in from keytab as kudu/127.24.175.195@KRBTEST.COM (short username kudu)
I20260811 16:38:10.729620 7685 webserver.cc:460] Webserver started at http://127.24.175.195:42807/ using document root <none> and password file <none>
I20260811 16:38:10.729820 7685 fs_manager.cc:359] Metadata directory not provided
I20260811 16:38:10.729867 7685 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:38:10.729987 7685 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:38:10.730994 7685 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-2/data/instance:
uuid: "d96d61a7b3c640c4ac76fc0f4e032d99"
format_stamp: "Formatted at 2026-08-11 16:38:10 on dist-test-slave-zj8q"
server_key: "e8dc630f54956c212eecf750b8eacedb"
server_key_iv: "230c8a2b4fba31499d71e3d1733e99dd"
server_key_version: "encryptionkey@0"
I20260811 16:38:10.731326 7685 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-2/wal/instance:
uuid: "d96d61a7b3c640c4ac76fc0f4e032d99"
format_stamp: "Formatted at 2026-08-11 16:38:10 on dist-test-slave-zj8q"
server_key: "e8dc630f54956c212eecf750b8eacedb"
server_key_iv: "230c8a2b4fba31499d71e3d1733e99dd"
server_key_version: "encryptionkey@0"
I20260811 16:38:10.732534 7685 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:38:10.733193 7710 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:10.733364 7685 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:38:10.733448 7685 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-2/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-2/wal
uuid: "d96d61a7b3c640c4ac76fc0f4e032d99"
format_stamp: "Formatted at 2026-08-11 16:38:10 on dist-test-slave-zj8q"
server_key: "e8dc630f54956c212eecf750b8eacedb"
server_key_iv: "230c8a2b4fba31499d71e3d1733e99dd"
server_key_version: "encryptionkey@0"
I20260811 16:38:10.733512 7685 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:38:10.743045 7685 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:38:10.744714 7685 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:38:10.744840 7685 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:38:10.745035 7685 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:38:10.745318 7685 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:38:10.745350 7685 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:10.745378 7685 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:38:10.745402 7685 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:10.750919 7685 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.195:41479
I20260811 16:38:10.750965 7910 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.195:41479 every 8 connection(s)
I20260811 16:38:10.751264 7685 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
Aug 11 16:38:10 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466290, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.195@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:38:10.759694 7189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:10.751901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.195:56311 (local address 127.24.175.254:44597)
0811 16:38:10.751979 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:10.751982 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:10.752108 (+ 126us) server_negotiation.cc:407] Connection header received
0811 16:38:10.752622 (+ 514us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:10.752623 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:10.752633 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:10.752671 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:10.753551 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:10.754038 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:10.755085 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:10.755334 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:10.755384 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:10.757373 (+ 1989us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:38:10.757376 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:38:10.757376 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:38:10.757382 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:38:10.758601 (+ 1219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:10.758945 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:10.758946 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:10.758946 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:10.758995 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:10.759182 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:10.759182 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:10.759183 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:10.759283 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:38:10.759331 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:10.759535 (+ 204us) server_negotiation.cc:299] Negotiation successful
0811 16:38:10.759630 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 16:38:10.759819 7914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:10.751869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:44597 (local address 127.24.175.195:56311)
0811 16:38:10.752000 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:10.752035 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:10.752530 (+ 495us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:10.752732 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:10.752735 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:10.753295 (+ 560us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:10.753485 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:10.753491 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:10.754100 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:10.754101 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:10.755018 (+ 917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:10.755021 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:10.755396 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:10.755397 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:10.755498 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:10.755957 (+ 459us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:10.755965 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:10.757289 (+ 1324us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:38:10.758678 (+ 1389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:10.758684 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:10.758686 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:10.758890 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:10.759039 (+ 149us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:10.759039 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:10.759039 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:10.759128 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:10.759326 (+ 198us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:38:10.759328 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:38:10.759437 (+ 109us) client_negotiation.cc:769] Sending connection context
0811 16:38:10.759511 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 16:38:10.759626 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":67,"threads_started":1}
I20260811 16:38:10.760289 7911 heartbeater.cc:347] Connected to a master server at 127.24.175.254:44597
I20260811 16:38:10.760375 7911 heartbeater.cc:464] Registering TS with master...
I20260811 16:38:10.760516 7911 heartbeater.cc:511] Master 127.24.175.254:44597 requested a full tablet report, sending...
I20260811 16:38:10.760846 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 7685
I20260811 16:38:10.760905 7109 ts_manager.cc:194] Registered new tserver with Master: d96d61a7b3c640c4ac76fc0f4e032d99 (127.24.175.195:41479)
I20260811 16:38:10.760950 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-2/wal/instance
I20260811 16:38:10.761133 25279 external_mini_cluster.cc:1428] Setting key c2f649257ebf460b04c6dd7a92c0e4f1
I20260811 16:38:10.761300 7109 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.175.195@KRBTEST.COM'} at 127.24.175.195:56311
I20260811 16:38:10.761920 25279 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.24.175.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.24.175.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.24.175.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/krb5kdc/oryx_127.24.175.193.keytab.
Entry for principal oryx/127.24.175.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/krb5kdc/oryx_127.24.175.193.keytab.
WARNING: no policy specified for oryx/127.24.175.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.24.175.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.24.175.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/krb5kdc/oryx_127.24.175.194.keytab.
Entry for principal oryx/127.24.175.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/krb5kdc/oryx_127.24.175.194.keytab.
WARNING: no policy specified for oryx/127.24.175.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.24.175.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.24.175.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/krb5kdc/oryx_127.24.175.195.keytab.
Entry for principal oryx/127.24.175.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/krb5kdc/oryx_127.24.175.195.keytab.
I20260811 16:38:10.825985 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 7211
I20260811 16:38:10.836819 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 7447
I20260811 16:38:10.857775 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 7685
I20260811 16:38:10.867120 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 7053
I20260811 16:38:10.879266 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:44597
--webserver_interface=127.24.175.254
--webserver_port=36757
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:40167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.175.254:44597
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:38:10.959632 7924 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:38:10.959830 7924 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:38:10.959852 7924 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:38:10.960961 7924 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:38:10.961004 7924 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:38:10.961017 7924 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:38:10.961040 7924 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:38:10.961063 7924 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:38:10.962572 7924 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:40167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.175.254:44597
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:44597
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.175.254
--webserver_port=36757
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7924
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:38:10.962807 7924 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:38:10.963006 7924 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:38:10.967693 7934 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:38:10.967669 7937 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:38:10.967759 7935 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:38:10.967818 7924 server_base.cc:1034] running on GCE node
I20260811 16:38:10.968160 7924 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:38:10.968433 7924 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:38:10.969571 7924 hybrid_clock.cc:648] HybridClock initialized: now 1786466290969557 us; error 26 us; skew 500 ppm
Aug 11 16:38:10 dist-test-slave-zj8q krb5kdc[7035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466290, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:38:10.971936 7924 init.cc:377] Logged in from keytab as kudu/127.24.175.254@KRBTEST.COM (short username kudu)
I20260811 16:38:10.972368 7924 webserver.cc:460] Webserver started at http://127.24.175.254:36757/ using document root <none> and password file <none>
I20260811 16:38:10.972568 7924 fs_manager.cc:359] Metadata directory not provided
I20260811 16:38:10.972632 7924 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:38:10.973912 7924 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:38:10.974555 7947 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:10.974700 7924 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:10.974785 7924 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/master-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/master-0/wal
uuid: "c2f8be7883d74a3992f8b745fe51477c"
format_stamp: "Formatted at 2026-08-11 16:38:10 on dist-test-slave-zj8q"
server_key: "da79fb67e10a20d85d34bf86c2486609"
server_key_iv: "69da94345fc6a4cf62dd54a9d8a68e63"
server_key_version: "encryptionkey@0"
I20260811 16:38:10.975106 7924 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:38:10.989904 7924 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:38:10.991971 7924 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:38:10.992106 7924 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:38:10.995993 7924 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.254:44597
I20260811 16:38:10.996028 8038 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.254:44597 every 8 connection(s)
I20260811 16:38:10.996394 7924 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
I20260811 16:38:10.997797 8040 sys_catalog.cc:263] Verifying existing consensus state
I20260811 16:38:10.998400 8040 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2f8be7883d74a3992f8b745fe51477c: Bootstrap starting.
I20260811 16:38:11.003922 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 7924
I20260811 16:38:11.004261 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.193:41353
--local_ip_for_outbound_sockets=127.24.175.193
--tserver_master_addrs=127.24.175.254:44597
--webserver_port=46855
--webserver_interface=127.24.175.193
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab
--principal=kudu/127.24.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:40167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.24.175.193
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/krb5kdc/oryx_127.24.175.193.keytab with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 16:38:11.007442 8040 log.cc:824] T 00000000000000000000000000000000 P c2f8be7883d74a3992f8b745fe51477c: Log is configured to *not* fsync() on all Append() calls
I20260811 16:38:11.009063 8040 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2f8be7883d74a3992f8b745fe51477c: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:38:11.009323 8040 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2f8be7883d74a3992f8b745fe51477c: Bootstrap complete.
I20260811 16:38:11.011479 8040 raft_consensus.cc:348] T 00000000000000000000000000000000 P c2f8be7883d74a3992f8b745fe51477c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2f8be7883d74a3992f8b745fe51477c" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 44597 } }
I20260811 16:38:11.011694 8040 raft_consensus.cc:729] T 00000000000000000000000000000000 P c2f8be7883d74a3992f8b745fe51477c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2f8be7883d74a3992f8b745fe51477c, State: Initialized, Role: FOLLOWER
I20260811 16:38:11.011834 8040 consensus_queue.cc:260] T 00000000000000000000000000000000 P c2f8be7883d74a3992f8b745fe51477c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2f8be7883d74a3992f8b745fe51477c" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 44597 } }
I20260811 16:38:11.011907 8040 raft_consensus.cc:388] T 00000000000000000000000000000000 P c2f8be7883d74a3992f8b745fe51477c [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:38:11.011955 8040 raft_consensus.cc:482] T 00000000000000000000000000000000 P c2f8be7883d74a3992f8b745fe51477c [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:38:11.012001 8040 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c2f8be7883d74a3992f8b745fe51477c [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:38:11.013051 8040 raft_consensus.cc:504] T 00000000000000000000000000000000 P c2f8be7883d74a3992f8b745fe51477c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2f8be7883d74a3992f8b745fe51477c" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 44597 } }
I20260811 16:38:11.013160 8040 leader_election.cc:302] T 00000000000000000000000000000000 P c2f8be7883d74a3992f8b745fe51477c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c2f8be7883d74a3992f8b745fe51477c; no voters:
I20260811 16:38:11.013329 8040 leader_election.cc:288] T 00000000000000000000000000000000 P c2f8be7883d74a3992f8b745fe51477c [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 16:38:11.013383 8044 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c2f8be7883d74a3992f8b745fe51477c [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:38:11.013504 8044 raft_consensus.cc:686] T 00000000000000000000000000000000 P c2f8be7883d74a3992f8b745fe51477c [term 2 LEADER]: Becoming Leader. State: Replica: c2f8be7883d74a3992f8b745fe51477c, State: Running, Role: LEADER
I20260811 16:38:11.013594 8040 sys_catalog.cc:564] T 00000000000000000000000000000000 P c2f8be7883d74a3992f8b745fe51477c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:38:11.013589 8044 consensus_queue.cc:237] T 00000000000000000000000000000000 P c2f8be7883d74a3992f8b745fe51477c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2f8be7883d74a3992f8b745fe51477c" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 44597 } }
I20260811 16:38:11.013926 8046 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2f8be7883d74a3992f8b745fe51477c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "c2f8be7883d74a3992f8b745fe51477c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2f8be7883d74a3992f8b745fe51477c" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 44597 } } }
I20260811 16:38:11.014065 8046 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2f8be7883d74a3992f8b745fe51477c [sys.catalog]: This master's current role is: LEADER
I20260811 16:38:11.013934 8044 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2f8be7883d74a3992f8b745fe51477c [sys.catalog]: SysCatalogTable state changed. Reason: New leader c2f8be7883d74a3992f8b745fe51477c. Latest consensus state: current_term: 2 leader_uuid: "c2f8be7883d74a3992f8b745fe51477c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2f8be7883d74a3992f8b745fe51477c" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 44597 } } }
I20260811 16:38:11.014264 8044 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2f8be7883d74a3992f8b745fe51477c [sys.catalog]: This master's current role is: LEADER
I20260811 16:38:11.015374 8081 catalog_manager.cc:1259] Loaded cluster ID: cb731c7456bd44aea4f29521953d7304
I20260811 16:38:11.015460 8081 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c2f8be7883d74a3992f8b745fe51477c: loading cluster ID for follower catalog manager: success
I20260811 16:38:11.016618 8081 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c2f8be7883d74a3992f8b745fe51477c: acquiring CA information for follower catalog manager: success
I20260811 16:38:11.017005 8081 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c2f8be7883d74a3992f8b745fe51477c: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 16:38:11.017153 8061 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:38:11.017359 8061 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:38:11.017421 8061 catalog_manager.cc:1259] Loaded cluster ID: cb731c7456bd44aea4f29521953d7304
I20260811 16:38:11.017450 8061 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:38:11.017622 8061 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:38:11.017699 8061 catalog_manager.cc:5879] T 00000000000000000000000000000000 P c2f8be7883d74a3992f8b745fe51477c: Loaded TSK: 0
I20260811 16:38:11.017822 8061 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 16:38:11.087217 8042 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:38:11.087407 8042 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:38:11.087428 8042 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:38:11.088598 8042 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:38:11.088640 8042 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:38:11.088665 8042 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.193
I20260811 16:38:11.090073 8042 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:40167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/krb5kdc/oryx_127.24.175.193.keytab
--principal=oryx/127.24.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.193:41353
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.175.193
--webserver_port=46855
--tserver_master_addrs=127.24.175.254:44597
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8042
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.193
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:38:11.090294 8042 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:38:11.090517 8042 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:38:11.096372 8097 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:38:11.096387 8089 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:38:11.096395 8091 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:38:11.096633 8042 server_base.cc:1034] running on GCE node
I20260811 16:38:11.096865 8042 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:38:11.097096 8042 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:38:11.098228 8042 hybrid_clock.cc:648] HybridClock initialized: now 1786466291098214 us; error 26 us; skew 500 ppm
Aug 11 16:38:11 dist-test-slave-zj8q krb5kdc[7035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466291, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:38:11.100766 8042 init.cc:377] Logged in from keytab as oryx/127.24.175.193@KRBTEST.COM (short username oryx)
I20260811 16:38:11.101222 8042 webserver.cc:460] Webserver started at http://127.24.175.193:46855/ using document root <none> and password file <none>
I20260811 16:38:11.101449 8042 fs_manager.cc:359] Metadata directory not provided
I20260811 16:38:11.101516 8042 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:38:11.102923 8042 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.000s
I20260811 16:38:11.103523 8108 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:11.103689 8042 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:38:11.103772 8042 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-0/wal
uuid: "9292bac464c4479d95ad2065375b9f73"
format_stamp: "Formatted at 2026-08-11 16:38:10 on dist-test-slave-zj8q"
server_key: "766f3dda09941d8d863fa6fc06904855"
server_key_iv: "3e43390c26e04471187aa94c341cf275"
server_key_version: "encryptionkey@0"
I20260811 16:38:11.104077 8042 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:38:11.122473 8042 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:38:11.124529 8042 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:38:11.124673 8042 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:38:11.124886 8042 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:38:11.125298 8042 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:38:11.125348 8042 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:11.125382 8042 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:38:11.125398 8042 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:11.132136 8042 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.193:41353
I20260811 16:38:11.132206 8306 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.193:41353 every 8 connection(s)
I20260811 16:38:11.132519 8042 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
Aug 11 16:38:11 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.193@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:38:11 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.193@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:38:11.140475 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 8042
I20260811 16:38:11.140761 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.194:35291
--local_ip_for_outbound_sockets=127.24.175.194
--tserver_master_addrs=127.24.175.254:44597
--webserver_port=43319
--webserver_interface=127.24.175.194
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab
--principal=kudu/127.24.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:40167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.24.175.194
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/krb5kdc/oryx_127.24.175.194.keytab with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 16:38:11.141345 8311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:11.133181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:44597 (local address 127.24.175.193:54999)
0811 16:38:11.133361 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:11.133404 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:11.133993 (+ 589us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:11.134458 (+ 465us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:11.134462 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:11.135159 (+ 697us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:11.135408 (+ 249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:11.135413 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:11.136489 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:11.136490 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:11.137656 (+ 1166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:11.137659 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:11.138243 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:11.138244 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:11.138378 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:11.138834 (+ 456us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:11.138843 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:11.141145 (+ 2302us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.175.254:44597: Server oryx/127.24.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":89,"threads_started":1}
W20260811 16:38:11.141436 8312 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:38:11.133277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:54999 (local address 127.24.175.254:44597)
0811 16:38:11.133454 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:11.133462 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:11.133489 (+ 27us) server_negotiation.cc:407] Connection header received
0811 16:38:11.134220 (+ 731us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:11.134228 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:11.134279 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:11.134386 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:11.135542 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:11.136389 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:11.137731 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:11.138122 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:11.138265 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:11.141288 (+ 3023us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.175.193:54999: BlockingRecv error: recv got EOF from 127.24.175.193:54999 (error 108)
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":69,"threads_started":1}
W20260811 16:38:11.141623 8309 heartbeater.cc:644] Failed to heartbeat to 127.24.175.254:44597 (0 consecutive failures): Not authorized: Failed to ping master at 127.24.175.254:44597: Client connection negotiation failed: client connection to 127.24.175.254:44597: Server oryx/127.24.175.254@KRBTEST.COM not found in Kerberos database
Aug 11 16:38:11 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.193@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:38:11 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.193@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:38:11.145721 8311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:11.141819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:44597 (local address 127.24.175.193:52987)
0811 16:38:11.141869 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:11.141879 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:11.141912 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:11.142047 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:11.142047 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:11.142174 (+ 127us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:11.142225 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:11.142226 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:11.142812 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:11.142813 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:11.143302 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:11.143303 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:11.143612 (+ 309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:11.143613 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:11.143680 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:11.144014 (+ 334us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:11.144019 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:11.145662 (+ 1643us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.175.254:44597: Server oryx/127.24.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":36}
W20260811 16:38:11.145871 8312 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:38:11.141879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:52987 (local address 127.24.175.254:44597)
0811 16:38:11.141931 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:11.141933 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:11.141942 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:38:11.141964 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:11.141965 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:11.141977 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:11.142033 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:11.142291 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:11.142745 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:11.143370 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:11.143555 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:11.143606 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:11.145763 (+ 2157us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.175.193:52987: BlockingRecv error: recv got EOF from 127.24.175.193:52987 (error 108)
Metrics: {"server-negotiator.queue_time_us":29}
Aug 11 16:38:11 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.193@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:38:11 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.193@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:38:11.149662 8311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:11.145939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:44597 (local address 127.24.175.193:56781)
0811 16:38:11.146045 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:11.146054 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:11.146097 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:11.146219 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:11.146219 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:11.146331 (+ 112us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:11.146357 (+ 26us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:11.146358 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:11.146919 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:11.146919 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:11.147399 (+ 480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:11.147401 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:11.147703 (+ 302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:11.147704 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:11.147753 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:11.148067 (+ 314us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:11.148072 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:11.149608 (+ 1536us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.175.254:44597: Server oryx/127.24.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":92}
W20260811 16:38:11.149766 8312 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:38:11.146012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:56781 (local address 127.24.175.254:44597)
0811 16:38:11.146053 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:11.146055 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:11.146085 (+ 30us) server_negotiation.cc:407] Connection header received
0811 16:38:11.146140 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:11.146141 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:11.146170 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:11.146215 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:11.146418 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:11.146855 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:11.147465 (+ 610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:11.147640 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:11.147698 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:11.149713 (+ 2015us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.175.193:56781: BlockingRecv error: recv got EOF from 127.24.175.193:56781 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
W20260811 16:38:11.149762 8309 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 16:38:11.222913 8314 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:38:11.223098 8314 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:38:11.223120 8314 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:38:11.224190 8314 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:38:11.224224 8314 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:38:11.224249 8314 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.194
I20260811 16:38:11.225653 8314 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:40167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/krb5kdc/oryx_127.24.175.194.keytab
--principal=oryx/127.24.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.194:35291
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.175.194
--webserver_port=43319
--tserver_master_addrs=127.24.175.254:44597
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8314
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.194
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:38:11.225831 8314 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:38:11.225996 8314 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:38:11.230720 8323 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:38:11.230749 8329 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:38:11.230901 8314 server_base.cc:1034] running on GCE node
W20260811 16:38:11.230751 8326 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:38:11.231148 8314 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:38:11.231361 8314 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:38:11.232496 8314 hybrid_clock.cc:648] HybridClock initialized: now 1786466291232484 us; error 27 us; skew 500 ppm
Aug 11 16:38:11 dist-test-slave-zj8q krb5kdc[7035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466291, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:38:11.234889 8314 init.cc:377] Logged in from keytab as oryx/127.24.175.194@KRBTEST.COM (short username oryx)
I20260811 16:38:11.235281 8314 webserver.cc:460] Webserver started at http://127.24.175.194:43319/ using document root <none> and password file <none>
I20260811 16:38:11.235477 8314 fs_manager.cc:359] Metadata directory not provided
I20260811 16:38:11.235535 8314 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:38:11.236817 8314 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:38:11.237311 8342 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:11.237457 8314 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:38:11.237540 8314 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-1/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-1/wal
uuid: "5fd57787d4c54cd1960a23e619990533"
format_stamp: "Formatted at 2026-08-11 16:38:10 on dist-test-slave-zj8q"
server_key: "440dd29b96eb40be94f42e9858f56725"
server_key_iv: "565503d48bb98e3f945ba70a6c82e26c"
server_key_version: "encryptionkey@0"
I20260811 16:38:11.237843 8314 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:38:11.267625 8314 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:38:11.269409 8314 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:38:11.269552 8314 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:38:11.269786 8314 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:38:11.270092 8314 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:38:11.270126 8314 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:11.270187 8314 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:38:11.270207 8314 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:11.275549 8314 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.194:35291
I20260811 16:38:11.275609 8531 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.194:35291 every 8 connection(s)
I20260811 16:38:11.275928 8314 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
I20260811 16:38:11.276269 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 8314
I20260811 16:38:11.276535 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.195:41479
--local_ip_for_outbound_sockets=127.24.175.195
--tserver_master_addrs=127.24.175.254:44597
--webserver_port=42807
--webserver_interface=127.24.175.195
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab
--principal=kudu/127.24.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:40167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.24.175.195
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/krb5kdc/oryx_127.24.175.195.keytab with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 16:38:11 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.194@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:38:11 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.194@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
W20260811 16:38:11.284186 8312 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:38:11.276672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:53955 (local address 127.24.175.254:44597)
0811 16:38:11.276720 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:11.276722 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:11.276951 (+ 229us) server_negotiation.cc:407] Connection header received
0811 16:38:11.277550 (+ 599us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:11.277550 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:11.277566 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:11.277612 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:11.278812 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:11.279543 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:11.280894 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:11.281087 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:11.281134 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:11.284132 (+ 2998us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.175.194:53955: BlockingRecv error: recv got EOF from 127.24.175.194:53955 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 16:38:11.284242 8535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:11.276648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:44597 (local address 127.24.175.194:53955)
0811 16:38:11.276812 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:11.276859 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:11.277453 (+ 594us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:11.277709 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:11.277713 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:11.278517 (+ 804us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:11.278724 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:11.278729 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:11.279667 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:11.279668 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:11.280819 (+ 1151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:11.280823 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:11.281169 (+ 346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:11.281170 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:11.281317 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:11.281786 (+ 469us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:11.281798 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:11.284034 (+ 2236us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.175.254:44597: Server oryx/127.24.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":85,"threads_started":1}
W20260811 16:38:11.284507 8533 heartbeater.cc:644] Failed to heartbeat to 127.24.175.254:44597 (0 consecutive failures): Not authorized: Failed to ping master at 127.24.175.254:44597: Client connection negotiation failed: client connection to 127.24.175.254:44597: Server oryx/127.24.175.254@KRBTEST.COM not found in Kerberos database
Aug 11 16:38:11 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.194@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:38:11 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.194@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:38:11.288451 8535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:11.284721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:44597 (local address 127.24.175.194:50203)
0811 16:38:11.284762 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:11.284771 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:11.284805 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:11.284934 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:11.284935 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:11.285055 (+ 120us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:11.285095 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:11.285096 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:11.285690 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:11.285691 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:11.286220 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:11.286222 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:11.286532 (+ 310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:11.286533 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:11.286593 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:11.286938 (+ 345us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:11.286943 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:11.288393 (+ 1450us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.175.254:44597: Server oryx/127.24.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":24}
W20260811 16:38:11.288523 8312 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:38:11.284782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:50203 (local address 127.24.175.254:44597)
0811 16:38:11.284840 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:11.284842 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:11.284849 (+ 7us) server_negotiation.cc:407] Connection header received
0811 16:38:11.284870 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:11.284871 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:11.284880 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:11.284925 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:11.285160 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:11.285622 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:11.286294 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:11.286479 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:11.286528 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:11.288477 (+ 1949us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.175.194:50203: BlockingRecv error: recv got EOF from 127.24.175.194:50203 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
Aug 11 16:38:11 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.194@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:38:11 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.194@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:38:11.292452 8535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:11.288853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:44597 (local address 127.24.175.194:53855)
0811 16:38:11.288892 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:11.288901 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:11.288936 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:11.289043 (+ 107us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:11.289044 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:11.289164 (+ 120us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:11.289187 (+ 23us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:11.289188 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:11.289750 (+ 562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:11.289751 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:11.290277 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:11.290279 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:11.290569 (+ 290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:11.290570 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:11.290617 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:11.290928 (+ 311us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:11.290933 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:11.292397 (+ 1464us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.175.254:44597: Server oryx/127.24.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":24}
W20260811 16:38:11.292567 8312 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:38:11.288916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:53855 (local address 127.24.175.254:44597)
0811 16:38:11.288955 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:11.288957 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:11.288964 (+ 7us) server_negotiation.cc:407] Connection header received
0811 16:38:11.288982 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:11.288983 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:11.288991 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:11.289035 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:11.289246 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:11.289688 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:11.290349 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:11.290518 (+ 169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:11.290565 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:11.292473 (+ 1908us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.175.194:53855: BlockingRecv error: recv got EOF from 127.24.175.194:53855 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260811 16:38:11.292559 8533 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 16:38:11.359922 8537 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:38:11.360111 8537 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:38:11.360132 8537 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:38:11.361224 8537 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:38:11.361264 8537 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:38:11.361289 8537 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.195
I20260811 16:38:11.362728 8537 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:40167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/krb5kdc/oryx_127.24.175.195.keytab
--principal=oryx/127.24.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.195:41479
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.175.195
--webserver_port=42807
--tserver_master_addrs=127.24.175.254:44597
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8537
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.195
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:38:11.362947 8537 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:38:11.363142 8537 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:38:11.367911 8546 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:38:11.367971 8537 server_base.cc:1034] running on GCE node
W20260811 16:38:11.367923 8547 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:38:11.367921 8550 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:38:11.368283 8537 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:38:11.368520 8537 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:38:11.369666 8537 hybrid_clock.cc:648] HybridClock initialized: now 1786466291369649 us; error 31 us; skew 500 ppm
Aug 11 16:38:11 dist-test-slave-zj8q krb5kdc[7035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466291, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:38:11.371951 8537 init.cc:377] Logged in from keytab as oryx/127.24.175.195@KRBTEST.COM (short username oryx)
I20260811 16:38:11.372390 8537 webserver.cc:460] Webserver started at http://127.24.175.195:42807/ using document root <none> and password file <none>
I20260811 16:38:11.372635 8537 fs_manager.cc:359] Metadata directory not provided
I20260811 16:38:11.372699 8537 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:38:11.374115 8537 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:38:11.374804 8573 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:11.374945 8537 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:11.375031 8537 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-2/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-2/wal
uuid: "d96d61a7b3c640c4ac76fc0f4e032d99"
format_stamp: "Formatted at 2026-08-11 16:38:10 on dist-test-slave-zj8q"
server_key: "e8dc630f54956c212eecf750b8eacedb"
server_key_iv: "230c8a2b4fba31499d71e3d1733e99dd"
server_key_version: "encryptionkey@0"
I20260811 16:38:11.375357 8537 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:38:11.395051 8537 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:38:11.396679 8537 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:38:11.396809 8537 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:38:11.397001 8537 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:38:11.397277 8537 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:38:11.397311 8537 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:11.397341 8537 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:38:11.397357 8537 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:11.402750 8537 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.195:41479
I20260811 16:38:11.402788 8779 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.195:41479 every 8 connection(s)
I20260811 16:38:11.403101 8537 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
Aug 11 16:38:11 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.195@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:38:11 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.195@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
W20260811 16:38:11.409660 8312 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:38:11.403762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.195:33509 (local address 127.24.175.254:44597)
0811 16:38:11.403817 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:11.403819 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:11.404030 (+ 211us) server_negotiation.cc:407] Connection header received
0811 16:38:11.404468 (+ 438us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:11.404469 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:11.404479 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:11.404532 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:11.405378 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:11.405882 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:11.406871 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:11.407078 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:11.407124 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:11.409611 (+ 2487us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.175.195:33509: BlockingRecv error: recv got EOF from 127.24.175.195:33509 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 16:38:11.409688 8784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:11.403742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:44597 (local address 127.24.175.195:33509)
0811 16:38:11.403890 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:11.403932 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:11.404391 (+ 459us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:11.404584 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:11.404587 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:11.405124 (+ 537us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:11.405309 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:11.405314 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:11.405956 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:11.405957 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:11.406799 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:11.406801 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:11.407139 (+ 338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:11.407140 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:11.407249 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:11.407649 (+ 400us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:11.407658 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:11.409532 (+ 1874us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.175.254:44597: Server oryx/127.24.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":65,"threads_started":1}
W20260811 16:38:11.409955 8781 heartbeater.cc:644] Failed to heartbeat to 127.24.175.254:44597 (0 consecutive failures): Not authorized: Failed to ping master at 127.24.175.254:44597: Client connection negotiation failed: client connection to 127.24.175.254:44597: Server oryx/127.24.175.254@KRBTEST.COM not found in Kerberos database
Aug 11 16:38:11 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.195@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:38:11.412889 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 8537
Aug 11 16:38:11 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.195@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:38:11.413909 8784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:11.410188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:44597 (local address 127.24.175.195:38487)
0811 16:38:11.410217 (+ 29us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:11.410227 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:11.410261 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:11.410452 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:11.410453 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:11.410555 (+ 102us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:11.410603 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:11.410604 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:11.411128 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:11.411129 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:11.411589 (+ 460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:11.411590 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:11.411867 (+ 277us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:11.411867 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:11.411912 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:11.412206 (+ 294us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:11.412209 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:11.413848 (+ 1639us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.175.254:44597: Server oryx/127.24.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":14}
W20260811 16:38:11.413939 8312 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:38:11.410330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.195:38487 (local address 127.24.175.254:44597)
0811 16:38:11.410372 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:11.410374 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:11.410380 (+ 6us) server_negotiation.cc:407] Connection header received
0811 16:38:11.410398 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:11.410398 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:11.410405 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:11.410448 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:11.410649 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:11.411080 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:11.411662 (+ 582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:11.411824 (+ 162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:11.411863 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:11.413900 (+ 2037us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.175.195:38487: BlockingRecv error: recv got EOF from 127.24.175.195:38487 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
Aug 11 16:38:11 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.195@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:38:11 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.195@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:38:11.417979 8784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:11.414133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:44597 (local address 127.24.175.195:44157)
0811 16:38:11.414185 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:11.414192 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:11.414221 (+ 29us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:11.414369 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:11.414370 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:11.414496 (+ 126us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:11.414526 (+ 30us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:11.414527 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:11.415125 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:11.415126 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:11.415650 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:11.415652 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:11.415955 (+ 303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:11.415956 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:11.416021 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:11.416359 (+ 338us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:11.416364 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:11.417922 (+ 1558us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.175.254:44597: Server oryx/127.24.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":40}
W20260811 16:38:11.418092 8781 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 16:38:11.418099 8312 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:38:11.414205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.195:44157 (local address 127.24.175.254:44597)
0811 16:38:11.414247 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:11.414248 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:11.414255 (+ 7us) server_negotiation.cc:407] Connection header received
0811 16:38:11.414273 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:11.414274 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:11.414282 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:11.414326 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:11.414587 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:11.415049 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:11.415717 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:11.415900 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:11.415951 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:11.417992 (+ 2041us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.175.195:44157: BlockingRecv error: recv got EOF from 127.24.175.195:44157 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 16:38:11.420102 8787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:11.413307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45526 (local address 127.24.175.254:44597)
0811 16:38:11.413409 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:11.413411 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:11.413580 (+ 169us) server_negotiation.cc:407] Connection header received
0811 16:38:11.413620 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:11.413621 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:11.413633 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:11.413699 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:11.414721 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:11.415208 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:11.415912 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:11.416123 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:11.416178 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:11.417229 (+ 1051us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:38:11.417233 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:38:11.417233 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:38:11.417243 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:38:11.418871 (+ 1628us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:11.419180 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:11.419183 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:11.419184 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:11.419281 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:11.419449 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:11.419449 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:11.419450 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:11.419675 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:38:11.419798 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:11.419906 (+ 108us) server_negotiation.cc:299] Negotiation successful
0811 16:38:11.420014 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84,"thread_start_us":53,"threads_started":1}
Aug 11 16:38:12 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.193@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:38:12 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.193@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:38:12.154469 8790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:12.150123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:44597 (local address 127.24.175.193:55445)
0811 16:38:12.150269 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:12.150281 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:12.150333 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:12.150464 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:12.150465 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:12.150627 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:12.150690 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:12.150692 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:12.151312 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:12.151313 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:12.151865 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:12.151866 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:12.152150 (+ 284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:12.152151 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:12.152189 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:12.152578 (+ 389us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:12.152582 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:12.154382 (+ 1800us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.175.254:44597: Server oryx/127.24.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":90,"threads_started":1}
W20260811 16:38:12.154561 8791 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:38:12.150205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:55445 (local address 127.24.175.254:44597)
0811 16:38:12.150309 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:12.150311 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:12.150320 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:38:12.150384 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:12.150385 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:12.150397 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:12.150453 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:12.150748 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:12.151251 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:12.151922 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:12.152103 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:12.152145 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:12.154487 (+ 2342us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.175.193:55445: BlockingRecv error: recv got EOF from 127.24.175.193:55445 (error 108)
Metrics: {"server-negotiator.queue_time_us":84,"thread_start_us":48,"threads_started":1}
Aug 11 16:38:12 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.194@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:38:12 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.194@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:38:12.297284 8792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:12.292936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:44597 (local address 127.24.175.194:39335)
0811 16:38:12.293092 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:12.293103 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:12.293166 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:12.293318 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:12.293319 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:12.293489 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:12.293549 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:12.293551 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:12.294204 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:12.294206 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:12.294764 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:12.294766 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:12.295062 (+ 296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:12.295063 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:12.295113 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:12.295485 (+ 372us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:12.295489 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:12.297199 (+ 1710us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.175.254:44597: Server oryx/127.24.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":64,"threads_started":1}
W20260811 16:38:12.297363 8791 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:38:12.292984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:39335 (local address 127.24.175.254:44597)
0811 16:38:12.293037 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:12.293039 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:12.293157 (+ 118us) server_negotiation.cc:407] Connection header received
0811 16:38:12.293221 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:12.293222 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:12.293249 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:12.293306 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:12.293609 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:12.294097 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:12.294826 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:12.295001 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:12.295043 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:12.297312 (+ 2269us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.175.194:39335: BlockingRecv error: recv got EOF from 127.24.175.194:39335 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
Aug 11 16:38:12 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.195@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:38:12 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.195@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:38:12.422739 8795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:12.418402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:44597 (local address 127.24.175.195:42495)
0811 16:38:12.418536 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:12.418549 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:12.418615 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:12.418754 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:12.418755 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:12.418935 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:12.418984 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:12.418985 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:12.419613 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:12.419615 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:12.420144 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:12.420146 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:12.420463 (+ 317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:12.420465 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:12.420520 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:12.421010 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:12.421015 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:12.422659 (+ 1644us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.175.254:44597: Server oryx/127.24.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":67,"threads_started":1}
W20260811 16:38:12.422816 8791 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:38:12.418469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.195:42495 (local address 127.24.175.254:44597)
0811 16:38:12.418530 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:12.418533 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:12.418603 (+ 70us) server_negotiation.cc:407] Connection header received
0811 16:38:12.418674 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:12.418675 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:12.418689 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:12.418748 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:12.419050 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:12.419537 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:12.420216 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:12.420405 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:12.420458 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:12.422764 (+ 2306us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.175.195:42495: BlockingRecv error: recv got EOF from 127.24.175.195:42495 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
Aug 11 16:38:13 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.193@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:38:13 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.193@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:38:13.158979 8798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:13.154858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:44597 (local address 127.24.175.193:38311)
0811 16:38:13.154984 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:13.154994 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:13.155043 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:13.155160 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:13.155161 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:13.155329 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:13.155382 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:13.155384 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:13.156004 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:13.156004 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:13.156536 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:13.156537 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:13.156824 (+ 287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:13.156824 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:13.156860 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:13.157265 (+ 405us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:13.157269 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:13.158920 (+ 1651us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.175.254:44597: Server oryx/127.24.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":65,"threads_started":1}
W20260811 16:38:13.159089 8799 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:38:13.154921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:38311 (local address 127.24.175.254:44597)
0811 16:38:13.155049 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:13.155051 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:13.155061 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:38:13.155082 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:13.155083 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:13.155093 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:13.155148 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:13.155435 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:13.155951 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:13.156588 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:13.156777 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:13.156821 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:13.159015 (+ 2194us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.175.193:38311: BlockingRecv error: recv got EOF from 127.24.175.193:38311 (error 108)
Metrics: {"server-negotiator.queue_time_us":107,"thread_start_us":66,"threads_started":1}
Aug 11 16:38:13 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.194@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:38:13 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.194@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:38:13.302356 8800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:13.297747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:44597 (local address 127.24.175.194:37963)
0811 16:38:13.297878 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:13.297891 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:13.297953 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:13.298071 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:13.298071 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:13.298254 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:13.298306 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:13.298307 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:13.298899 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:13.298899 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:13.299438 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:13.299439 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:13.299711 (+ 272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:13.299712 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:13.299750 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:13.300270 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:13.300275 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:13.302299 (+ 2024us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.175.254:44597: Server oryx/127.24.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":64,"threads_started":1}
W20260811 16:38:13.302449 8799 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:38:13.297820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:37963 (local address 127.24.175.254:44597)
0811 16:38:13.297886 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:13.297888 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:13.297947 (+ 59us) server_negotiation.cc:407] Connection header received
0811 16:38:13.298008 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:13.298009 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:13.298021 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:13.298060 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:13.298356 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:13.298845 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:13.299493 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:13.299666 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:13.299707 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:13.302388 (+ 2681us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.175.194:37963: BlockingRecv error: recv got EOF from 127.24.175.194:37963 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 11 16:38:13 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.195@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:38:13 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.195@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:38:13.427264 8802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:13.423151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:44597 (local address 127.24.175.195:46699)
0811 16:38:13.423266 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:13.423276 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:13.423329 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:13.423446 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:13.423447 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:13.423611 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:13.423659 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:13.423661 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:13.424291 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:13.424293 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:13.424821 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:13.424823 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:13.425135 (+ 312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:13.425136 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:13.425191 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:13.425583 (+ 392us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:13.425588 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:13.427188 (+ 1600us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.175.254:44597: Server oryx/127.24.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":54,"threads_started":1}
W20260811 16:38:13.427358 8799 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:38:13.423280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.195:46699 (local address 127.24.175.254:44597)
0811 16:38:13.423339 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:13.423341 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:13.423352 (+ 11us) server_negotiation.cc:407] Connection header received
0811 16:38:13.423376 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:13.423376 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:13.423391 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:13.423435 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:13.423726 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:13.424214 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:13.424891 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:13.425078 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:13.425131 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:13.427305 (+ 2174us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.175.195:46699: BlockingRecv error: recv got EOF from 127.24.175.195:46699 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
Aug 11 16:38:14 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.193@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:38:14 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.193@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:38:14.167446 8806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:14.159421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:44597 (local address 127.24.175.193:36635)
0811 16:38:14.159566 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:14.159580 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:14.159647 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:14.159818 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:14.159820 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:14.159990 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:14.160040 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:14.160042 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:14.160824 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:14.160826 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:14.161346 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:14.161348 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:14.161683 (+ 335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:14.161684 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:14.161743 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:14.165674 (+ 3931us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:14.165679 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:14.167376 (+ 1697us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.175.254:44597: Server oryx/127.24.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":65,"threads_started":1}
W20260811 16:38:14.167528 8807 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:38:14.159511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:36635 (local address 127.24.175.254:44597)
0811 16:38:14.159647 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:14.159649 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:14.159658 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:38:14.159713 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:14.159714 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:14.159727 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:14.159795 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:14.160110 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:14.160753 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:14.161417 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:14.161625 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:14.161677 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:14.167464 (+ 5787us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.175.193:36635: BlockingRecv error: recv got EOF from 127.24.175.193:36635 (error 108)
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":79,"threads_started":1}
Aug 11 16:38:14 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.194@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:38:14 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.194@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:38:14.307401 8808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:14.302784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:44597 (local address 127.24.175.194:60805)
0811 16:38:14.302904 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:14.302917 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:14.302980 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:14.303096 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:14.303096 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:14.303263 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:14.303318 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:14.303319 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:14.304127 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:14.304128 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:14.304663 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:14.304665 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:14.305004 (+ 339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:14.305005 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:14.305059 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:14.305471 (+ 412us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:14.305475 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:14.307330 (+ 1855us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.175.254:44597: Server oryx/127.24.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":59,"threads_started":1}
W20260811 16:38:14.307482 8807 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:38:14.302844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:60805 (local address 127.24.175.254:44597)
0811 16:38:14.302918 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:14.302919 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:14.302962 (+ 43us) server_negotiation.cc:407] Connection header received
0811 16:38:14.303025 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:14.303025 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:14.303038 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:14.303084 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:14.303368 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:14.304041 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:14.304738 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:14.304948 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:14.304991 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:14.307422 (+ 2431us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.175.194:60805: BlockingRecv error: recv got EOF from 127.24.175.194:60805 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 11 16:38:14 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.195@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:38:14 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.195@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:38:14.431875 8809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:14.427708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:44597 (local address 127.24.175.195:54467)
0811 16:38:14.427832 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:14.427842 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:14.427902 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:14.428013 (+ 111us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:14.428014 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:14.428188 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:14.428240 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:14.428242 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:14.428846 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:14.428847 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:14.429372 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:14.429373 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:14.429648 (+ 275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:14.429649 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:14.429693 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:14.430102 (+ 409us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:14.430107 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:14.431801 (+ 1694us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.175.254:44597: Server oryx/127.24.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":72,"threads_started":1}
W20260811 16:38:14.431934 8807 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:38:14.427775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.195:54467 (local address 127.24.175.254:44597)
0811 16:38:14.427835 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:14.427837 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:14.427892 (+ 55us) server_negotiation.cc:407] Connection header received
0811 16:38:14.427947 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:14.427947 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:14.427960 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:14.428002 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:14.428287 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:14.428779 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:14.429427 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:14.429594 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:14.429635 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:14.431887 (+ 2252us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.175.195:54467: BlockingRecv error: recv got EOF from 127.24.175.195:54467 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
Aug 11 16:38:15 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.193@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:38:15 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.193@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:38:15.172307 8810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:15.167910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:44597 (local address 127.24.175.193:50749)
0811 16:38:15.168052 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:15.168065 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:15.168125 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:15.168267 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:15.168268 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:15.168425 (+ 157us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:15.168477 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:15.168479 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:15.169242 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:15.169243 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:15.169793 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:15.169795 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:15.170103 (+ 308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:15.170104 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:15.170138 (+ 34us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:15.170600 (+ 462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:15.170605 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:15.172229 (+ 1624us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.175.254:44597: Server oryx/127.24.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":75,"threads_started":1}
W20260811 16:38:15.172391 8819 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:38:15.167978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:50749 (local address 127.24.175.254:44597)
0811 16:38:15.168112 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:15.168114 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:15.168124 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:38:15.168188 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:15.168188 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:15.168201 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:15.168255 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:15.168530 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:15.169138 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:15.169856 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:15.170051 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:15.170098 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:15.172330 (+ 2232us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.175.193:50749: BlockingRecv error: recv got EOF from 127.24.175.193:50749 (error 108)
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":64,"threads_started":1}
Aug 11 16:38:15 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.194@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:38:15 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.194@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:38:15.312070 8820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:15.307829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:44597 (local address 127.24.175.194:36309)
0811 16:38:15.307973 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:15.307983 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:15.308041 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:15.308169 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:15.308170 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:15.308336 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:15.308407 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:15.308409 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:15.309173 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:15.309175 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:15.309701 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:15.309703 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:15.309985 (+ 282us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:15.309985 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:15.310020 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:15.310439 (+ 419us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:15.310443 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:15.312007 (+ 1564us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.175.254:44597: Server oryx/127.24.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":84,"threads_started":1}
W20260811 16:38:15.312212 8819 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:38:15.307880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:36309 (local address 127.24.175.254:44597)
0811 16:38:15.307947 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:15.307949 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:15.308028 (+ 79us) server_negotiation.cc:407] Connection header received
0811 16:38:15.308094 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:15.308094 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:15.308107 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:15.308144 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:15.308476 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:15.309096 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:15.309760 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:15.309940 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:15.309981 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:15.312106 (+ 2125us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.175.194:36309: BlockingRecv error: recv got EOF from 127.24.175.194:36309 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Aug 11 16:38:15 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.195@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:38:15 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.195@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:38:15.436455 8821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:15.432315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:44597 (local address 127.24.175.195:52851)
0811 16:38:15.432447 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:15.432458 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:15.432510 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:15.432625 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:15.432626 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:15.432782 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:15.432834 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:15.432836 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:15.433442 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:15.433442 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:15.433969 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:15.433970 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:15.434279 (+ 309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:15.434280 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:15.434333 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:15.434778 (+ 445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:15.434783 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:15.436398 (+ 1615us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.175.254:44597: Server oryx/127.24.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":72,"threads_started":1}
W20260811 16:38:15.436553 8819 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:38:15.432381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.195:52851 (local address 127.24.175.254:44597)
0811 16:38:15.432435 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:15.432437 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:15.432505 (+ 68us) server_negotiation.cc:407] Connection header received
0811 16:38:15.432551 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:15.432552 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:15.432566 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:15.432615 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:15.432880 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:15.433387 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:15.434021 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:15.434223 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:15.434269 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:15.436493 (+ 2224us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.175.195:52851: BlockingRecv error: recv got EOF from 127.24.175.195:52851 (error 108)
Metrics: {"server-negotiator.queue_time_us":29}
Aug 11 16:38:16 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.193@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:38:16 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.193@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:38:16.176946 8822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:16.172820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:44597 (local address 127.24.175.193:52391)
0811 16:38:16.172941 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:16.172953 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:16.173001 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:16.173135 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:16.173136 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:16.173309 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:16.173361 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:16.173363 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:16.174005 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:16.174006 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:16.174561 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:16.174562 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:16.174854 (+ 292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:16.174855 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:16.174891 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:16.175279 (+ 388us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:16.175284 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:16.176886 (+ 1602us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.175.254:44597: Server oryx/127.24.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":68,"threads_started":1}
W20260811 16:38:16.177053 8824 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:38:16.172886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:52391 (local address 127.24.175.254:44597)
0811 16:38:16.173009 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:16.173011 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:16.173019 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:38:16.173041 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:16.173042 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:16.173053 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:16.173112 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:16.173425 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:16.173949 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:16.174612 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:16.174805 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:16.174850 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:16.176981 (+ 2131us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.175.193:52391: BlockingRecv error: recv got EOF from 127.24.175.193:52391 (error 108)
Metrics: {"server-negotiator.queue_time_us":100,"thread_start_us":61,"threads_started":1}
Aug 11 16:38:16 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.194@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:38:16 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.194@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:38:16.317057 8825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:16.312511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:44597 (local address 127.24.175.194:45449)
0811 16:38:16.312633 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:16.312644 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:16.312701 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:16.312832 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:16.312832 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:16.313030 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:16.313079 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:16.313082 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:16.313819 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:16.313821 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:16.314421 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:16.314425 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:16.314811 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:16.314812 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:16.314875 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:16.315292 (+ 417us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:16.315298 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:16.316972 (+ 1674us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.175.254:44597: Server oryx/127.24.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":60,"threads_started":1}
W20260811 16:38:16.317130 8824 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:38:16.312633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:45449 (local address 127.24.175.254:44597)
0811 16:38:16.312697 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:16.312699 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:16.312708 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:38:16.312760 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:16.312761 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:16.312774 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:16.312820 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:16.313147 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:16.313746 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:16.314489 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:16.314720 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:16.314785 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:16.317079 (+ 2294us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.175.194:45449: BlockingRecv error: recv got EOF from 127.24.175.194:45449 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 11 16:38:16 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.195@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:38:16 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.195@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:38:16.441219 8826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:16.436871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:44597 (local address 127.24.175.195:42883)
0811 16:38:16.437007 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:16.437018 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:16.437084 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:16.437230 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:16.437231 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:16.437403 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:16.437451 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:16.437452 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:16.438091 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:16.438093 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:16.438637 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:16.438638 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:16.438968 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:16.438969 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:16.439020 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:16.439409 (+ 389us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:16.439413 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:16.441142 (+ 1729us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.175.254:44597: Server oryx/127.24.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":68,"threads_started":1}
W20260811 16:38:16.441288 8824 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:38:16.436954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.195:42883 (local address 127.24.175.254:44597)
0811 16:38:16.437013 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:16.437015 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:16.437064 (+ 49us) server_negotiation.cc:407] Connection header received
0811 16:38:16.437133 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:16.437134 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:16.437167 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:16.437214 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:16.437523 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:16.438020 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:16.438718 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:16.438911 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:16.438964 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:16.441235 (+ 2271us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.175.195:42883: BlockingRecv error: recv got EOF from 127.24.175.195:42883 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 11 16:38:17 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.193@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:38:17 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.193@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:38:17.182205 8830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:17.177419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:44597 (local address 127.24.175.193:60927)
0811 16:38:17.177554 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:17.177565 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:17.177625 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:17.177785 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:17.177785 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:17.177999 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:17.178069 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:17.178071 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:17.178797 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:17.178798 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:17.179421 (+ 623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:17.179424 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:17.179773 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:17.179774 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:17.179811 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:17.180219 (+ 408us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:17.180223 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:17.182099 (+ 1876us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.175.254:44597: Server oryx/127.24.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":69,"threads_started":1}
W20260811 16:38:17.182288 8833 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:38:17.177469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:60927 (local address 127.24.175.254:44597)
0811 16:38:17.177579 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:17.177581 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:17.177607 (+ 26us) server_negotiation.cc:407] Connection header received
0811 16:38:17.177691 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:17.177692 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:17.177704 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:17.177774 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:17.178136 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:17.178717 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:17.179500 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:17.179705 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:17.179771 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:17.182226 (+ 2455us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.175.193:60927: BlockingRecv error: recv got EOF from 127.24.175.193:60927 (error 108)
Metrics: {"server-negotiator.queue_time_us":88,"thread_start_us":48,"threads_started":1}
Aug 11 16:38:17 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.194@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:38:17 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.194@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:38:17.321798 8834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:17.317530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:44597 (local address 127.24.175.194:55785)
0811 16:38:17.317652 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:17.317664 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:17.317722 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:17.317850 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:17.317851 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:17.318012 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:17.318063 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:17.318065 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:17.318741 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:17.318742 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:17.319390 (+ 648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:17.319394 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:17.319707 (+ 313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:17.319707 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:17.319746 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:17.320131 (+ 385us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:17.320136 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:17.321739 (+ 1603us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.175.254:44597: Server oryx/127.24.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":63,"threads_started":1}
W20260811 16:38:17.321899 8833 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:38:17.317590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:55785 (local address 127.24.175.254:44597)
0811 16:38:17.317646 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:17.317648 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:17.317717 (+ 69us) server_negotiation.cc:407] Connection header received
0811 16:38:17.317773 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:17.317773 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:17.317786 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:17.317840 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:17.318111 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:17.318666 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:17.319456 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:17.319652 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:17.319703 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:17.321834 (+ 2131us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.175.194:55785: BlockingRecv error: recv got EOF from 127.24.175.194:55785 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
Aug 11 16:38:17 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.195@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:38:17 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.195@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:38:17.446190 8835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:17.441663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:44597 (local address 127.24.175.195:34233)
0811 16:38:17.441789 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:17.441801 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:17.441867 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:17.441996 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:17.441997 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:17.442198 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:17.442262 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:17.442264 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:17.442909 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:17.442911 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:17.443458 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:17.443460 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:17.443780 (+ 320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:17.443781 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:17.443837 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:17.444239 (+ 402us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:17.444243 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:17.446079 (+ 1836us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.175.254:44597: Server oryx/127.24.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":65,"threads_started":1}
W20260811 16:38:17.446280 8833 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:38:17.441729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.195:34233 (local address 127.24.175.254:44597)
0811 16:38:17.441791 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:17.441793 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:17.441857 (+ 64us) server_negotiation.cc:407] Connection header received
0811 16:38:17.441920 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:17.441920 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:17.441935 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:17.441983 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:17.442327 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:17.442839 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:17.443527 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:17.443716 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:17.443776 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:17.446216 (+ 2440us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.175.195:34233: BlockingRecv error: recv got EOF from 127.24.175.195:34233 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
Aug 11 16:38:18 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.193@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:38:18 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.193@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:38:18.186957 8842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:18.182647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:44597 (local address 127.24.175.193:58971)
0811 16:38:18.182772 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:18.182783 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:18.182837 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:18.182960 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:18.182961 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:18.183127 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:18.183187 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:18.183189 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:18.183800 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:18.183800 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:18.184335 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:18.184337 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:18.184605 (+ 268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:18.184605 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:18.184641 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:18.185073 (+ 432us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:18.185078 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:18.186898 (+ 1820us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.175.254:44597: Server oryx/127.24.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":77,"threads_started":1}
W20260811 16:38:18.187083 8843 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:38:18.182716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:58971 (local address 127.24.175.254:44597)
0811 16:38:18.182818 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:18.182820 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:18.182829 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:38:18.182879 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:18.182880 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:18.182896 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:18.182949 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:18.183239 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:18.183749 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:18.184386 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:18.184561 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:18.184601 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:18.187007 (+ 2406us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.175.193:58971: BlockingRecv error: recv got EOF from 127.24.175.193:58971 (error 108)
Metrics: {"server-negotiator.queue_time_us":80,"thread_start_us":52,"threads_started":1}
Aug 11 16:38:18 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.194@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:38:18 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.194@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:38:18.326659 8844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:18.322274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:44597 (local address 127.24.175.194:60095)
0811 16:38:18.322409 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:18.322420 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:18.322478 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:18.322597 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:18.322597 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:18.322771 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:18.322823 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:18.322824 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:18.323425 (+ 601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:18.323426 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:18.324053 (+ 627us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:18.324056 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:18.324381 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:18.324382 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:18.324419 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:18.324813 (+ 394us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:18.324818 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:18.326579 (+ 1761us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.175.254:44597: Server oryx/127.24.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":68,"threads_started":1}
W20260811 16:38:18.326856 8843 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:38:18.322350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:60095 (local address 127.24.175.254:44597)
0811 16:38:18.322419 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:18.322420 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:18.322473 (+ 53us) server_negotiation.cc:407] Connection header received
0811 16:38:18.322531 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:18.322531 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:18.322542 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:18.322582 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:18.322876 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:18.323366 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:18.324131 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:18.324326 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:18.324379 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:18.326688 (+ 2309us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.175.194:60095: BlockingRecv error: recv got EOF from 127.24.175.194:60095 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 11 16:38:18 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.195@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:38:18 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.195@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:38:18.450717 8845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:18.446614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:44597 (local address 127.24.175.195:34901)
0811 16:38:18.446776 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:18.446786 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:18.446844 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:18.446960 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:18.446961 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:18.447125 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:18.447186 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:18.447187 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:18.447780 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:18.447781 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:18.448313 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:18.448314 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:18.448580 (+ 266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:18.448580 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:18.448616 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:18.449051 (+ 435us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:18.449056 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:18.450660 (+ 1604us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.175.254:44597: Server oryx/127.24.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":96,"threads_started":1}
W20260811 16:38:18.450816 8843 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:38:18.446683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.195:34901 (local address 127.24.175.254:44597)
0811 16:38:18.446743 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:18.446745 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:18.446837 (+ 92us) server_negotiation.cc:407] Connection header received
0811 16:38:18.446888 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:18.446889 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:18.446901 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:18.446949 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:18.447238 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:18.447725 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:18.448365 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:18.448534 (+ 169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:18.448574 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:18.450753 (+ 2179us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.175.195:34901: BlockingRecv error: recv got EOF from 127.24.175.195:34901 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
Aug 11 16:38:19 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.193@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:38:19 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.193@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:38:19.198441 8846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:19.187370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:44597 (local address 127.24.175.193:58401)
0811 16:38:19.187511 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:19.187522 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:19.187574 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:19.187695 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:19.187695 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:19.187858 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:19.187911 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:19.187912 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:19.188591 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:19.188592 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:19.189115 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:19.189117 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:19.189459 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:19.189459 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:19.189498 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:19.196444 (+ 6946us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:19.196450 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:19.198380 (+ 1930us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.175.254:44597: Server oryx/127.24.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":60,"threads_started":1}
W20260811 16:38:19.198567 8848 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:38:19.187475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:58401 (local address 127.24.175.254:44597)
0811 16:38:19.187582 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:19.187584 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:19.187592 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:38:19.187615 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:19.187615 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:19.187627 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:19.187679 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:19.187999 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:19.188522 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:19.189189 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:19.189400 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:19.189452 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:19.198486 (+ 9034us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.175.193:58401: BlockingRecv error: recv got EOF from 127.24.175.193:58401 (error 108)
Metrics: {"server-negotiator.queue_time_us":85,"thread_start_us":49,"threads_started":1}
Aug 11 16:38:19 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.194@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:38:19 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.194@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:38:19.331456 8849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:19.327090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:44597 (local address 127.24.175.194:52507)
0811 16:38:19.327224 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:19.327246 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:19.327311 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:19.327424 (+ 113us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:19.327425 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:19.327590 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:19.327640 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:19.327642 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:19.328393 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:19.328394 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:19.328932 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:19.328933 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:19.329210 (+ 277us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:19.329210 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:19.329268 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:19.329713 (+ 445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:19.329718 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:19.331377 (+ 1659us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.175.254:44597: Server oryx/127.24.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":72,"threads_started":1}
W20260811 16:38:19.331539 8848 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:38:19.327164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:52507 (local address 127.24.175.254:44597)
0811 16:38:19.327228 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:19.327230 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:19.327305 (+ 75us) server_negotiation.cc:407] Connection header received
0811 16:38:19.327354 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:19.327354 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:19.327366 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:19.327414 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:19.327687 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:19.328330 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:19.328986 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:19.329161 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:19.329203 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:19.331486 (+ 2283us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.175.194:52507: BlockingRecv error: recv got EOF from 127.24.175.194:52507 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Aug 11 16:38:19 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.195@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:38:19 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.195@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:38:19.455535 8851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:19.451161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:44597 (local address 127.24.175.195:45605)
0811 16:38:19.451323 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:19.451336 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:19.451406 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:19.451544 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:19.451545 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:19.451764 (+ 219us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:19.451813 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:19.451815 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:19.452466 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:19.452467 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:19.452995 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:19.452996 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:19.453332 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:19.453333 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:19.453388 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:19.453787 (+ 399us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:19.453791 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:19.455478 (+ 1687us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.175.254:44597: Server oryx/127.24.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":91,"threads_started":1}
W20260811 16:38:19.455644 8848 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:38:19.451248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.195:45605 (local address 127.24.175.254:44597)
0811 16:38:19.451328 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:19.451330 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:19.451398 (+ 68us) server_negotiation.cc:407] Connection header received
0811 16:38:19.451466 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:19.451466 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:19.451483 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:19.451530 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:19.451885 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:19.452393 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:19.453087 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:19.453273 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:19.453327 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:19.455574 (+ 2247us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.175.195:45605: BlockingRecv error: recv got EOF from 127.24.175.195:45605 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 11 16:38:20 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.193@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:38:20 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.193@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:38:20.203797 8853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:20.198924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:44597 (local address 127.24.175.193:39501)
0811 16:38:20.199076 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:20.199102 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:20.199177 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:20.199365 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:20.199367 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:20.199592 (+ 225us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:20.199661 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:20.199664 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:20.200614 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:20.200615 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:20.201159 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:20.201161 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:20.201475 (+ 314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:20.201475 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:20.201518 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:20.201963 (+ 445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:20.201967 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:20.203738 (+ 1771us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.175.254:44597: Server oryx/127.24.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":82,"threads_started":1}
W20260811 16:38:20.203922 8855 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:38:20.199035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:39501 (local address 127.24.175.254:44597)
0811 16:38:20.199207 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:20.199209 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:20.199221 (+ 12us) server_negotiation.cc:407] Connection header received
0811 16:38:20.199253 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:20.199254 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:20.199268 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:20.199339 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:20.199732 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:20.200546 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:20.201224 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:20.201423 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:20.201466 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:20.203841 (+ 2375us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.175.193:39501: BlockingRecv error: recv got EOF from 127.24.175.193:39501 (error 108)
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":55,"threads_started":1}
Aug 11 16:38:20 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.194@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:38:20 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.194@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:38:20.336372 8856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:20.331913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:44597 (local address 127.24.175.194:48933)
0811 16:38:20.332052 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:20.332064 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:20.332131 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:20.332277 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:20.332278 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:20.332461 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:20.332511 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:20.332513 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:20.333163 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:20.333164 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:20.333679 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:20.333681 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:20.334007 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:20.334008 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:20.334065 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:20.334533 (+ 468us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:20.334537 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:20.336296 (+ 1759us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.175.254:44597: Server oryx/127.24.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":72,"threads_started":1}
W20260811 16:38:20.336457 8855 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:38:20.331984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:48933 (local address 127.24.175.254:44597)
0811 16:38:20.332050 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:20.332052 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:20.332112 (+ 60us) server_negotiation.cc:407] Connection header received
0811 16:38:20.332186 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:20.332187 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:20.332201 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:20.332264 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:20.332587 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:20.333090 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:20.333756 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:20.333949 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:20.334004 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:20.336404 (+ 2400us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.175.194:48933: BlockingRecv error: recv got EOF from 127.24.175.194:48933 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
Aug 11 16:38:20 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.195@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:38:20 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.195@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:38:20.460209 8859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:20.455949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:44597 (local address 127.24.175.195:51783)
0811 16:38:20.456075 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:20.456086 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:20.456153 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:20.456279 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:20.456280 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:20.456460 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:20.456510 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:20.456512 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:20.457155 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:20.457156 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:20.457682 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:20.457684 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:20.458005 (+ 321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:20.458005 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:20.458059 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:20.458474 (+ 415us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:20.458479 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:20.460132 (+ 1653us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.175.254:44597: Server oryx/127.24.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":70,"threads_started":1}
W20260811 16:38:20.460285 8855 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:38:20.456019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.195:51783 (local address 127.24.175.254:44597)
0811 16:38:20.456083 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:20.456085 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:20.456133 (+ 48us) server_negotiation.cc:407] Connection header received
0811 16:38:20.456202 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:20.456202 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:20.456219 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:20.456264 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:20.456580 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:20.457088 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:20.457759 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:20.457947 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:20.458000 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:20.460233 (+ 2233us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.175.195:51783: BlockingRecv error: recv got EOF from 127.24.175.195:51783 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 11 16:38:21 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.193@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:38:21 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.193@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:38:21.208904 8860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:21.204285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:44597 (local address 127.24.175.193:43131)
0811 16:38:21.204442 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:21.204454 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:21.204512 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:21.204638 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:21.204639 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:21.204812 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:21.204866 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:21.204868 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:21.205537 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:21.205538 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:21.206073 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:21.206075 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:21.206420 (+ 345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:21.206421 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:21.206484 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:21.206896 (+ 412us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:21.206901 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:21.208823 (+ 1922us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.175.254:44597: Server oryx/127.24.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":94,"threads_started":1}
W20260811 16:38:21.209003 8862 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:38:21.204387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:43131 (local address 127.24.175.254:44597)
0811 16:38:21.204517 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:21.204519 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:21.204532 (+ 13us) server_negotiation.cc:407] Connection header received
0811 16:38:21.204557 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:21.204557 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:21.204570 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:21.204627 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:21.204927 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:21.205467 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:21.206132 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:21.206359 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:21.206410 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:21.208939 (+ 2529us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.175.193:43131: BlockingRecv error: recv got EOF from 127.24.175.193:43131 (error 108)
Metrics: {"server-negotiator.queue_time_us":107,"thread_start_us":66,"threads_started":1}
Aug 11 16:38:21 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.194@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:38:21 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.194@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:38:21.341254 8864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:21.336841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:44597 (local address 127.24.175.194:33057)
0811 16:38:21.336981 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:21.336992 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:21.337058 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:21.337188 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:21.337189 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:21.337375 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:21.337427 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:21.337429 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:21.338076 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:21.338077 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:21.338622 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:21.338624 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:21.338949 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:21.338950 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:21.339006 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:21.339424 (+ 418us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:21.339428 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:21.341174 (+ 1746us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.175.254:44597: Server oryx/127.24.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":73,"threads_started":1}
W20260811 16:38:21.341341 8862 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:38:21.336906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:33057 (local address 127.24.175.254:44597)
0811 16:38:21.336970 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:21.336972 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:21.337040 (+ 68us) server_negotiation.cc:407] Connection header received
0811 16:38:21.337113 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:21.337114 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:21.337128 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:21.337174 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:21.337500 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:21.338003 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:21.338692 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:21.338890 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:21.338945 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:21.341289 (+ 2344us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.175.194:33057: BlockingRecv error: recv got EOF from 127.24.175.194:33057 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
Aug 11 16:38:21 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.195@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:38:21 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.195@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:38:21.464932 8866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:21.460663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:44597 (local address 127.24.175.195:36565)
0811 16:38:21.460824 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:21.460836 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:21.460903 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:21.461057 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:21.461058 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:21.461282 (+ 224us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:21.461347 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:21.461350 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:21.461982 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:21.461983 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:21.462532 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:21.462534 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:21.462809 (+ 275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:21.462810 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:21.462845 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:21.463226 (+ 381us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:21.463230 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:21.464874 (+ 1644us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.175.254:44597: Server oryx/127.24.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":84,"threads_started":1}
W20260811 16:38:21.465030 8862 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:38:21.460774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.195:36565 (local address 127.24.175.254:44597)
0811 16:38:21.460843 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:21.460845 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:21.460886 (+ 41us) server_negotiation.cc:407] Connection header received
0811 16:38:21.460965 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:21.460966 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:21.460982 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:21.461038 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:21.461418 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:21.461924 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:21.462584 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:21.462761 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:21.462805 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:21.464969 (+ 2164us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.175.195:36565: BlockingRecv error: recv got EOF from 127.24.175.195:36565 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 11 16:38:22 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.193@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:38:22 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.193@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:38:22.213724 8870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:22.209398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:44597 (local address 127.24.175.193:50321)
0811 16:38:22.209529 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:22.209542 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:22.209599 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:22.209718 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:22.209719 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:22.209896 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:22.209947 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:22.209949 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:22.210614 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:22.210615 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:22.211177 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:22.211180 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:22.211471 (+ 291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:22.211471 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:22.211508 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:22.211902 (+ 394us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:22.211906 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:22.213649 (+ 1743us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.175.254:44597: Server oryx/127.24.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":69,"threads_started":1}
W20260811 16:38:22.213825 8871 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:38:22.209500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:50321 (local address 127.24.175.254:44597)
0811 16:38:22.209608 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:22.209609 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:22.209617 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:38:22.209640 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:22.209640 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:22.209653 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:22.209707 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:22.210000 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:22.210533 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:22.211240 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:22.211423 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:22.211464 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:22.213758 (+ 2294us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.175.193:50321: BlockingRecv error: recv got EOF from 127.24.175.193:50321 (error 108)
Metrics: {"server-negotiator.queue_time_us":86,"thread_start_us":47,"threads_started":1}
Aug 11 16:38:22 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.194@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:38:22 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.194@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:38:22.345932 8872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:22.341686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:44597 (local address 127.24.175.194:45667)
0811 16:38:22.341822 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:22.341832 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:22.341900 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:22.342028 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:22.342029 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:22.342238 (+ 209us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:22.342286 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:22.342289 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:22.342925 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:22.342926 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:22.343445 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:22.343446 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:22.343775 (+ 329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:22.343776 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:22.343834 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:22.344235 (+ 401us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:22.344240 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:22.345842 (+ 1602us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.175.254:44597: Server oryx/127.24.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":72,"threads_started":1}
W20260811 16:38:22.345997 8871 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:38:22.341757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:45667 (local address 127.24.175.254:44597)
0811 16:38:22.341822 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:22.341825 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:22.341884 (+ 59us) server_negotiation.cc:407] Connection header received
0811 16:38:22.341954 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:22.341954 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:22.341968 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:22.342017 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:22.342361 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:22.342855 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:22.343521 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:22.343711 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:22.343768 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:22.345947 (+ 2179us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.175.194:45667: BlockingRecv error: recv got EOF from 127.24.175.194:45667 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 11 16:38:22 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.195@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:38:22 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.195@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:38:22.469641 8876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:22.465373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:44597 (local address 127.24.175.195:35577)
0811 16:38:22.465503 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:22.465514 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:22.465582 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:22.465718 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:22.465719 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:22.465903 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:22.465954 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:22.465955 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:22.466586 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:22.466588 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:22.467144 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:22.467146 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:22.467427 (+ 281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:22.467428 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:22.467465 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:22.467913 (+ 448us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:22.467918 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:22.469570 (+ 1652us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.175.254:44597: Server oryx/127.24.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":60,"threads_started":1}
W20260811 16:38:22.469722 8871 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:38:22.465429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.195:35577 (local address 127.24.175.254:44597)
0811 16:38:22.465481 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:22.465482 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:22.465571 (+ 89us) server_negotiation.cc:407] Connection header received
0811 16:38:22.465634 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:22.465634 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:22.465665 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:22.465704 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:22.466006 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:22.466517 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:22.467208 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:22.467380 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:22.467421 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:22.469668 (+ 2247us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.175.195:35577: BlockingRecv error: recv got EOF from 127.24.175.195:35577 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
Aug 11 16:38:23 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.193@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:38:23 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.193@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:38:23.218513 8880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:23.214134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:44597 (local address 127.24.175.193:36791)
0811 16:38:23.214381 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:23.214392 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:23.214453 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:23.214603 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:23.214605 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:23.214795 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:23.214848 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:23.214850 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:23.215571 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:23.215572 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:23.216096 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:23.216099 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:23.216381 (+ 282us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:23.216382 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:23.216419 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:23.216834 (+ 415us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:23.216839 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:23.218451 (+ 1612us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.175.254:44597: Server oryx/127.24.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":134,"threads_started":1}
W20260811 16:38:23.218611 8881 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:38:23.214196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:36791 (local address 127.24.175.254:44597)
0811 16:38:23.214348 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:23.214350 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:23.214449 (+ 99us) server_negotiation.cc:407] Connection header received
0811 16:38:23.214512 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:23.214513 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:23.214530 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:23.214586 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:23.214938 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:23.215502 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:23.216153 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:23.216334 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:23.216377 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:23.218543 (+ 2166us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.175.193:36791: BlockingRecv error: recv got EOF from 127.24.175.193:36791 (error 108)
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":76,"threads_started":1}
Aug 11 16:38:23 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.194@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:38:23 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.194@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:38:23.354971 8883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:23.346425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:44597 (local address 127.24.175.194:41877)
0811 16:38:23.346556 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:23.346566 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:23.346624 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:23.346774 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:23.346775 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:23.346950 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:23.347001 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:23.347003 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:23.347605 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:23.347605 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:23.348139 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:23.348141 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:23.348432 (+ 291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:23.348432 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:23.348470 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:23.353083 (+ 4613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:23.353089 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:23.354892 (+ 1803us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.175.254:44597: Server oryx/127.24.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":71,"threads_started":1}
W20260811 16:38:23.355057 8881 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:38:23.346512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:41877 (local address 127.24.175.254:44597)
0811 16:38:23.346576 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:23.346578 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:23.346609 (+ 31us) server_negotiation.cc:407] Connection header received
0811 16:38:23.346691 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:23.346691 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:23.346702 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:23.346763 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:23.347053 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:23.347546 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:23.348202 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:23.348383 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:23.348429 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:23.355004 (+ 6575us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.175.194:41877: BlockingRecv error: recv got EOF from 127.24.175.194:41877 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
Aug 11 16:38:23 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.195@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:38:23 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.195@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:38:23.474285 8884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:23.470091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:44597 (local address 127.24.175.195:35597)
0811 16:38:23.470229 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:23.470241 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:23.470301 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:23.470419 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:23.470420 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:23.470587 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:23.470638 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:23.470639 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:23.471258 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:23.471259 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:23.471789 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:23.471790 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:23.472056 (+ 266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:23.472056 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:23.472091 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:23.472481 (+ 390us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:23.472485 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:23.474206 (+ 1721us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.175.254:44597: Server oryx/127.24.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":80,"threads_started":1}
W20260811 16:38:23.474418 8881 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:38:23.470134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.195:35597 (local address 127.24.175.254:44597)
0811 16:38:23.470217 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:23.470220 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:23.470293 (+ 73us) server_negotiation.cc:407] Connection header received
0811 16:38:23.470355 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:23.470355 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:23.470371 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:23.470409 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:23.470704 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:23.471206 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:23.471841 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:23.472011 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:23.472052 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:23.474310 (+ 2258us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.175.195:35597: BlockingRecv error: recv got EOF from 127.24.175.195:35597 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 11 16:38:24 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.193@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:38:24 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.193@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:38:24.226224 8886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:24.218959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:44597 (local address 127.24.175.193:39551)
0811 16:38:24.219090 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:24.219100 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:24.219150 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:24.219274 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:24.219275 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:24.219446 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:24.219498 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:24.219500 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:24.220132 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:24.220133 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:24.220680 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:24.220682 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:24.220973 (+ 291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:24.220974 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:24.221008 (+ 34us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:24.224230 (+ 3222us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:24.224242 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:24.226107 (+ 1865us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.175.254:44597: Server oryx/127.24.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":68,"threads_started":1}
W20260811 16:38:24.226301 8891 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:38:24.219020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:39551 (local address 127.24.175.254:44597)
0811 16:38:24.219143 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:24.219145 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:24.219154 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:38:24.219191 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:24.219191 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:24.219201 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:24.219262 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:24.219550 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:24.220074 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:24.220745 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:24.220928 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:24.220970 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:24.226231 (+ 5261us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.175.193:39551: BlockingRecv error: recv got EOF from 127.24.175.193:39551 (error 108)
Metrics: {"server-negotiator.queue_time_us":102,"thread_start_us":61,"threads_started":1}
Aug 11 16:38:24 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.194@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:38:24 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.194@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:38:24.359618 8893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:24.355401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:44597 (local address 127.24.175.194:46651)
0811 16:38:24.355552 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:24.355564 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:24.355614 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:24.355731 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:24.355731 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:24.355901 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:24.355952 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:24.355953 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:24.356560 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:24.356562 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:24.357129 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:24.357131 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:24.357413 (+ 282us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:24.357414 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:24.357451 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:24.357844 (+ 393us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:24.357848 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:24.359549 (+ 1701us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.175.254:44597: Server oryx/127.24.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":58,"threads_started":1}
W20260811 16:38:24.359706 8891 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:38:24.355549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:46651 (local address 127.24.175.254:44597)
0811 16:38:24.355614 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:24.355616 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:24.355625 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:38:24.355663 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:24.355663 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:24.355674 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:24.355711 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:24.356003 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:24.356492 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:24.357189 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:24.357365 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:24.357406 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:24.359643 (+ 2237us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.175.194:46651: BlockingRecv error: recv got EOF from 127.24.175.194:46651 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 11 16:38:24 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.195@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:38:24 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.195@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:38:24.479071 8894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:24.474730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:44597 (local address 127.24.175.195:39357)
0811 16:38:24.474861 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:24.474872 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:24.474937 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:24.475059 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:24.475060 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:24.475250 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:24.475297 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:24.475299 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:24.475931 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:24.475932 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:24.476470 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:24.476472 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:24.476789 (+ 317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:24.476790 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:24.476845 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:24.477271 (+ 426us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:24.477276 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:24.478987 (+ 1711us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.175.254:44597: Server oryx/127.24.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":69,"threads_started":1}
W20260811 16:38:24.479132 8891 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:38:24.474796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.195:39357 (local address 127.24.175.254:44597)
0811 16:38:24.474857 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:24.474859 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:24.474917 (+ 58us) server_negotiation.cc:407] Connection header received
0811 16:38:24.474994 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:24.474994 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:24.475009 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:24.475054 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:24.475366 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:24.475862 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:24.476542 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:24.476732 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:24.476784 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:24.479081 (+ 2297us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.175.195:39357: BlockingRecv error: recv got EOF from 127.24.175.195:39357 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
Aug 11 16:38:25 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.193@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:38:25 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.193@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:38:25.230928 8895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:25.226655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:44597 (local address 127.24.175.193:60261)
0811 16:38:25.226783 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:25.226794 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:25.226847 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:25.226967 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:25.226968 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:25.227138 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:25.227190 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:25.227191 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:25.227814 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:25.227814 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:25.228353 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:25.228354 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:25.228641 (+ 287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:25.228643 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:25.228701 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:25.229102 (+ 401us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:25.229107 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:25.230837 (+ 1730us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.175.254:44597: Server oryx/127.24.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":69,"threads_started":1}
W20260811 16:38:25.230998 8896 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:38:25.226724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:60261 (local address 127.24.175.254:44597)
0811 16:38:25.226854 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:25.226856 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:25.226865 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:38:25.226888 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:25.226889 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:25.226902 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:25.226956 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:25.227255 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:25.227762 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:25.228408 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:25.228589 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:25.228630 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:25.230938 (+ 2308us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.175.193:60261: BlockingRecv error: recv got EOF from 127.24.175.193:60261 (error 108)
Metrics: {"server-negotiator.queue_time_us":94,"thread_start_us":52,"threads_started":1}
Aug 11 16:38:25 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.194@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:38:25 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.194@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:38:25.364528 8901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:25.360110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:44597 (local address 127.24.175.194:46967)
0811 16:38:25.360243 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:25.360255 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:25.360314 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:25.360433 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:25.360434 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:25.360612 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:25.360663 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:25.360664 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:25.361302 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:25.361303 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:25.361857 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:25.361859 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:25.362184 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:25.362186 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:25.362248 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:25.362762 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:25.362767 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:25.364452 (+ 1685us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.175.254:44597: Server oryx/127.24.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":60,"threads_started":1}
W20260811 16:38:25.364607 8896 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:38:25.360145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:46967 (local address 127.24.175.254:44597)
0811 16:38:25.360197 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:25.360199 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:25.360306 (+ 107us) server_negotiation.cc:407] Connection header received
0811 16:38:25.360358 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:25.360359 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:25.360370 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:25.360421 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:25.360711 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:25.361213 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:25.361918 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:25.362095 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:25.362170 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:25.364556 (+ 2386us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.175.194:46967: BlockingRecv error: recv got EOF from 127.24.175.194:46967 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
Aug 11 16:38:25 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.195@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:38:25 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.195@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:38:25.483669 8902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:25.479524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:44597 (local address 127.24.175.195:55339)
0811 16:38:25.479703 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:25.479713 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:25.479766 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:25.479879 (+ 113us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:25.479879 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:25.480046 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:25.480095 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:25.480096 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:25.480689 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:25.480690 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:25.481210 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:25.481211 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:25.481472 (+ 261us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:25.481473 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:25.481507 (+ 34us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:25.481895 (+ 388us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:25.481900 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:25.483593 (+ 1693us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.175.254:44597: Server oryx/127.24.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":70,"threads_started":1}
W20260811 16:38:25.483753 8896 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:38:25.479581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.195:55339 (local address 127.24.175.254:44597)
0811 16:38:25.479629 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:25.479630 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:25.479761 (+ 131us) server_negotiation.cc:407] Connection header received
0811 16:38:25.479807 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:25.479807 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:25.479820 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:25.479865 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:25.480141 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:25.480633 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:25.481259 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:25.481426 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:25.481467 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:25.483690 (+ 2223us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.175.195:55339: BlockingRecv error: recv got EOF from 127.24.175.195:55339 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
Aug 11 16:38:26 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.193@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:38:26 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.193@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:38:26.235836 8903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:26.231481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:44597 (local address 127.24.175.193:48381)
0811 16:38:26.231622 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:26.231633 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:26.231700 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:26.231853 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:26.231854 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:26.232023 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:26.232076 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:26.232077 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:26.232736 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:26.232737 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:26.233251 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:26.233252 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:26.233564 (+ 312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:26.233565 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:26.233600 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:26.234005 (+ 405us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:26.234009 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:26.235751 (+ 1742us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.175.254:44597: Server oryx/127.24.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":65,"threads_started":1}
W20260811 16:38:26.235940 8905 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:38:26.231575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:48381 (local address 127.24.175.254:44597)
0811 16:38:26.231701 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:26.231703 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:26.231745 (+ 42us) server_negotiation.cc:407] Connection header received
0811 16:38:26.231768 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:26.231769 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:26.231780 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:26.231831 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:26.232133 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:26.232676 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:26.233308 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:26.233491 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:26.233564 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:26.235863 (+ 2299us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.175.193:48381: BlockingRecv error: recv got EOF from 127.24.175.193:48381 (error 108)
Metrics: {"server-negotiator.queue_time_us":103,"thread_start_us":62,"threads_started":1}
Aug 11 16:38:26 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.194@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:38:26 dist-test-slave-zj8q krb5kdc[7035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.175.194@KRBTEST.COM for oryx/127.24.175.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:38:26.369254 8907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:26.365025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:44597 (local address 127.24.175.194:59307)
0811 16:38:26.365158 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:26.365169 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:26.365220 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:26.365329 (+ 109us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:26.365330 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:26.365493 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:26.365560 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:26.365562 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:26.366223 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:26.366224 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:26.366772 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:26.366773 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:26.367064 (+ 291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:26.367065 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:26.367100 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:26.367535 (+ 435us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:26.367540 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:26.369184 (+ 1644us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.175.254:44597: Server oryx/127.24.175.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":81,"threads_started":1}
W20260811 16:38:26.369333 8905 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:38:26.365109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:59307 (local address 127.24.175.254:44597)
0811 16:38:26.365177 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:26.365178 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:26.365207 (+ 29us) server_negotiation.cc:407] Connection header received
0811 16:38:26.365265 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:26.365266 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:26.365276 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:26.365319 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:26.365622 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:26.366134 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:26.366825 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:26.367013 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:26.367063 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:26.369271 (+ 2208us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.175.194:59307: BlockingRecv error: recv got EOF from 127.24.175.194:59307 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 16:38:26.415427 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 8042
I20260811 16:38:26.428990 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 8314
I20260811 16:38:26.439306 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 8537
I20260811 16:38:26.446686 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 7924
2026-08-11T16:38:26Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17568 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-11T16:38:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:38:26Z Disabled control of system clock
I20260811 16:38:26.481928 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466249441839-25279-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466249441839-25279-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466249441839-25279-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:33565
--webserver_interface=127.24.175.254
--webserver_port=0
--builtin_ntp_servers=127.24.175.212:36823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.175.254:33565
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260811 16:38:26.561782 8913 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:38:26.562021 8913 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:38:26.562040 8913 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:38:26.563210 8913 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:38:26.563249 8913 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:38:26.563261 8913 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:38:26.563270 8913 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:38:26.563282 8913 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:38:26.564610 8913 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:36823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466249441839-25279-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466249441839-25279-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.175.254:33565
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:33565
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8913
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466249441839-25279-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:38:26.564811 8913 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:38:26.565070 8913 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:38:26.569887 8921 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:38:26.569922 8920 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:38:26.569922 8923 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:38:26.570094 8913 server_base.cc:1034] running on GCE node
I20260811 16:38:26.570358 8913 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:38:26.570695 8913 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:38:26.571853 8913 hybrid_clock.cc:648] HybridClock initialized: now 1786466306571837 us; error 31 us; skew 500 ppm
I20260811 16:38:26.573050 8913 webserver.cc:460] Webserver started at http://127.24.175.254:36647/ using document root <none> and password file <none>
I20260811 16:38:26.573282 8913 fs_manager.cc:359] Metadata directory not provided
I20260811 16:38:26.573326 8913 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:38:26.573452 8913 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:38:26.574592 8913 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466249441839-25279-0/minicluster-data/master-0/data/instance:
uuid: "0f2e57ae26cf4da0947efbc259f8f170"
format_stamp: "Formatted at 2026-08-11 16:38:26 on dist-test-slave-zj8q"
server_key: "eab2a3c15e18d1c0ea7cf8e50ac0265d"
server_key_iv: "54646e25621c384cf8ccfe6c7e0dfab3"
server_key_version: "encryptionkey@0"
I20260811 16:38:26.574922 8913 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466249441839-25279-0/minicluster-data/master-0/wal/instance:
uuid: "0f2e57ae26cf4da0947efbc259f8f170"
format_stamp: "Formatted at 2026-08-11 16:38:26 on dist-test-slave-zj8q"
server_key: "eab2a3c15e18d1c0ea7cf8e50ac0265d"
server_key_iv: "54646e25621c384cf8ccfe6c7e0dfab3"
server_key_version: "encryptionkey@0"
I20260811 16:38:26.576200 8913 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:38:26.576875 8931 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:26.577039 8913 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:38:26.577124 8913 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466249441839-25279-0/minicluster-data/master-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466249441839-25279-0/minicluster-data/master-0/wal
uuid: "0f2e57ae26cf4da0947efbc259f8f170"
format_stamp: "Formatted at 2026-08-11 16:38:26 on dist-test-slave-zj8q"
server_key: "eab2a3c15e18d1c0ea7cf8e50ac0265d"
server_key_iv: "54646e25621c384cf8ccfe6c7e0dfab3"
server_key_version: "encryptionkey@0"
I20260811 16:38:26.577195 8913 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466249441839-25279-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466249441839-25279-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466249441839-25279-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:38:26.601934 8913 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:38:26.602272 8913 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:38:26.602408 8913 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:38:26.606243 8913 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.254:33565
I20260811 16:38:26.606284 9028 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.254:33565 every 8 connection(s)
I20260811 16:38:26.606618 8913 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
I20260811 16:38:26.607301 9030 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:38:26.609913 9030 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f2e57ae26cf4da0947efbc259f8f170: Bootstrap starting.
I20260811 16:38:26.610519 9030 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0f2e57ae26cf4da0947efbc259f8f170: Neither blocks nor log segments found. Creating new log.
I20260811 16:38:26.610785 9030 log.cc:824] T 00000000000000000000000000000000 P 0f2e57ae26cf4da0947efbc259f8f170: Log is configured to *not* fsync() on all Append() calls
I20260811 16:38:26.611450 9030 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f2e57ae26cf4da0947efbc259f8f170: No bootstrap required, opened a new log
I20260811 16:38:26.612980 9030 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0f2e57ae26cf4da0947efbc259f8f170 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f2e57ae26cf4da0947efbc259f8f170" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 33565 } }
I20260811 16:38:26.613116 9030 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0f2e57ae26cf4da0947efbc259f8f170 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:38:26.613137 9030 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0f2e57ae26cf4da0947efbc259f8f170 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f2e57ae26cf4da0947efbc259f8f170, State: Initialized, Role: FOLLOWER
I20260811 16:38:26.613287 9030 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0f2e57ae26cf4da0947efbc259f8f170 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f2e57ae26cf4da0947efbc259f8f170" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 33565 } }
I20260811 16:38:26.613353 9030 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0f2e57ae26cf4da0947efbc259f8f170 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:38:26.613384 9030 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0f2e57ae26cf4da0947efbc259f8f170 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:38:26.613430 9030 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0f2e57ae26cf4da0947efbc259f8f170 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:38:26.613919 9030 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0f2e57ae26cf4da0947efbc259f8f170 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f2e57ae26cf4da0947efbc259f8f170" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 33565 } }
I20260811 16:38:26.614009 9030 leader_election.cc:302] T 00000000000000000000000000000000 P 0f2e57ae26cf4da0947efbc259f8f170 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0f2e57ae26cf4da0947efbc259f8f170; no voters:
I20260811 16:38:26.614189 9030 leader_election.cc:288] T 00000000000000000000000000000000 P 0f2e57ae26cf4da0947efbc259f8f170 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:38:26.614220 9038 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0f2e57ae26cf4da0947efbc259f8f170 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:38:26.614359 9038 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0f2e57ae26cf4da0947efbc259f8f170 [term 1 LEADER]: Becoming Leader. State: Replica: 0f2e57ae26cf4da0947efbc259f8f170, State: Running, Role: LEADER
I20260811 16:38:26.614449 9030 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0f2e57ae26cf4da0947efbc259f8f170 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:38:26.614494 9038 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0f2e57ae26cf4da0947efbc259f8f170 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f2e57ae26cf4da0947efbc259f8f170" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 33565 } }
I20260811 16:38:26.614852 9041 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f2e57ae26cf4da0947efbc259f8f170 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0f2e57ae26cf4da0947efbc259f8f170" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f2e57ae26cf4da0947efbc259f8f170" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 33565 } } }
I20260811 16:38:26.614982 9042 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f2e57ae26cf4da0947efbc259f8f170 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0f2e57ae26cf4da0947efbc259f8f170. Latest consensus state: current_term: 1 leader_uuid: "0f2e57ae26cf4da0947efbc259f8f170" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f2e57ae26cf4da0947efbc259f8f170" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 33565 } } }
I20260811 16:38:26.615073 9042 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f2e57ae26cf4da0947efbc259f8f170 [sys.catalog]: This master's current role is: LEADER
I20260811 16:38:26.615003 9041 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f2e57ae26cf4da0947efbc259f8f170 [sys.catalog]: This master's current role is: LEADER
I20260811 16:38:26.615516 9053 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:38:26.615939 9053 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:38:26.616153 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 8913
I20260811 16:38:26.616242 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466249441839-25279-0/minicluster-data/master-0/wal/instance
I20260811 16:38:26.616415 25279 external_mini_cluster.cc:1428] Setting key c09889eb7432fbeac056d2cf20ea0c77
I20260811 16:38:26.617415 9053 catalog_manager.cc:1347] Generated new cluster ID: e3235468ccc8457ca1399cf339beeb2a
I20260811 16:38:26.617471 9053 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:38:26.623405 9064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:26.616820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49514 (local address 127.24.175.254:33565)
0811 16:38:26.617161 (+ 341us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:26.617171 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:26.617194 (+ 23us) server_negotiation.cc:407] Connection header received
0811 16:38:26.617284 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:26.617289 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:26.617351 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:26.618525 (+ 1174us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:26.618610 (+ 85us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:26.619959 (+ 1349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:26.621000 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:26.621606 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:26.622011 (+ 405us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:26.622658 (+ 647us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:38:26.622661 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:38:26.622661 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:38:26.622836 (+ 175us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:38:26.622873 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:38:26.622885 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:38:26.623093 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:26.623122 (+ 29us) server_negotiation.cc:299] Negotiation successful
0811 16:38:26.623205 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":271,"thread_start_us":78,"threads_started":1}
I20260811 16:38:26.624997 9053 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:38:26.625445 9053 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:38:26.628978 9053 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0f2e57ae26cf4da0947efbc259f8f170: Generated new TSK 0
I20260811 16:38:26.629128 9053 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:38:26.631937 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.193:0
--local_ip_for_outbound_sockets=127.24.175.193
--webserver_interface=127.24.175.193
--webserver_port=0
--tserver_master_addrs=127.24.175.254:33565
--builtin_ntp_servers=127.24.175.212:36823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260811 16:38:26.741539 9066 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:38:26.741739 9066 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:38:26.741761 9066 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:38:26.742913 9066 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:38:26.742955 9066 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:38:26.742978 9066 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.193
I20260811 16:38:26.744803 9066 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:36823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.175.193
--webserver_port=0
--tserver_master_addrs=127.24.175.254:33565
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9066
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.193
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:38:26.745191 9066 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:38:26.745584 9066 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:38:26.751369 9077 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:38:26.751556 9074 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:38:26.751783 9075 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:38:26.751943 9066 server_base.cc:1034] running on GCE node
I20260811 16:38:26.752200 9066 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:38:26.752465 9066 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:38:26.753634 9066 hybrid_clock.cc:648] HybridClock initialized: now 1786466306753619 us; error 26 us; skew 500 ppm
I20260811 16:38:26.755034 9066 webserver.cc:460] Webserver started at http://127.24.175.193:42813/ using document root <none> and password file <none>
I20260811 16:38:26.755266 9066 fs_manager.cc:359] Metadata directory not provided
I20260811 16:38:26.755311 9066 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:38:26.755421 9066 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:38:26.756693 9066 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-0/data/instance:
uuid: "95cc9f773d604b43aac5327ae9200003"
format_stamp: "Formatted at 2026-08-11 16:38:26 on dist-test-slave-zj8q"
server_key: "4927decf4bc517579abe886c629c4224"
server_key_iv: "774f30ecf947ce3b7ec76f6e22026c8c"
server_key_version: "encryptionkey@0"
I20260811 16:38:26.757154 9066 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-0/wal/instance:
uuid: "95cc9f773d604b43aac5327ae9200003"
format_stamp: "Formatted at 2026-08-11 16:38:26 on dist-test-slave-zj8q"
server_key: "4927decf4bc517579abe886c629c4224"
server_key_iv: "774f30ecf947ce3b7ec76f6e22026c8c"
server_key_version: "encryptionkey@0"
I20260811 16:38:26.758747 9066 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 16:38:26.759656 9088 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:26.759855 9066 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 16:38:26.759943 9066 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-0/wal
uuid: "95cc9f773d604b43aac5327ae9200003"
format_stamp: "Formatted at 2026-08-11 16:38:26 on dist-test-slave-zj8q"
server_key: "4927decf4bc517579abe886c629c4224"
server_key_iv: "774f30ecf947ce3b7ec76f6e22026c8c"
server_key_version: "encryptionkey@0"
I20260811 16:38:26.760017 9066 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:38:26.784037 9066 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:38:26.784319 9066 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:38:26.784422 9066 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:38:26.784605 9066 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:38:26.784920 9066 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:38:26.784955 9066 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:26.784986 9066 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:38:26.785008 9066 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:26.790647 9066 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.193:33327
I20260811 16:38:26.790689 9287 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.193:33327 every 8 connection(s)
I20260811 16:38:26.791014 9066 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
I20260811 16:38:26.795662 9064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:26.791707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:42365 (local address 127.24.175.254:33565)
0811 16:38:26.791766 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:26.791768 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:26.791984 (+ 216us) server_negotiation.cc:407] Connection header received
0811 16:38:26.792451 (+ 467us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:26.792452 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:26.792464 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:26.792509 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:26.793118 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:26.793608 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:26.794565 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:26.794749 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:26.794798 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:26.795452 (+ 654us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:38:26.795453 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:38:26.795453 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:38:26.795457 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:38:26.795471 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:38:26.795475 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:38:26.795512 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:26.795576 (+ 64us) server_negotiation.cc:299] Negotiation successful
0811 16:38:26.795603 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 16:38:26.795845 9295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:26.791676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:33565 (local address 127.24.175.193:42365)
0811 16:38:26.791868 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:26.791901 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:26.792373 (+ 472us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:26.792568 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:26.792571 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:26.792580 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:26.793056 (+ 476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:26.793061 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:26.793670 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:26.793670 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:26.794504 (+ 834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:26.794507 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:26.794805 (+ 298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:26.794805 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:26.794908 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:26.795329 (+ 421us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 16:38:26.795329 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:26.795357 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 16:38:26.795378 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:38:26.795519 (+ 141us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:38:26.795522 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:38:26.795524 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 16:38:26.795568 (+ 44us) client_negotiation.cc:240] Negotiation successful
0811 16:38:26.795644 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":101,"threads_started":1}
I20260811 16:38:26.796394 9290 heartbeater.cc:347] Connected to a master server at 127.24.175.254:33565
I20260811 16:38:26.796482 9290 heartbeater.cc:464] Registering TS with master...
I20260811 16:38:26.796634 9290 heartbeater.cc:511] Master 127.24.175.254:33565 requested a full tablet report, sending...
I20260811 16:38:26.797138 8958 ts_manager.cc:194] Registered new tserver with Master: 95cc9f773d604b43aac5327ae9200003 (127.24.175.193:33327)
I20260811 16:38:26.797724 8958 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.24.175.193:42365
I20260811 16:38:26.801107 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 9066
I20260811 16:38:26.801188 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-0/wal/instance
I20260811 16:38:26.801347 25279 external_mini_cluster.cc:1428] Setting key 630df4e561ef3d7db094a24648b6680e
I20260811 16:38:26.802204 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.194:0
--local_ip_for_outbound_sockets=127.24.175.194
--webserver_interface=127.24.175.194
--webserver_port=0
--tserver_master_addrs=127.24.175.254:33565
--builtin_ntp_servers=127.24.175.212:36823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260811 16:38:26.883575 9296 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:38:26.883764 9296 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:38:26.883782 9296 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:38:26.884830 9296 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:38:26.884863 9296 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:38:26.884886 9296 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.194
I20260811 16:38:26.886142 9296 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:36823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.175.194
--webserver_port=0
--tserver_master_addrs=127.24.175.254:33565
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9296
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.194
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:38:26.886360 9296 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:38:26.886584 9296 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:38:26.891234 9305 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:38:26.891211 9308 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:38:26.891331 9304 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:38:26.891577 9296 server_base.cc:1034] running on GCE node
I20260811 16:38:26.891741 9296 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:38:26.891963 9296 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:38:26.893100 9296 hybrid_clock.cc:648] HybridClock initialized: now 1786466306893078 us; error 35 us; skew 500 ppm
I20260811 16:38:26.894258 9296 webserver.cc:460] Webserver started at http://127.24.175.194:34493/ using document root <none> and password file <none>
I20260811 16:38:26.894454 9296 fs_manager.cc:359] Metadata directory not provided
I20260811 16:38:26.894497 9296 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:38:26.894618 9296 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:38:26.895577 9296 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-1/data/instance:
uuid: "814a13b321254a14aa51cfb4e1686556"
format_stamp: "Formatted at 2026-08-11 16:38:26 on dist-test-slave-zj8q"
server_key: "87c09b2c038b959e3561a7a652ef85e9"
server_key_iv: "824c4a04ac492f5ce7985cfaabe2e242"
server_key_version: "encryptionkey@0"
I20260811 16:38:26.895888 9296 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-1/wal/instance:
uuid: "814a13b321254a14aa51cfb4e1686556"
format_stamp: "Formatted at 2026-08-11 16:38:26 on dist-test-slave-zj8q"
server_key: "87c09b2c038b959e3561a7a652ef85e9"
server_key_iv: "824c4a04ac492f5ce7985cfaabe2e242"
server_key_version: "encryptionkey@0"
I20260811 16:38:26.897022 9296 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:38:26.897615 9317 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:26.897766 9296 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:38:26.897848 9296 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-1/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-1/wal
uuid: "814a13b321254a14aa51cfb4e1686556"
format_stamp: "Formatted at 2026-08-11 16:38:26 on dist-test-slave-zj8q"
server_key: "87c09b2c038b959e3561a7a652ef85e9"
server_key_iv: "824c4a04ac492f5ce7985cfaabe2e242"
server_key_version: "encryptionkey@0"
I20260811 16:38:26.897908 9296 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:38:26.914855 9296 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:38:26.915115 9296 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:38:26.915252 9296 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:38:26.915459 9296 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:38:26.915751 9296 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:38:26.915784 9296 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:26.915812 9296 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:38:26.915832 9296 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:26.921244 9296 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.194:39063
I20260811 16:38:26.921288 9524 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.194:39063 every 8 connection(s)
I20260811 16:38:26.921578 9296 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
I20260811 16:38:26.926411 9064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:26.922228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:40185 (local address 127.24.175.254:33565)
0811 16:38:26.922289 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:26.922291 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:26.922527 (+ 236us) server_negotiation.cc:407] Connection header received
0811 16:38:26.923018 (+ 491us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:26.923020 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:26.923032 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:26.923084 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:26.923705 (+ 621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:26.924216 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:26.925130 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:26.925336 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:26.925391 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:26.926139 (+ 748us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:38:26.926141 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:38:26.926141 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:38:26.926146 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:38:26.926176 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:38:26.926181 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:38:26.926225 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:26.926301 (+ 76us) server_negotiation.cc:299] Negotiation successful
0811 16:38:26.926331 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 16:38:26.926585 9530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:26.922234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:33565 (local address 127.24.175.194:40185)
0811 16:38:26.922414 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:26.922446 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:26.922916 (+ 470us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:26.923149 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:26.923152 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:26.923160 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:26.923613 (+ 453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:26.923618 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:26.924297 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:26.924298 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:26.925045 (+ 747us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:26.925047 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:26.925402 (+ 355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:26.925403 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:26.925538 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:26.926003 (+ 465us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 16:38:26.926003 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:26.926031 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 16:38:26.926052 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:38:26.926232 (+ 180us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:38:26.926236 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:38:26.926240 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:38:26.926298 (+ 58us) client_negotiation.cc:240] Negotiation successful
0811 16:38:26.926396 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":81,"threads_started":1}
I20260811 16:38:26.927062 9525 heartbeater.cc:347] Connected to a master server at 127.24.175.254:33565
I20260811 16:38:26.927156 9525 heartbeater.cc:464] Registering TS with master...
I20260811 16:38:26.927158 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 9296
I20260811 16:38:26.927249 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-1/wal/instance
I20260811 16:38:26.927343 9525 heartbeater.cc:511] Master 127.24.175.254:33565 requested a full tablet report, sending...
I20260811 16:38:26.927431 25279 external_mini_cluster.cc:1428] Setting key adeab10629a1bfb41f4b8d8c78c5afc3
I20260811 16:38:26.927718 8958 ts_manager.cc:194] Registered new tserver with Master: 814a13b321254a14aa51cfb4e1686556 (127.24.175.194:39063)
I20260811 16:38:26.928157 8958 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.24.175.194:40185
I20260811 16:38:26.928455 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.195:0
--local_ip_for_outbound_sockets=127.24.175.195
--webserver_interface=127.24.175.195
--webserver_port=0
--tserver_master_addrs=127.24.175.254:33565
--builtin_ntp_servers=127.24.175.212:36823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260811 16:38:27.010001 9531 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:38:27.010222 9531 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:38:27.010243 9531 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:38:27.011317 9531 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:38:27.011353 9531 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:38:27.011376 9531 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.195
I20260811 16:38:27.012724 9531 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:36823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.175.195
--webserver_port=0
--tserver_master_addrs=127.24.175.254:33565
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9531
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.195
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:38:27.012910 9531 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:38:27.013157 9531 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:38:27.018213 9538 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:38:27.018260 9541 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:38:27.018213 9539 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:38:27.018394 9531 server_base.cc:1034] running on GCE node
I20260811 16:38:27.018605 9531 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:38:27.018795 9531 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:38:27.019936 9531 hybrid_clock.cc:648] HybridClock initialized: now 1786466307019926 us; error 26 us; skew 500 ppm
I20260811 16:38:27.021133 9531 webserver.cc:460] Webserver started at http://127.24.175.195:34715/ using document root <none> and password file <none>
I20260811 16:38:27.021376 9531 fs_manager.cc:359] Metadata directory not provided
I20260811 16:38:27.021422 9531 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:38:27.021544 9531 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:38:27.022709 9531 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-2/data/instance:
uuid: "db0d73d3cbad423cbcace7e85ef84a6c"
format_stamp: "Formatted at 2026-08-11 16:38:27 on dist-test-slave-zj8q"
server_key: "83f65f3f4aca82be90fa839b2c3c8157"
server_key_iv: "e21ec363cd206662392b86a3af265587"
server_key_version: "encryptionkey@0"
I20260811 16:38:27.023044 9531 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-2/wal/instance:
uuid: "db0d73d3cbad423cbcace7e85ef84a6c"
format_stamp: "Formatted at 2026-08-11 16:38:27 on dist-test-slave-zj8q"
server_key: "83f65f3f4aca82be90fa839b2c3c8157"
server_key_iv: "e21ec363cd206662392b86a3af265587"
server_key_version: "encryptionkey@0"
I20260811 16:38:27.024230 9531 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:38:27.024870 9550 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:27.025019 9531 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:38:27.025105 9531 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-2/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-2/wal
uuid: "db0d73d3cbad423cbcace7e85ef84a6c"
format_stamp: "Formatted at 2026-08-11 16:38:27 on dist-test-slave-zj8q"
server_key: "83f65f3f4aca82be90fa839b2c3c8157"
server_key_iv: "e21ec363cd206662392b86a3af265587"
server_key_version: "encryptionkey@0"
I20260811 16:38:27.025180 9531 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:38:27.046391 9531 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:38:27.046669 9531 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:38:27.046793 9531 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:38:27.046991 9531 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:38:27.047310 9531 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:38:27.047346 9531 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:27.047374 9531 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:38:27.047397 9531 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:27.052623 9531 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.195:34159
I20260811 16:38:27.052663 9758 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.195:34159 every 8 connection(s)
I20260811 16:38:27.052963 9531 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
I20260811 16:38:27.053359 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 9531
I20260811 16:38:27.053450 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-2/wal/instance
I20260811 16:38:27.053666 25279 external_mini_cluster.cc:1428] Setting key a9dc751560e0a894bad0a9b10616ab7d
I20260811 16:38:27.057915 9064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:27.053812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.195:39261 (local address 127.24.175.254:33565)
0811 16:38:27.053862 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:27.053864 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:27.054115 (+ 251us) server_negotiation.cc:407] Connection header received
0811 16:38:27.054699 (+ 584us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:27.054700 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:27.054711 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:27.054747 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:27.055363 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:27.055850 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:27.056772 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:27.056947 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:27.056991 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:27.057690 (+ 699us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:38:27.057692 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:38:27.057692 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:38:27.057696 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:38:27.057711 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:38:27.057716 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:38:27.057757 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:27.057830 (+ 73us) server_negotiation.cc:299] Negotiation successful
0811 16:38:27.057857 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 16:38:27.058075 9761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:27.053810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:33565 (local address 127.24.175.195:39261)
0811 16:38:27.054003 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:27.054042 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:27.054598 (+ 556us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:27.054805 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:27.054809 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:27.054817 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:27.055301 (+ 484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:27.055306 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:27.055914 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:27.055914 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:27.056710 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:27.056712 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:27.057002 (+ 290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:27.057002 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:27.057107 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:27.057559 (+ 452us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 16:38:27.057559 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:27.057588 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 16:38:27.057610 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:38:27.057764 (+ 154us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:38:27.057767 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:38:27.057769 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 16:38:27.057815 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 16:38:27.057896 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":77,"threads_started":1}
I20260811 16:38:27.058508 9759 heartbeater.cc:347] Connected to a master server at 127.24.175.254:33565
I20260811 16:38:27.058596 9759 heartbeater.cc:464] Registering TS with master...
I20260811 16:38:27.058772 9759 heartbeater.cc:511] Master 127.24.175.254:33565 requested a full tablet report, sending...
I20260811 16:38:27.059132 8958 ts_manager.cc:194] Registered new tserver with Master: db0d73d3cbad423cbcace7e85ef84a6c (127.24.175.195:34159)
I20260811 16:38:27.059454 8958 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.24.175.195:39261
I20260811 16:38:27.065359 25279 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 16:38:27.067239 9064 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:38:27.066766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49528 (local address 127.24.175.254:33565)
0811 16:38:27.066837 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:27.066839 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:27.066898 (+ 59us) server_negotiation.cc:407] Connection header received
0811 16:38:27.066964 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:27.066964 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:27.066977 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:27.067021 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:27.067170 (+ 149us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49528: BlockingRecv error: recv got EOF from 127.0.0.1:49528 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 16:38:27.067284 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 9066
I20260811 16:38:27.086936 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 9296
I20260811 16:38:27.103607 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 9531
I20260811 16:38:27.128413 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 8913
2026-08-11T16:38:27Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (684 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-11T16:38:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:38:27Z Disabled control of system clock
I20260811 16:38:27.165906 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466249441839-25279-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466249441839-25279-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466249441839-25279-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:46385
--webserver_interface=127.24.175.254
--webserver_port=0
--builtin_ntp_servers=127.24.175.212:42629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.175.254:46385
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 16:38:27.246510 9776 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:38:27.246713 9776 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:38:27.246764 9776 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:38:27.247920 9776 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:38:27.247963 9776 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:38:27.247977 9776 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:38:27.247987 9776 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:38:27.247997 9776 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:38:27.249285 9776 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:42629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466249441839-25279-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466249441839-25279-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.175.254:46385
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:46385
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9776
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466249441839-25279-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:38:27.249476 9776 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:38:27.249747 9776 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:38:27.254418 9783 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:38:27.254434 9788 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:38:27.254498 9776 server_base.cc:1034] running on GCE node
W20260811 16:38:27.254434 9790 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:38:27.254834 9776 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:38:27.255155 9776 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:38:27.256309 9776 hybrid_clock.cc:648] HybridClock initialized: now 1786466307256294 us; error 31 us; skew 500 ppm
I20260811 16:38:27.257500 9776 webserver.cc:460] Webserver started at http://127.24.175.254:46025/ using document root <none> and password file <none>
I20260811 16:38:27.257745 9776 fs_manager.cc:359] Metadata directory not provided
I20260811 16:38:27.257790 9776 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:38:27.257913 9776 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:38:27.259002 9776 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466249441839-25279-0/minicluster-data/master-0/data/instance:
uuid: "5744616dce47465ababfd9744de18fc6"
format_stamp: "Formatted at 2026-08-11 16:38:27 on dist-test-slave-zj8q"
server_key: "8f3dff7bc329e746f939a546aab8e94f"
server_key_iv: "08059158e3ce78ae5ef50462f76dbd83"
server_key_version: "encryptionkey@0"
I20260811 16:38:27.259349 9776 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466249441839-25279-0/minicluster-data/master-0/wal/instance:
uuid: "5744616dce47465ababfd9744de18fc6"
format_stamp: "Formatted at 2026-08-11 16:38:27 on dist-test-slave-zj8q"
server_key: "8f3dff7bc329e746f939a546aab8e94f"
server_key_iv: "08059158e3ce78ae5ef50462f76dbd83"
server_key_version: "encryptionkey@0"
I20260811 16:38:27.260594 9776 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 16:38:27.261286 9799 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:27.261445 9776 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 16:38:27.261530 9776 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466249441839-25279-0/minicluster-data/master-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466249441839-25279-0/minicluster-data/master-0/wal
uuid: "5744616dce47465ababfd9744de18fc6"
format_stamp: "Formatted at 2026-08-11 16:38:27 on dist-test-slave-zj8q"
server_key: "8f3dff7bc329e746f939a546aab8e94f"
server_key_iv: "08059158e3ce78ae5ef50462f76dbd83"
server_key_version: "encryptionkey@0"
I20260811 16:38:27.261600 9776 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466249441839-25279-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466249441839-25279-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466249441839-25279-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:38:27.264835 9776 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:38:27.265082 9776 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:38:27.265200 9776 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:38:27.269035 9776 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.254:46385
I20260811 16:38:27.269068 9889 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.254:46385 every 8 connection(s)
I20260811 16:38:27.269369 9776 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
I20260811 16:38:27.269923 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 9776
I20260811 16:38:27.270002 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466249441839-25279-0/minicluster-data/master-0/wal/instance
I20260811 16:38:27.270023 9891 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:38:27.270211 25279 external_mini_cluster.cc:1428] Setting key a517d551e903cd6cd3138f6c8092c365
I20260811 16:38:27.272703 9900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:27.270725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46690 (local address 127.24.175.254:46385)
0811 16:38:27.270924 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:27.270931 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:27.270954 (+ 23us) server_negotiation.cc:407] Connection header received
0811 16:38:27.271536 (+ 582us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:27.271542 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:27.271580 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:27.271686 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:27.272292 (+ 606us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:38:27.272295 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:38:27.272295 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:38:27.272299 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:38:27.272337 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:38:27.272346 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:38:27.272399 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:27.272477 (+ 78us) server_negotiation.cc:299] Negotiation successful
0811 16:38:27.272524 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":89,"threads_started":1}
I20260811 16:38:27.273655 9891 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5744616dce47465ababfd9744de18fc6: Bootstrap starting.
I20260811 16:38:27.274266 9891 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5744616dce47465ababfd9744de18fc6: Neither blocks nor log segments found. Creating new log.
I20260811 16:38:27.274530 9891 log.cc:824] T 00000000000000000000000000000000 P 5744616dce47465ababfd9744de18fc6: Log is configured to *not* fsync() on all Append() calls
I20260811 16:38:27.275147 9891 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5744616dce47465ababfd9744de18fc6: No bootstrap required, opened a new log
I20260811 16:38:27.276444 9891 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5744616dce47465ababfd9744de18fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5744616dce47465ababfd9744de18fc6" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 46385 } }
I20260811 16:38:27.276576 9891 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5744616dce47465ababfd9744de18fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:38:27.276620 9891 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5744616dce47465ababfd9744de18fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5744616dce47465ababfd9744de18fc6, State: Initialized, Role: FOLLOWER
I20260811 16:38:27.276727 9891 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5744616dce47465ababfd9744de18fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5744616dce47465ababfd9744de18fc6" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 46385 } }
I20260811 16:38:27.276787 9891 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5744616dce47465ababfd9744de18fc6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:38:27.276816 9891 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5744616dce47465ababfd9744de18fc6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:38:27.276860 9891 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5744616dce47465ababfd9744de18fc6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:38:27.277321 9891 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5744616dce47465ababfd9744de18fc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5744616dce47465ababfd9744de18fc6" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 46385 } }
I20260811 16:38:27.277413 9891 leader_election.cc:302] T 00000000000000000000000000000000 P 5744616dce47465ababfd9744de18fc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5744616dce47465ababfd9744de18fc6; no voters:
I20260811 16:38:27.277555 9891 leader_election.cc:288] T 00000000000000000000000000000000 P 5744616dce47465ababfd9744de18fc6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:38:27.277798 9891 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5744616dce47465ababfd9744de18fc6 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:38:27.277806 9904 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5744616dce47465ababfd9744de18fc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:38:27.277952 9904 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5744616dce47465ababfd9744de18fc6 [term 1 LEADER]: Becoming Leader. State: Replica: 5744616dce47465ababfd9744de18fc6, State: Running, Role: LEADER
I20260811 16:38:27.278065 9904 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5744616dce47465ababfd9744de18fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5744616dce47465ababfd9744de18fc6" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 46385 } }
I20260811 16:38:27.278402 9904 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5744616dce47465ababfd9744de18fc6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5744616dce47465ababfd9744de18fc6. Latest consensus state: current_term: 1 leader_uuid: "5744616dce47465ababfd9744de18fc6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5744616dce47465ababfd9744de18fc6" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 46385 } } }
I20260811 16:38:27.278429 9907 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5744616dce47465ababfd9744de18fc6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5744616dce47465ababfd9744de18fc6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5744616dce47465ababfd9744de18fc6" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 46385 } } }
I20260811 16:38:27.278759 9907 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5744616dce47465ababfd9744de18fc6 [sys.catalog]: This master's current role is: LEADER
I20260811 16:38:27.278484 9904 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5744616dce47465ababfd9744de18fc6 [sys.catalog]: This master's current role is: LEADER
I20260811 16:38:27.279431 9923 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:38:27.279870 9923 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:38:27.281136 9923 catalog_manager.cc:1347] Generated new cluster ID: a11368a218f04c37a15a83a021f3e44c
I20260811 16:38:27.281180 9923 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:38:27.294373 9923 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:38:27.294533 9923 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:38:27.301721 9923 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5744616dce47465ababfd9744de18fc6: Generated new TSK 0
I20260811 16:38:27.301920 9923 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:38:27.310264 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.193:0
--local_ip_for_outbound_sockets=127.24.175.193
--webserver_interface=127.24.175.193
--webserver_port=0
--tserver_master_addrs=127.24.175.254:46385
--builtin_ntp_servers=127.24.175.212:42629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 16:38:27.393266 9941 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:38:27.393489 9941 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:38:27.393518 9941 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:38:27.394773 9941 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:38:27.394814 9941 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:38:27.394848 9941 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.193
I20260811 16:38:27.396199 9941 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:42629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.175.193
--webserver_port=0
--tserver_master_addrs=127.24.175.254:46385
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9941
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.193
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:38:27.396440 9941 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:38:27.396775 9941 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:38:27.401621 9954 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:38:27.401626 9952 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:38:27.401868 9941 server_base.cc:1034] running on GCE node
W20260811 16:38:27.401633 9956 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:38:27.402199 9941 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:38:27.402444 9941 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:38:27.403601 9941 hybrid_clock.cc:648] HybridClock initialized: now 1786466307403589 us; error 33 us; skew 500 ppm
I20260811 16:38:27.404789 9941 webserver.cc:460] Webserver started at http://127.24.175.193:41723/ using document root <none> and password file <none>
I20260811 16:38:27.405025 9941 fs_manager.cc:359] Metadata directory not provided
I20260811 16:38:27.405077 9941 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:38:27.405206 9941 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:38:27.406330 9941 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-0/data/instance:
uuid: "e38c039c2b75435396403446ff42709e"
format_stamp: "Formatted at 2026-08-11 16:38:27 on dist-test-slave-zj8q"
server_key: "2e1696a455d5a765fd8fcf7e9dc10514"
server_key_iv: "f7c6bc1e313e0c0a25adc0843d67c8a6"
server_key_version: "encryptionkey@0"
I20260811 16:38:27.406664 9941 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-0/wal/instance:
uuid: "e38c039c2b75435396403446ff42709e"
format_stamp: "Formatted at 2026-08-11 16:38:27 on dist-test-slave-zj8q"
server_key: "2e1696a455d5a765fd8fcf7e9dc10514"
server_key_iv: "f7c6bc1e313e0c0a25adc0843d67c8a6"
server_key_version: "encryptionkey@0"
I20260811 16:38:27.407861 9941 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:38:27.408495 9963 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:27.408665 9941 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 16:38:27.408748 9941 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-0/wal
uuid: "e38c039c2b75435396403446ff42709e"
format_stamp: "Formatted at 2026-08-11 16:38:27 on dist-test-slave-zj8q"
server_key: "2e1696a455d5a765fd8fcf7e9dc10514"
server_key_iv: "f7c6bc1e313e0c0a25adc0843d67c8a6"
server_key_version: "encryptionkey@0"
I20260811 16:38:27.408813 9941 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:38:27.411993 9941 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:38:27.412222 9941 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:38:27.412344 9941 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:38:27.412521 9941 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:38:27.412797 9941 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:38:27.412830 9941 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:27.412855 9941 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:38:27.412878 9941 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:27.418213 9941 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.193:36971
I20260811 16:38:27.418263 10184 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.193:36971 every 8 connection(s)
I20260811 16:38:27.418548 9941 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
I20260811 16:38:27.421175 9900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:27.419195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:44905 (local address 127.24.175.254:46385)
0811 16:38:27.419252 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:27.419254 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:27.419453 (+ 199us) server_negotiation.cc:407] Connection header received
0811 16:38:27.419896 (+ 443us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:27.419897 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:27.419902 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:27.419960 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:27.421022 (+ 1062us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:38:27.421022 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:38:27.421022 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:38:27.421025 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:38:27.421034 (+ 9us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:38:27.421037 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:38:27.421066 (+ 29us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:27.421116 (+ 50us) server_negotiation.cc:299] Negotiation successful
0811 16:38:27.421126 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 16:38:27.421356 10188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:27.419173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:46385 (local address 127.24.175.193:44905)
0811 16:38:27.419350 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:27.419387 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:27.419822 (+ 435us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:27.420012 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:27.420014 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:27.420023 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:27.420905 (+ 882us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 16:38:27.420906 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:27.420933 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 16:38:27.420961 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:38:27.421073 (+ 112us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:38:27.421075 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:38:27.421077 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 16:38:27.421122 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 16:38:27.421168 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":72,"threads_started":1}
I20260811 16:38:27.421819 10186 heartbeater.cc:347] Connected to a master server at 127.24.175.254:46385
I20260811 16:38:27.421903 10186 heartbeater.cc:464] Registering TS with master...
I20260811 16:38:27.422014 10186 heartbeater.cc:511] Master 127.24.175.254:46385 requested a full tablet report, sending...
I20260811 16:38:27.422490 9833 ts_manager.cc:194] Registered new tserver with Master: e38c039c2b75435396403446ff42709e (127.24.175.193:36971)
I20260811 16:38:27.425773 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 9941
I20260811 16:38:27.425843 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-0/wal/instance
I20260811 16:38:27.425987 25279 external_mini_cluster.cc:1428] Setting key 043cbc8e7fff8d4fd7a5e554b7eb2f3e
I20260811 16:38:27.426816 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.194:0
--local_ip_for_outbound_sockets=127.24.175.194
--webserver_interface=127.24.175.194
--webserver_port=0
--tserver_master_addrs=127.24.175.254:46385
--builtin_ntp_servers=127.24.175.212:42629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 16:38:27.506208 10190 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:38:27.506397 10190 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:38:27.506424 10190 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:38:27.507540 10190 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:38:27.507578 10190 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:38:27.507611 10190 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.194
I20260811 16:38:27.508912 10190 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:42629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.175.194
--webserver_port=0
--tserver_master_addrs=127.24.175.254:46385
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10190
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.194
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:38:27.509127 10190 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:38:27.509379 10190 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:38:27.514122 10201 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:38:27.514178 10205 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:38:27.514290 10200 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:38:27.514267 10190 server_base.cc:1034] running on GCE node
I20260811 16:38:27.514593 10190 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:38:27.514827 10190 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:38:27.515970 10190 hybrid_clock.cc:648] HybridClock initialized: now 1786466307515959 us; error 29 us; skew 500 ppm
I20260811 16:38:27.517143 10190 webserver.cc:460] Webserver started at http://127.24.175.194:41905/ using document root <none> and password file <none>
I20260811 16:38:27.517357 10190 fs_manager.cc:359] Metadata directory not provided
I20260811 16:38:27.517406 10190 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:38:27.517531 10190 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:38:27.518566 10190 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-1/data/instance:
uuid: "83608897e13542eda79113cd810f8ab7"
format_stamp: "Formatted at 2026-08-11 16:38:27 on dist-test-slave-zj8q"
server_key: "ff1699b8272fcb9c558e6e8abd3459a4"
server_key_iv: "f8854bc2cbc04ff8988ed08f8d6109ec"
server_key_version: "encryptionkey@0"
I20260811 16:38:27.518903 10190 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-1/wal/instance:
uuid: "83608897e13542eda79113cd810f8ab7"
format_stamp: "Formatted at 2026-08-11 16:38:27 on dist-test-slave-zj8q"
server_key: "ff1699b8272fcb9c558e6e8abd3459a4"
server_key_iv: "f8854bc2cbc04ff8988ed08f8d6109ec"
server_key_version: "encryptionkey@0"
I20260811 16:38:27.520076 10190 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:38:27.520682 10216 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:27.520828 10190 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:38:27.520910 10190 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-1/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-1/wal
uuid: "83608897e13542eda79113cd810f8ab7"
format_stamp: "Formatted at 2026-08-11 16:38:27 on dist-test-slave-zj8q"
server_key: "ff1699b8272fcb9c558e6e8abd3459a4"
server_key_iv: "f8854bc2cbc04ff8988ed08f8d6109ec"
server_key_version: "encryptionkey@0"
I20260811 16:38:27.520972 10190 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:38:27.524164 10190 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:38:27.524384 10190 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:38:27.524497 10190 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:38:27.524686 10190 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:38:27.524964 10190 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:38:27.524996 10190 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:27.525022 10190 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:38:27.525046 10190 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:27.530342 10190 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.194:36813
I20260811 16:38:27.530375 10414 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.194:36813 every 8 connection(s)
I20260811 16:38:27.530658 10190 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
I20260811 16:38:27.531461 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 10190
I20260811 16:38:27.531541 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-1/wal/instance
I20260811 16:38:27.531714 25279 external_mini_cluster.cc:1428] Setting key d53cb3920d05e1b67fa444a0971e738e
I20260811 16:38:27.532677 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.195:0
--local_ip_for_outbound_sockets=127.24.175.195
--webserver_interface=127.24.175.195
--webserver_port=0
--tserver_master_addrs=127.24.175.254:46385
--builtin_ntp_servers=127.24.175.212:42629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260811 16:38:27.533424 9900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:27.531325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:34665 (local address 127.24.175.254:46385)
0811 16:38:27.531381 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:27.531383 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:27.531551 (+ 168us) server_negotiation.cc:407] Connection header received
0811 16:38:27.531993 (+ 442us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:27.531994 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:27.531999 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:27.532051 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:27.533217 (+ 1166us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:38:27.533219 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:38:27.533219 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:38:27.533223 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:38:27.533244 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:38:27.533248 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:38:27.533293 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:27.533361 (+ 68us) server_negotiation.cc:299] Negotiation successful
0811 16:38:27.533372 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 16:38:27.533618 10420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:27.531277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:46385 (local address 127.24.175.194:34665)
0811 16:38:27.531445 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:27.531480 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:27.531906 (+ 426us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:27.532105 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:27.532108 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:27.532115 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:27.533068 (+ 953us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 16:38:27.533068 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:27.533103 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 16:38:27.533134 (+ 31us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:38:27.533294 (+ 160us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:38:27.533298 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:38:27.533300 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 16:38:27.533369 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 16:38:27.533427 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":81,"threads_started":1}
I20260811 16:38:27.534519 10416 heartbeater.cc:347] Connected to a master server at 127.24.175.254:46385
I20260811 16:38:27.534603 10416 heartbeater.cc:464] Registering TS with master...
I20260811 16:38:27.534734 10416 heartbeater.cc:511] Master 127.24.175.254:46385 requested a full tablet report, sending...
I20260811 16:38:27.535050 9833 ts_manager.cc:194] Registered new tserver with Master: 83608897e13542eda79113cd810f8ab7 (127.24.175.194:36813)
W20260811 16:38:27.613072 10421 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:38:27.613268 10421 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:38:27.613289 10421 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:38:27.614404 10421 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:38:27.614436 10421 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:38:27.614459 10421 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.195
I20260811 16:38:27.615723 10421 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:42629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.175.195
--webserver_port=0
--tserver_master_addrs=127.24.175.254:46385
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10421
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.195
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:38:27.615891 10421 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:38:27.616114 10421 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:38:27.620810 10430 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:38:27.620842 10439 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:38:27.620880 10421 server_base.cc:1034] running on GCE node
W20260811 16:38:27.620831 10433 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:38:27.621207 10421 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:38:27.621435 10421 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:38:27.622574 10421 hybrid_clock.cc:648] HybridClock initialized: now 1786466307622557 us; error 28 us; skew 500 ppm
I20260811 16:38:27.623790 10421 webserver.cc:460] Webserver started at http://127.24.175.195:45673/ using document root <none> and password file <none>
I20260811 16:38:27.624001 10421 fs_manager.cc:359] Metadata directory not provided
I20260811 16:38:27.624056 10421 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:38:27.624178 10421 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:38:27.625262 10421 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-2/data/instance:
uuid: "b4ee1e733ef6458eb3c69b6408b48c57"
format_stamp: "Formatted at 2026-08-11 16:38:27 on dist-test-slave-zj8q"
server_key: "3bc1c67638f1b250286786101aed96d5"
server_key_iv: "5fee602f6690cb0cd19f65b5290a9004"
server_key_version: "encryptionkey@0"
I20260811 16:38:27.625610 10421 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-2/wal/instance:
uuid: "b4ee1e733ef6458eb3c69b6408b48c57"
format_stamp: "Formatted at 2026-08-11 16:38:27 on dist-test-slave-zj8q"
server_key: "3bc1c67638f1b250286786101aed96d5"
server_key_iv: "5fee602f6690cb0cd19f65b5290a9004"
server_key_version: "encryptionkey@0"
I20260811 16:38:27.626856 10421 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:38:27.627466 10446 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:27.627636 10421 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:38:27.627736 10421 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-2/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-2/wal
uuid: "b4ee1e733ef6458eb3c69b6408b48c57"
format_stamp: "Formatted at 2026-08-11 16:38:27 on dist-test-slave-zj8q"
server_key: "3bc1c67638f1b250286786101aed96d5"
server_key_iv: "5fee602f6690cb0cd19f65b5290a9004"
server_key_version: "encryptionkey@0"
I20260811 16:38:27.627794 10421 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:38:27.630870 10421 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:38:27.631073 10421 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:38:27.631160 10421 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:38:27.631313 10421 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:38:27.631546 10421 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:38:27.631575 10421 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:27.631593 10421 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:38:27.631610 10421 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:27.636791 10421 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.195:42181
I20260811 16:38:27.636826 10650 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.195:42181 every 8 connection(s)
I20260811 16:38:27.637094 10421 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
I20260811 16:38:27.637924 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 10421
I20260811 16:38:27.638008 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466249441839-25279-0/minicluster-data/ts-2/wal/instance
I20260811 16:38:27.638206 25279 external_mini_cluster.cc:1428] Setting key 11ebec5c12db987a024dac3a30c7bcff
I20260811 16:38:27.639962 9900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:27.637744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.195:49447 (local address 127.24.175.254:46385)
0811 16:38:27.637812 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:27.637814 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:27.637995 (+ 181us) server_negotiation.cc:407] Connection header received
0811 16:38:27.638606 (+ 611us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:27.638607 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:27.638614 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:27.638671 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:27.639784 (+ 1113us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:38:27.639785 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:38:27.639786 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:38:27.639790 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:38:27.639805 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:38:27.639810 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:38:27.639855 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:27.639900 (+ 45us) server_negotiation.cc:299] Negotiation successful
0811 16:38:27.639911 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 16:38:27.640132 10656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:27.637693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:46385 (local address 127.24.175.195:49447)
0811 16:38:27.637881 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:27.637918 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:27.638428 (+ 510us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:27.638741 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:27.638746 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:27.638756 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:27.639639 (+ 883us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 16:38:27.639639 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:27.639676 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 16:38:27.639709 (+ 33us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:38:27.639854 (+ 145us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:38:27.639857 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:38:27.639859 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 16:38:27.639906 (+ 47us) client_negotiation.cc:240] Negotiation successful
0811 16:38:27.639950 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":95,"threads_started":1}
I20260811 16:38:27.640534 10653 heartbeater.cc:347] Connected to a master server at 127.24.175.254:46385
I20260811 16:38:27.640607 10653 heartbeater.cc:464] Registering TS with master...
I20260811 16:38:27.640741 10653 heartbeater.cc:511] Master 127.24.175.254:46385 requested a full tablet report, sending...
I20260811 16:38:27.641057 9833 ts_manager.cc:194] Registered new tserver with Master: b4ee1e733ef6458eb3c69b6408b48c57 (127.24.175.195:42181)
I20260811 16:38:27.649767 25279 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 16:38:27.651479 9900 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:38:27.651027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46702 (local address 127.24.175.254:46385)
0811 16:38:27.651066 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:27.651068 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:27.651186 (+ 118us) server_negotiation.cc:407] Connection header received
0811 16:38:27.651238 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:27.651239 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:27.651243 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:27.651300 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:27.651418 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46702: BlockingRecv error: recv got EOF from 127.0.0.1:46702 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 16:38:27.651533 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 9941
I20260811 16:38:27.661886 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 10190
I20260811 16:38:27.675283 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 10421
I20260811 16:38:27.689249 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 9776
2026-08-11T16:38:27Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (555 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:38:27 dist-test-slave-zj8q krb5kdc[10667](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:38:27 dist-test-slave-zj8q krb5kdc[10667](info): set up 2 sockets
Aug 11 16:38:27 dist-test-slave-zj8q krb5kdc[10667](info): commencing operation
krb5kdc: starting...
W20260811 16:38:28.863555 25279 mini_kdc.cc:121] Time spent starting KDC: real 1.149s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Aug 11 16:38:28 dist-test-slave-zj8q krb5kdc[10667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466308, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:38:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:38:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab.
Entry for principal kudu/127.24.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab.
I20260811 16:38:28.976778 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:41435
--webserver_interface=127.24.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:42893
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.175.254:41435
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:38:29.057926 10696 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:38:29.058130 10696 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:38:29.058179 10696 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:38:29.059298 10696 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:38:29.059337 10696 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:38:29.059350 10696 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:38:29.059361 10696 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:38:29.059371 10696 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:38:29.060828 10696 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:42893
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.175.254:41435
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:41435
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10696
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:38:29.061031 10696 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:38:29.061241 10696 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:38:29.065858 10703 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:38:29.065912 10706 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:38:29.065863 10704 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:38:29.066133 10696 server_base.cc:1034] running on GCE node
I20260811 16:38:29.066453 10696 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:38:29.066735 10696 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:38:29.067888 10696 hybrid_clock.cc:648] HybridClock initialized: now 1786466309067864 us; error 40 us; skew 500 ppm
Aug 11 16:38:29 dist-test-slave-zj8q krb5kdc[10667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466309, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:38:29.070315 10696 init.cc:377] Logged in from keytab as kudu/127.24.175.254@KRBTEST.COM (short username kudu)
I20260811 16:38:29.070761 10696 webserver.cc:460] Webserver started at http://127.24.175.254:37749/ using document root <none> and password file <none>
I20260811 16:38:29.070986 10696 fs_manager.cc:359] Metadata directory not provided
I20260811 16:38:29.071035 10696 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:38:29.071170 10696 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:38:29.072175 10696 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/master-0/data/instance:
uuid: "95a40c707e224f1f895f1dee9d2be1aa"
format_stamp: "Formatted at 2026-08-11 16:38:29 on dist-test-slave-zj8q"
server_key: "183ddc9a2b09e8279c609e6ef72a8489"
server_key_iv: "1a32907024a16e831711dfa4ed7ab664"
server_key_version: "encryptionkey@0"
I20260811 16:38:29.072503 10696 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/master-0/wal/instance:
uuid: "95a40c707e224f1f895f1dee9d2be1aa"
format_stamp: "Formatted at 2026-08-11 16:38:29 on dist-test-slave-zj8q"
server_key: "183ddc9a2b09e8279c609e6ef72a8489"
server_key_iv: "1a32907024a16e831711dfa4ed7ab664"
server_key_version: "encryptionkey@0"
I20260811 16:38:29.073719 10696 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 16:38:29.074429 10723 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:29.074579 10696 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:29.074663 10696 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/master-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/master-0/wal
uuid: "95a40c707e224f1f895f1dee9d2be1aa"
format_stamp: "Formatted at 2026-08-11 16:38:29 on dist-test-slave-zj8q"
server_key: "183ddc9a2b09e8279c609e6ef72a8489"
server_key_iv: "1a32907024a16e831711dfa4ed7ab664"
server_key_version: "encryptionkey@0"
I20260811 16:38:29.074734 10696 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:38:29.084928 10696 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:38:29.086956 10696 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:38:29.087090 10696 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:38:29.090950 10696 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.254:41435
I20260811 16:38:29.090986 10814 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.254:41435 every 8 connection(s)
I20260811 16:38:29.091291 10696 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
I20260811 16:38:29.091512 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 10696
I20260811 16:38:29.091612 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/master-0/wal/instance
I20260811 16:38:29.091789 25279 external_mini_cluster.cc:1428] Setting key 3217f6b00123c20db64ab444dd00aea3
I20260811 16:38:29.092382 10815 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:38:29.094894 10815 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 95a40c707e224f1f895f1dee9d2be1aa: Bootstrap starting.
I20260811 16:38:29.095484 10815 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 95a40c707e224f1f895f1dee9d2be1aa: Neither blocks nor log segments found. Creating new log.
I20260811 16:38:29.095763 10815 log.cc:824] T 00000000000000000000000000000000 P 95a40c707e224f1f895f1dee9d2be1aa: Log is configured to *not* fsync() on all Append() calls
I20260811 16:38:29.096455 10815 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 95a40c707e224f1f895f1dee9d2be1aa: No bootstrap required, opened a new log
Aug 11 16:38:29 dist-test-slave-zj8q krb5kdc[10667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466308, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:38:29.098272 10815 raft_consensus.cc:348] T 00000000000000000000000000000000 P 95a40c707e224f1f895f1dee9d2be1aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95a40c707e224f1f895f1dee9d2be1aa" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 41435 } }
I20260811 16:38:29.098430 10815 raft_consensus.cc:374] T 00000000000000000000000000000000 P 95a40c707e224f1f895f1dee9d2be1aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:38:29.098480 10815 raft_consensus.cc:729] T 00000000000000000000000000000000 P 95a40c707e224f1f895f1dee9d2be1aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95a40c707e224f1f895f1dee9d2be1aa, State: Initialized, Role: FOLLOWER
I20260811 16:38:29.098611 10815 consensus_queue.cc:260] T 00000000000000000000000000000000 P 95a40c707e224f1f895f1dee9d2be1aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95a40c707e224f1f895f1dee9d2be1aa" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 41435 } }
I20260811 16:38:29.098682 10815 raft_consensus.cc:388] T 00000000000000000000000000000000 P 95a40c707e224f1f895f1dee9d2be1aa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:38:29.098706 10815 raft_consensus.cc:482] T 00000000000000000000000000000000 P 95a40c707e224f1f895f1dee9d2be1aa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:38:29.098755 10815 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 95a40c707e224f1f895f1dee9d2be1aa [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:38:29.099351 10815 raft_consensus.cc:504] T 00000000000000000000000000000000 P 95a40c707e224f1f895f1dee9d2be1aa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95a40c707e224f1f895f1dee9d2be1aa" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 41435 } }
I20260811 16:38:29.099442 10815 leader_election.cc:302] T 00000000000000000000000000000000 P 95a40c707e224f1f895f1dee9d2be1aa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 95a40c707e224f1f895f1dee9d2be1aa; no voters:
I20260811 16:38:29.099592 10815 leader_election.cc:288] T 00000000000000000000000000000000 P 95a40c707e224f1f895f1dee9d2be1aa [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:38:29.099634 10822 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 95a40c707e224f1f895f1dee9d2be1aa [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:38:29.099778 10822 raft_consensus.cc:686] T 00000000000000000000000000000000 P 95a40c707e224f1f895f1dee9d2be1aa [term 1 LEADER]: Becoming Leader. State: Replica: 95a40c707e224f1f895f1dee9d2be1aa, State: Running, Role: LEADER
I20260811 16:38:29.099857 10815 sys_catalog.cc:564] T 00000000000000000000000000000000 P 95a40c707e224f1f895f1dee9d2be1aa [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:38:29.099864 10822 consensus_queue.cc:237] T 00000000000000000000000000000000 P 95a40c707e224f1f895f1dee9d2be1aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95a40c707e224f1f895f1dee9d2be1aa" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 41435 } }
I20260811 16:38:29.100239 10823 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95a40c707e224f1f895f1dee9d2be1aa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "95a40c707e224f1f895f1dee9d2be1aa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95a40c707e224f1f895f1dee9d2be1aa" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 41435 } } }
I20260811 16:38:29.100324 10823 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95a40c707e224f1f895f1dee9d2be1aa [sys.catalog]: This master's current role is: LEADER
I20260811 16:38:29.100476 10824 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95a40c707e224f1f895f1dee9d2be1aa [sys.catalog]: SysCatalogTable state changed. Reason: New leader 95a40c707e224f1f895f1dee9d2be1aa. Latest consensus state: current_term: 1 leader_uuid: "95a40c707e224f1f895f1dee9d2be1aa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95a40c707e224f1f895f1dee9d2be1aa" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 41435 } } }
I20260811 16:38:29.100534 10824 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95a40c707e224f1f895f1dee9d2be1aa [sys.catalog]: This master's current role is: LEADER
I20260811 16:38:29.101081 10830 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:38:29.101572 10830 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:38:29.101824 10820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:29.092251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37938 (local address 127.24.175.254:41435)
0811 16:38:29.092463 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:29.092471 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:29.092495 (+ 24us) server_negotiation.cc:407] Connection header received
0811 16:38:29.092941 (+ 446us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:29.092948 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:29.092993 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:29.093110 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:29.093734 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:29.094643 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:29.095426 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:29.095868 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:29.095971 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:29.098084 (+ 2113us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:38:29.098088 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:38:29.098089 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:38:29.098099 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:38:29.099818 (+ 1719us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:29.100213 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:29.100216 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:29.100217 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:29.100317 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:29.100535 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:29.100536 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:29.100536 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:29.100911 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:38:29.101478 (+ 567us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:29.101545 (+ 67us) server_negotiation.cc:299] Negotiation successful
0811 16:38:29.101670 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":117,"threads_started":1}
I20260811 16:38:29.103034 10830 catalog_manager.cc:1347] Generated new cluster ID: 56d44ae6db8b4a0cae93a7d00e2cf1de
I20260811 16:38:29.103091 10830 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:38:29.115021 10830 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:38:29.115717 10830 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:38:29.124679 10830 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 95a40c707e224f1f895f1dee9d2be1aa: Generated new TSK 0
I20260811 16:38:29.124846 10830 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.175.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab.
Entry for principal kudu/127.24.175.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab.
I20260811 16:38:29.150874 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.193:0
--local_ip_for_outbound_sockets=127.24.175.193
--webserver_interface=127.24.175.193
--webserver_port=0
--tserver_master_addrs=127.24.175.254:41435
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab
--principal=kudu/127.24.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:42893
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:38:29.230434 10849 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:38:29.230634 10849 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:38:29.230664 10849 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:38:29.231766 10849 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:38:29.231805 10849 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:38:29.231839 10849 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.193
I20260811 16:38:29.233275 10849 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:42893
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab
--principal=kudu/127.24.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.175.193
--webserver_port=0
--tserver_master_addrs=127.24.175.254:41435
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10849
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.193
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:38:29.233493 10849 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:38:29.233690 10849 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:38:29.238660 10860 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:38:29.238667 10855 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:38:29.238667 10856 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:38:29.238957 10849 server_base.cc:1034] running on GCE node
I20260811 16:38:29.239137 10849 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:38:29.239355 10849 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:38:29.240496 10849 hybrid_clock.cc:648] HybridClock initialized: now 1786466309240488 us; error 33 us; skew 500 ppm
Aug 11 16:38:29 dist-test-slave-zj8q krb5kdc[10667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466309, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:38:29.246716 10849 init.cc:377] Logged in from keytab as kudu/127.24.175.193@KRBTEST.COM (short username kudu)
I20260811 16:38:29.247126 10849 webserver.cc:460] Webserver started at http://127.24.175.193:46699/ using document root <none> and password file <none>
I20260811 16:38:29.247298 10849 fs_manager.cc:359] Metadata directory not provided
I20260811 16:38:29.247336 10849 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:38:29.247424 10849 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:38:29.248461 10849 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/ts-0/data/instance:
uuid: "8301d07c922b4382b3aefe28f27d0a74"
format_stamp: "Formatted at 2026-08-11 16:38:29 on dist-test-slave-zj8q"
server_key: "c7224d9b0992a1f5798245ddeae453a2"
server_key_iv: "2381325a04bbf1c19f1562b839f7d1fd"
server_key_version: "encryptionkey@0"
I20260811 16:38:29.248764 10849 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/ts-0/wal/instance:
uuid: "8301d07c922b4382b3aefe28f27d0a74"
format_stamp: "Formatted at 2026-08-11 16:38:29 on dist-test-slave-zj8q"
server_key: "c7224d9b0992a1f5798245ddeae453a2"
server_key_iv: "2381325a04bbf1c19f1562b839f7d1fd"
server_key_version: "encryptionkey@0"
I20260811 16:38:29.249989 10849 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 16:38:29.250824 10869 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:29.250999 10849 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:38:29.251117 10849 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/ts-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/ts-0/wal
uuid: "8301d07c922b4382b3aefe28f27d0a74"
format_stamp: "Formatted at 2026-08-11 16:38:29 on dist-test-slave-zj8q"
server_key: "c7224d9b0992a1f5798245ddeae453a2"
server_key_iv: "2381325a04bbf1c19f1562b839f7d1fd"
server_key_version: "encryptionkey@0"
I20260811 16:38:29.251181 10849 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:38:29.261922 10849 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:38:29.263654 10849 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:38:29.263780 10849 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:38:29.263965 10849 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:38:29.264252 10849 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:38:29.264285 10849 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:29.264312 10849 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:38:29.264338 10849 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:29.269696 10849 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.193:34617
I20260811 16:38:29.269767 11057 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.193:34617 every 8 connection(s)
I20260811 16:38:29.270035 10849 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
I20260811 16:38:29.275692 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 10849
I20260811 16:38:29.275803 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/ts-0/wal/instance
I20260811 16:38:29.275995 25279 external_mini_cluster.cc:1428] Setting key ed0867b123b88bdf53a86ff7c0ce7988
Aug 11 16:38:29 dist-test-slave-zj8q krb5kdc[10667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466309, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.193@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:38:29.279215 10820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:29.270750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:45377 (local address 127.24.175.254:41435)
0811 16:38:29.270815 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:29.270817 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:29.270997 (+ 180us) server_negotiation.cc:407] Connection header received
0811 16:38:29.271503 (+ 506us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:29.271505 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:29.271518 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:29.271627 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:29.272566 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:29.273075 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:29.274028 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:29.274300 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:29.274353 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:29.276551 (+ 2198us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:38:29.276552 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:38:29.276553 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:38:29.276560 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:38:29.277893 (+ 1333us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:29.278347 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:29.278349 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:29.278349 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:29.278409 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:29.278620 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:29.278621 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:29.278622 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:29.278741 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:38:29.278798 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:29.279047 (+ 249us) server_negotiation.cc:299] Negotiation successful
0811 16:38:29.279129 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 16:38:29.279381 11060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:29.270704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:41435 (local address 127.24.175.193:45377)
0811 16:38:29.270880 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:29.270915 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:29.271401 (+ 486us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:29.271712 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:29.271717 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:29.272270 (+ 553us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:29.272457 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:29.272462 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:29.273158 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:29.273159 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:29.273941 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:29.273943 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:29.274381 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:29.274382 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:29.274496 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:29.274910 (+ 414us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:29.274917 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:29.276459 (+ 1542us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:38:29.277975 (+ 1516us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:29.277982 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:29.277984 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:29.278287 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:29.278460 (+ 173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:29.278461 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:29.278461 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:29.278567 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:29.278794 (+ 227us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:38:29.278802 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:38:29.278931 (+ 129us) client_negotiation.cc:769] Sending connection context
0811 16:38:29.279019 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 16:38:29.279165 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":94,"threads_started":1}
I20260811 16:38:29.279886 11058 heartbeater.cc:347] Connected to a master server at 127.24.175.254:41435
I20260811 16:38:29.279981 11058 heartbeater.cc:464] Registering TS with master...
I20260811 16:38:29.280154 11058 heartbeater.cc:511] Master 127.24.175.254:41435 requested a full tablet report, sending...
I20260811 16:38:29.280643 10757 ts_manager.cc:194] Registered new tserver with Master: 8301d07c922b4382b3aefe28f27d0a74 (127.24.175.193:34617)
I20260811 16:38:29.281245 10757 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.175.193@KRBTEST.COM'} at 127.24.175.193:45377
WARNING: no policy specified for kudu/127.24.175.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab.
Entry for principal kudu/127.24.175.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab.
I20260811 16:38:29.300093 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.194:0
--local_ip_for_outbound_sockets=127.24.175.194
--webserver_interface=127.24.175.194
--webserver_port=0
--tserver_master_addrs=127.24.175.254:41435
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab
--principal=kudu/127.24.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:42893
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:38:29.380429 11063 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:38:29.380645 11063 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:38:29.380678 11063 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:38:29.381819 11063 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:38:29.381862 11063 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:38:29.381896 11063 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.194
I20260811 16:38:29.383363 11063 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:42893
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab
--principal=kudu/127.24.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.175.194
--webserver_port=0
--tserver_master_addrs=127.24.175.254:41435
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11063
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.194
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:38:29.383602 11063 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:38:29.383809 11063 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:38:29.388751 11074 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:38:29.388772 11070 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:38:29.388788 11063 server_base.cc:1034] running on GCE node
W20260811 16:38:29.388746 11072 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:38:29.389128 11063 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:38:29.389348 11063 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:38:29.390478 11063 hybrid_clock.cc:648] HybridClock initialized: now 1786466309390465 us; error 26 us; skew 500 ppm
Aug 11 16:38:29 dist-test-slave-zj8q krb5kdc[10667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466309, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:38:29.392844 11063 init.cc:377] Logged in from keytab as kudu/127.24.175.194@KRBTEST.COM (short username kudu)
I20260811 16:38:29.393241 11063 webserver.cc:460] Webserver started at http://127.24.175.194:40395/ using document root <none> and password file <none>
I20260811 16:38:29.393407 11063 fs_manager.cc:359] Metadata directory not provided
I20260811 16:38:29.393445 11063 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:38:29.393535 11063 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:38:29.394549 11063 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/ts-1/data/instance:
uuid: "9e52ef4b85a64f639668e7006d17b42d"
format_stamp: "Formatted at 2026-08-11 16:38:29 on dist-test-slave-zj8q"
server_key: "52d48e876fe0bdc0100268952332c1d2"
server_key_iv: "ba843035939c0d64c1b9bc1370bbf3e6"
server_key_version: "encryptionkey@0"
I20260811 16:38:29.394860 11063 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/ts-1/wal/instance:
uuid: "9e52ef4b85a64f639668e7006d17b42d"
format_stamp: "Formatted at 2026-08-11 16:38:29 on dist-test-slave-zj8q"
server_key: "52d48e876fe0bdc0100268952332c1d2"
server_key_iv: "ba843035939c0d64c1b9bc1370bbf3e6"
server_key_version: "encryptionkey@0"
I20260811 16:38:29.396026 11063 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:38:29.396642 11089 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:29.396803 11063 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:38:29.396886 11063 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/ts-1/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/ts-1/wal
uuid: "9e52ef4b85a64f639668e7006d17b42d"
format_stamp: "Formatted at 2026-08-11 16:38:29 on dist-test-slave-zj8q"
server_key: "52d48e876fe0bdc0100268952332c1d2"
server_key_iv: "ba843035939c0d64c1b9bc1370bbf3e6"
server_key_version: "encryptionkey@0"
I20260811 16:38:29.396939 11063 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:38:29.420714 11063 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:38:29.422451 11063 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:38:29.422560 11063 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:38:29.422747 11063 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:38:29.423048 11063 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:38:29.423081 11063 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:29.423105 11063 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:38:29.423127 11063 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:29.428449 11063 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.194:35503
I20260811 16:38:29.428510 11275 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.194:35503 every 8 connection(s)
I20260811 16:38:29.428788 11063 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
Aug 11 16:38:29 dist-test-slave-zj8q krb5kdc[10667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466309, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.194@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:38:29.434762 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 11063
I20260811 16:38:29.434875 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/ts-1/wal/instance
I20260811 16:38:29.435075 25279 external_mini_cluster.cc:1428] Setting key 78fea4ad45ca97ea3a2842bf0918ebf8
I20260811 16:38:29.437426 10820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:29.429429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:43497 (local address 127.24.175.254:41435)
0811 16:38:29.429473 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:29.429475 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:29.429667 (+ 192us) server_negotiation.cc:407] Connection header received
0811 16:38:29.430191 (+ 524us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:29.430192 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:29.430204 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:29.430248 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:29.431164 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:29.431653 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:29.432607 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:29.432800 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:29.432857 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:29.434822 (+ 1965us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:38:29.434825 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:38:29.434825 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:38:29.434835 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:38:29.436285 (+ 1450us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:29.436629 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:29.436630 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:29.436631 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:29.436694 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:29.436885 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:29.436885 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:29.436886 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:29.437003 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:38:29.437072 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:29.437260 (+ 188us) server_negotiation.cc:299] Negotiation successful
0811 16:38:29.437336 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 16:38:29.437783 11280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:29.429389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:41435 (local address 127.24.175.194:43497)
0811 16:38:29.429556 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:29.429591 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:29.430073 (+ 482us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:29.430328 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:29.430332 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:29.430877 (+ 545us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:29.431069 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:29.431074 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:29.431736 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:29.431738 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:29.432516 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:29.432518 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:29.432867 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:29.432869 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:29.432991 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:29.433375 (+ 384us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:29.433384 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:29.434721 (+ 1337us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:38:29.436356 (+ 1635us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:29.436361 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:29.436363 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:29.436563 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:29.436751 (+ 188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:29.436752 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:29.436752 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:29.436836 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:29.437054 (+ 218us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:38:29.437056 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:38:29.437159 (+ 103us) client_negotiation.cc:769] Sending connection context
0811 16:38:29.437232 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 16:38:29.437344 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":75,"threads_started":1}
I20260811 16:38:29.438258 11276 heartbeater.cc:347] Connected to a master server at 127.24.175.254:41435
I20260811 16:38:29.438352 11276 heartbeater.cc:464] Registering TS with master...
I20260811 16:38:29.438524 11276 heartbeater.cc:511] Master 127.24.175.254:41435 requested a full tablet report, sending...
I20260811 16:38:29.438961 10757 ts_manager.cc:194] Registered new tserver with Master: 9e52ef4b85a64f639668e7006d17b42d (127.24.175.194:35503)
I20260811 16:38:29.439436 10757 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.175.194@KRBTEST.COM'} at 127.24.175.194:43497
WARNING: no policy specified for kudu/127.24.175.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab.
Entry for principal kudu/127.24.175.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab.
I20260811 16:38:29.458626 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.195:0
--local_ip_for_outbound_sockets=127.24.175.195
--webserver_interface=127.24.175.195
--webserver_port=0
--tserver_master_addrs=127.24.175.254:41435
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab
--principal=kudu/127.24.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:42893
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:38:29.537571 11284 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:38:29.537767 11284 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:38:29.537789 11284 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:38:29.538899 11284 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:38:29.538936 11284 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:38:29.538961 11284 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.195
I20260811 16:38:29.540333 11284 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:42893
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab
--principal=kudu/127.24.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.175.195
--webserver_port=0
--tserver_master_addrs=127.24.175.254:41435
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11284
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.195
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:38:29.540519 11284 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:38:29.540675 11284 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:38:29.545544 11296 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:38:29.545625 11284 server_base.cc:1034] running on GCE node
W20260811 16:38:29.545517 11291 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:38:29.545498 11292 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:38:29.545936 11284 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:38:29.546175 11284 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:38:29.547323 11284 hybrid_clock.cc:648] HybridClock initialized: now 1786466309547305 us; error 33 us; skew 500 ppm
Aug 11 16:38:29 dist-test-slave-zj8q krb5kdc[10667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466309, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:38:29.549561 11284 init.cc:377] Logged in from keytab as kudu/127.24.175.195@KRBTEST.COM (short username kudu)
I20260811 16:38:29.549985 11284 webserver.cc:460] Webserver started at http://127.24.175.195:41587/ using document root <none> and password file <none>
I20260811 16:38:29.550240 11284 fs_manager.cc:359] Metadata directory not provided
I20260811 16:38:29.550293 11284 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:38:29.550419 11284 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:38:29.551367 11284 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/ts-2/data/instance:
uuid: "e1d62e5c39c943e6b5f1db7576460fe5"
format_stamp: "Formatted at 2026-08-11 16:38:29 on dist-test-slave-zj8q"
server_key: "6260286d39f67b77db3f646985bc99f6"
server_key_iv: "630ecf111463acec92a22a9563f10322"
server_key_version: "encryptionkey@0"
I20260811 16:38:29.551687 11284 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/ts-2/wal/instance:
uuid: "e1d62e5c39c943e6b5f1db7576460fe5"
format_stamp: "Formatted at 2026-08-11 16:38:29 on dist-test-slave-zj8q"
server_key: "6260286d39f67b77db3f646985bc99f6"
server_key_iv: "630ecf111463acec92a22a9563f10322"
server_key_version: "encryptionkey@0"
I20260811 16:38:29.552891 11284 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:38:29.553534 11309 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:29.553709 11284 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:38:29.553793 11284 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/ts-2/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/ts-2/wal
uuid: "e1d62e5c39c943e6b5f1db7576460fe5"
format_stamp: "Formatted at 2026-08-11 16:38:29 on dist-test-slave-zj8q"
server_key: "6260286d39f67b77db3f646985bc99f6"
server_key_iv: "630ecf111463acec92a22a9563f10322"
server_key_version: "encryptionkey@0"
I20260811 16:38:29.553860 11284 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:38:29.595094 11284 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:38:29.596947 11284 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:38:29.597080 11284 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:38:29.597304 11284 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:38:29.597604 11284 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:38:29.597637 11284 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:29.597667 11284 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:38:29.597690 11284 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:38:29.603807 11284 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.195:45011
I20260811 16:38:29.603858 11483 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.195:45011 every 8 connection(s)
I20260811 16:38:29.604156 11284 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
Aug 11 16:38:29 dist-test-slave-zj8q krb5kdc[10667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466309, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.195@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:38:29.612414 10820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:29.604830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.195:57699 (local address 127.24.175.254:41435)
0811 16:38:29.604880 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:29.604882 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:29.605077 (+ 195us) server_negotiation.cc:407] Connection header received
0811 16:38:29.605588 (+ 511us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:29.605590 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:29.605602 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:29.605653 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:29.606618 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:29.607122 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:29.608075 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:29.608282 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:29.608337 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:29.610356 (+ 2019us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:38:29.610357 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:38:29.610358 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:38:29.610364 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:38:29.611404 (+ 1040us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:29.611743 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:29.611744 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:29.611744 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:29.611786 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:29.611964 (+ 178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:29.611964 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:29.611964 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:29.612052 (+ 88us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:38:29.612095 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:29.612297 (+ 202us) server_negotiation.cc:299] Negotiation successful
0811 16:38:29.612351 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 16:38:29.612588 11493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:29.604800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:41435 (local address 127.24.175.195:57699)
0811 16:38:29.604967 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:29.605003 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:29.605486 (+ 483us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:29.605723 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:29.605727 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:29.606334 (+ 607us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:38:29.606529 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:29.606534 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:29.607205 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:29.607206 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:29.607996 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:29.607999 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:29.608349 (+ 350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:29.608350 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:29.608472 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:29.608879 (+ 407us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:38:29.608887 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:38:29.610266 (+ 1379us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:38:29.611468 (+ 1202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:29.611474 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:29.611475 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:29.611683 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:29.611828 (+ 145us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:38:29.611829 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:38:29.611829 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:38:29.611924 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:38:29.612091 (+ 167us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:38:29.612094 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:38:29.612209 (+ 115us) client_negotiation.cc:769] Sending connection context
0811 16:38:29.612282 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 16:38:29.612399 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":86,"threads_started":1}
I20260811 16:38:29.613039 11486 heartbeater.cc:347] Connected to a master server at 127.24.175.254:41435
I20260811 16:38:29.613126 11486 heartbeater.cc:464] Registering TS with master...
I20260811 16:38:29.613325 11486 heartbeater.cc:511] Master 127.24.175.254:41435 requested a full tablet report, sending...
I20260811 16:38:29.613341 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 11284
I20260811 16:38:29.613418 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/ts-2/wal/instance
I20260811 16:38:29.613581 25279 external_mini_cluster.cc:1428] Setting key 484a024713dc515df1154e43af96b3dc
I20260811 16:38:29.613766 10757 ts_manager.cc:194] Registered new tserver with Master: e1d62e5c39c943e6b5f1db7576460fe5 (127.24.175.195:45011)
I20260811 16:38:29.614207 10757 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.175.195@KRBTEST.COM'} at 127.24.175.195:57699
I20260811 16:38:29.614405 25279 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 16:38:29.620699 10820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:29.615576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37940 (local address 127.24.175.254:41435)
0811 16:38:29.615617 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:29.615619 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:29.615762 (+ 143us) server_negotiation.cc:407] Connection header received
0811 16:38:29.615785 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:29.615786 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:29.615795 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:29.615847 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:38:29.616364 (+ 517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:29.616835 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:29.617461 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:29.617656 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:29.617700 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:29.618686 (+ 986us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:38:29.618687 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:38:29.618687 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:38:29.618693 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:38:29.619871 (+ 1178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:29.620118 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:29.620119 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:29.620119 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:29.620162 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:38:29.620280 (+ 118us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:38:29.620281 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:38:29.620281 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:38:29.620396 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:38:29.620460 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:29.620532 (+ 72us) server_negotiation.cc:299] Negotiation successful
0811 16:38:29.620588 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 16:38:29.622005 10757 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37940:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:38:29.623579 10757 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:38:29.630023 11502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:29.625705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.193:34617 (local address 127.0.0.1:45342)
0811 16:38:29.626007 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:29.626045 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:29.626109 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:29.626402 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:29.626405 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:29.626410 (+ 5us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:38:29.626478 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:29.626479 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:29.627770 (+ 1291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:29.627771 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:29.628802 (+ 1031us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:29.628804 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:29.629698 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:29.629699 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:29.629802 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:29.629814 (+ 12us) client_negotiation.cc:769] Sending connection context
0811 16:38:29.629878 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 16:38:29.629936 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":277,"mutex_wait_us":29,"thread_start_us":54,"threads_started":1}
I20260811 16:38:29.630046 11507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:29.626096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53580 (local address 127.24.175.194:35503)
0811 16:38:29.626318 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:29.626322 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:29.626331 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:38:29.626367 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:29.626369 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:29.626382 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:29.626540 (+ 158us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:38:29.626770 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:29.627419 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:29.628817 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:29.629537 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:29.629608 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:29.629661 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:29.629917 (+ 256us) server_negotiation.cc:299] Negotiation successful
0811 16:38:29.629964 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":194,"thread_start_us":105,"threads_started":1}
I20260811 16:38:29.630021 11501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:29.625902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.194:35503 (local address 127.0.0.1:53580)
0811 16:38:29.626221 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:29.626237 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:29.626276 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:29.626614 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:29.626615 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:29.626617 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:38:29.626693 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:29.626695 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:29.627509 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:29.627510 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:29.628743 (+ 1233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:29.628746 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:29.629698 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:29.629699 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:29.629806 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:29.629814 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 16:38:29.629884 (+ 70us) client_negotiation.cc:240] Negotiation successful
0811 16:38:29.629936 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":309,"mutex_wait_us":21,"thread_start_us":47,"threads_started":1}
I20260811 16:38:29.630548 11505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:29.625706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.195:45011 (local address 127.0.0.1:38242)
0811 16:38:29.626086 (+ 380us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:29.626096 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:29.626207 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:29.626402 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:29.626405 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:29.626407 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:38:29.626477 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:29.626479 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:29.628882 (+ 2403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:29.628882 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:29.629519 (+ 637us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:29.629521 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:29.630332 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:29.630333 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:29.630392 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:29.630396 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:38:29.630439 (+ 43us) client_negotiation.cc:240] Negotiation successful
0811 16:38:29.630478 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":365,"mutex_wait_us":5,"thread_start_us":71,"threads_started":1}
I20260811 16:38:29.630577 11504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:29.625835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45342 (local address 127.24.175.193:34617)
0811 16:38:29.626009 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:29.626013 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:29.626090 (+ 77us) server_negotiation.cc:407] Connection header received
0811 16:38:29.626229 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:29.626231 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:29.626249 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:29.626321 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:38:29.626558 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:29.627660 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:29.628871 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:29.629537 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:29.629608 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:29.629661 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:29.630449 (+ 788us) server_negotiation.cc:299] Negotiation successful
0811 16:38:29.630495 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":86,"threads_started":1}
I20260811 16:38:29.630765 11503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:29.625782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38242 (local address 127.24.175.195:45011)
0811 16:38:29.625931 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:29.625936 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:29.626173 (+ 237us) server_negotiation.cc:407] Connection header received
0811 16:38:29.626301 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:29.626304 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:29.626320 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:29.626391 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:38:29.626558 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:29.627661 (+ 1103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:29.629594 (+ 1933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:29.630141 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:29.630242 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:29.630300 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:29.630649 (+ 349us) server_negotiation.cc:299] Negotiation successful
0811 16:38:29.630694 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":75,"threads_started":1}
I20260811 16:38:29.631007 11169 tablet_service.cc:1467] Processing CreateTablet for tablet 38536f57740048f0aedc9e17629c871c (DEFAULT_TABLE table=test-table [id=194fe8d1be8e4692971befe4b6cb4d93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:38:29.631204 10953 tablet_service.cc:1467] Processing CreateTablet for tablet 38536f57740048f0aedc9e17629c871c (DEFAULT_TABLE table=test-table [id=194fe8d1be8e4692971befe4b6cb4d93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:38:29.631378 11169 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 38536f57740048f0aedc9e17629c871c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:38:29.631322 11381 tablet_service.cc:1467] Processing CreateTablet for tablet 38536f57740048f0aedc9e17629c871c (DEFAULT_TABLE table=test-table [id=194fe8d1be8e4692971befe4b6cb4d93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:38:29.631538 10953 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 38536f57740048f0aedc9e17629c871c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:38:29.631623 11381 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 38536f57740048f0aedc9e17629c871c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:38:29.634008 11510 tablet_bootstrap.cc:492] T 38536f57740048f0aedc9e17629c871c P 8301d07c922b4382b3aefe28f27d0a74: Bootstrap starting.
I20260811 16:38:29.634575 11511 tablet_bootstrap.cc:492] T 38536f57740048f0aedc9e17629c871c P e1d62e5c39c943e6b5f1db7576460fe5: Bootstrap starting.
I20260811 16:38:29.634737 11510 tablet_bootstrap.cc:654] T 38536f57740048f0aedc9e17629c871c P 8301d07c922b4382b3aefe28f27d0a74: Neither blocks nor log segments found. Creating new log.
I20260811 16:38:29.634806 11512 tablet_bootstrap.cc:492] T 38536f57740048f0aedc9e17629c871c P 9e52ef4b85a64f639668e7006d17b42d: Bootstrap starting.
I20260811 16:38:29.635226 11511 tablet_bootstrap.cc:654] T 38536f57740048f0aedc9e17629c871c P e1d62e5c39c943e6b5f1db7576460fe5: Neither blocks nor log segments found. Creating new log.
I20260811 16:38:29.635281 11510 log.cc:824] T 38536f57740048f0aedc9e17629c871c P 8301d07c922b4382b3aefe28f27d0a74: Log is configured to *not* fsync() on all Append() calls
I20260811 16:38:29.635345 11512 tablet_bootstrap.cc:654] T 38536f57740048f0aedc9e17629c871c P 9e52ef4b85a64f639668e7006d17b42d: Neither blocks nor log segments found. Creating new log.
I20260811 16:38:29.635821 11511 log.cc:824] T 38536f57740048f0aedc9e17629c871c P e1d62e5c39c943e6b5f1db7576460fe5: Log is configured to *not* fsync() on all Append() calls
I20260811 16:38:29.635882 11512 log.cc:824] T 38536f57740048f0aedc9e17629c871c P 9e52ef4b85a64f639668e7006d17b42d: Log is configured to *not* fsync() on all Append() calls
I20260811 16:38:29.636094 11510 tablet_bootstrap.cc:492] T 38536f57740048f0aedc9e17629c871c P 8301d07c922b4382b3aefe28f27d0a74: No bootstrap required, opened a new log
I20260811 16:38:29.636175 11510 ts_tablet_manager.cc:1397] T 38536f57740048f0aedc9e17629c871c P 8301d07c922b4382b3aefe28f27d0a74: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:38:29.636554 11511 tablet_bootstrap.cc:492] T 38536f57740048f0aedc9e17629c871c P e1d62e5c39c943e6b5f1db7576460fe5: No bootstrap required, opened a new log
I20260811 16:38:29.636598 11512 tablet_bootstrap.cc:492] T 38536f57740048f0aedc9e17629c871c P 9e52ef4b85a64f639668e7006d17b42d: No bootstrap required, opened a new log
I20260811 16:38:29.636628 11511 ts_tablet_manager.cc:1397] T 38536f57740048f0aedc9e17629c871c P e1d62e5c39c943e6b5f1db7576460fe5: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 16:38:29.636646 11512 ts_tablet_manager.cc:1397] T 38536f57740048f0aedc9e17629c871c P 9e52ef4b85a64f639668e7006d17b42d: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 16:38:29.637804 11510 raft_consensus.cc:348] T 38536f57740048f0aedc9e17629c871c P 8301d07c922b4382b3aefe28f27d0a74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8301d07c922b4382b3aefe28f27d0a74" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 34617 } } peers { permanent_uuid: "e1d62e5c39c943e6b5f1db7576460fe5" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 45011 } } peers { permanent_uuid: "9e52ef4b85a64f639668e7006d17b42d" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 35503 } }
I20260811 16:38:29.637931 11510 raft_consensus.cc:374] T 38536f57740048f0aedc9e17629c871c P 8301d07c922b4382b3aefe28f27d0a74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:38:29.637964 11510 raft_consensus.cc:729] T 38536f57740048f0aedc9e17629c871c P 8301d07c922b4382b3aefe28f27d0a74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8301d07c922b4382b3aefe28f27d0a74, State: Initialized, Role: FOLLOWER
I20260811 16:38:29.638098 11510 consensus_queue.cc:260] T 38536f57740048f0aedc9e17629c871c P 8301d07c922b4382b3aefe28f27d0a74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8301d07c922b4382b3aefe28f27d0a74" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 34617 } } peers { permanent_uuid: "e1d62e5c39c943e6b5f1db7576460fe5" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 45011 } } peers { permanent_uuid: "9e52ef4b85a64f639668e7006d17b42d" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 35503 } }
I20260811 16:38:29.638391 11058 heartbeater.cc:503] Master 127.24.175.254:41435 was elected leader, sending a full tablet report...
I20260811 16:38:29.638388 11510 ts_tablet_manager.cc:1428] T 38536f57740048f0aedc9e17629c871c P 8301d07c922b4382b3aefe28f27d0a74: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:38:29.638453 11511 raft_consensus.cc:348] T 38536f57740048f0aedc9e17629c871c P e1d62e5c39c943e6b5f1db7576460fe5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8301d07c922b4382b3aefe28f27d0a74" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 34617 } } peers { permanent_uuid: "e1d62e5c39c943e6b5f1db7576460fe5" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 45011 } } peers { permanent_uuid: "9e52ef4b85a64f639668e7006d17b42d" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 35503 } }
I20260811 16:38:29.638460 11512 raft_consensus.cc:348] T 38536f57740048f0aedc9e17629c871c P 9e52ef4b85a64f639668e7006d17b42d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8301d07c922b4382b3aefe28f27d0a74" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 34617 } } peers { permanent_uuid: "e1d62e5c39c943e6b5f1db7576460fe5" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 45011 } } peers { permanent_uuid: "9e52ef4b85a64f639668e7006d17b42d" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 35503 } }
I20260811 16:38:29.638598 11512 raft_consensus.cc:374] T 38536f57740048f0aedc9e17629c871c P 9e52ef4b85a64f639668e7006d17b42d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:38:29.638598 11511 raft_consensus.cc:374] T 38536f57740048f0aedc9e17629c871c P e1d62e5c39c943e6b5f1db7576460fe5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:38:29.638633 11512 raft_consensus.cc:729] T 38536f57740048f0aedc9e17629c871c P 9e52ef4b85a64f639668e7006d17b42d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e52ef4b85a64f639668e7006d17b42d, State: Initialized, Role: FOLLOWER
I20260811 16:38:29.638633 11511 raft_consensus.cc:729] T 38536f57740048f0aedc9e17629c871c P e1d62e5c39c943e6b5f1db7576460fe5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1d62e5c39c943e6b5f1db7576460fe5, State: Initialized, Role: FOLLOWER
I20260811 16:38:29.638744 11511 consensus_queue.cc:260] T 38536f57740048f0aedc9e17629c871c P e1d62e5c39c943e6b5f1db7576460fe5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8301d07c922b4382b3aefe28f27d0a74" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 34617 } } peers { permanent_uuid: "e1d62e5c39c943e6b5f1db7576460fe5" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 45011 } } peers { permanent_uuid: "9e52ef4b85a64f639668e7006d17b42d" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 35503 } }
I20260811 16:38:29.638777 11512 consensus_queue.cc:260] T 38536f57740048f0aedc9e17629c871c P 9e52ef4b85a64f639668e7006d17b42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8301d07c922b4382b3aefe28f27d0a74" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 34617 } } peers { permanent_uuid: "e1d62e5c39c943e6b5f1db7576460fe5" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 45011 } } peers { permanent_uuid: "9e52ef4b85a64f639668e7006d17b42d" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 35503 } }
I20260811 16:38:29.639019 11512 ts_tablet_manager.cc:1428] T 38536f57740048f0aedc9e17629c871c P 9e52ef4b85a64f639668e7006d17b42d: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260811 16:38:29.639019 11511 ts_tablet_manager.cc:1428] T 38536f57740048f0aedc9e17629c871c P e1d62e5c39c943e6b5f1db7576460fe5: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 16:38:29.639124 11486 heartbeater.cc:503] Master 127.24.175.254:41435 was elected leader, sending a full tablet report...
I20260811 16:38:29.639166 11276 heartbeater.cc:503] Master 127.24.175.254:41435 was elected leader, sending a full tablet report...
I20260811 16:38:29.644285 11516 raft_consensus.cc:482] T 38536f57740048f0aedc9e17629c871c P 8301d07c922b4382b3aefe28f27d0a74 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:38:29.644351 11516 raft_consensus.cc:504] T 38536f57740048f0aedc9e17629c871c P 8301d07c922b4382b3aefe28f27d0a74 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8301d07c922b4382b3aefe28f27d0a74" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 34617 } } peers { permanent_uuid: "e1d62e5c39c943e6b5f1db7576460fe5" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 45011 } } peers { permanent_uuid: "9e52ef4b85a64f639668e7006d17b42d" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 35503 } }
I20260811 16:38:29.644625 11516 leader_election.cc:288] T 38536f57740048f0aedc9e17629c871c P 8301d07c922b4382b3aefe28f27d0a74 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1d62e5c39c943e6b5f1db7576460fe5 (127.24.175.195:45011), 9e52ef4b85a64f639668e7006d17b42d (127.24.175.194:35503)
I20260811 16:38:29.648075 11503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:29.644792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:60563 (local address 127.24.175.195:45011)
0811 16:38:29.644826 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:29.644828 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:29.644835 (+ 7us) server_negotiation.cc:407] Connection header received
0811 16:38:29.644906 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:29.644907 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:29.644915 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:29.644969 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:38:29.645100 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:29.645836 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:29.647217 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:29.647766 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:29.647841 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:29.647849 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:29.647982 (+ 133us) server_negotiation.cc:299] Negotiation successful
0811 16:38:29.648015 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 16:38:29.648075 11507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:29.644886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:54573 (local address 127.24.175.194:35503)
0811 16:38:29.644920 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:29.644921 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:29.645024 (+ 103us) server_negotiation.cc:407] Connection header received
0811 16:38:29.645085 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:29.645086 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:29.645095 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:29.645140 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:38:29.645231 (+ 91us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:29.645901 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:29.647217 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:29.647782 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:29.647842 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:29.647849 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:29.647982 (+ 133us) server_negotiation.cc:299] Negotiation successful
0811 16:38:29.648015 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 16:38:29.648103 11060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:29.644738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.195:45011 (local address 127.24.175.193:60563)
0811 16:38:29.644782 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:29.644793 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:29.644837 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:29.644972 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:29.644973 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:29.644974 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:38:29.645034 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:29.645035 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:29.645910 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:29.645911 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:29.647127 (+ 1216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:29.647130 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:29.647838 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:29.647839 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:29.647915 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:29.647920 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 16:38:29.647973 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 16:38:29.648015 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27,"mutex_wait_us":4}
I20260811 16:38:29.648313 11520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:29.644841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.194:35503 (local address 127.24.175.193:54573)
0811 16:38:29.644971 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:29.644979 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 16:38:29.645029 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:38:29.645141 (+ 112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:38:29.645142 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:38:29.645143 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:38:29.645184 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:29.645185 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:29.645958 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:29.645959 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:29.647127 (+ 1168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:38:29.647130 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:38:29.647842 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:38:29.647843 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:38:29.647915 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:29.647920 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 16:38:29.647973 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 16:38:29.648015 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"mutex_wait_us":49,"thread_start_us":87,"threads_started":1}
I20260811 16:38:29.648554 11204 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38536f57740048f0aedc9e17629c871c" candidate_uuid: "8301d07c922b4382b3aefe28f27d0a74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e52ef4b85a64f639668e7006d17b42d" is_pre_election: true
I20260811 16:38:29.648551 11411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38536f57740048f0aedc9e17629c871c" candidate_uuid: "8301d07c922b4382b3aefe28f27d0a74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1d62e5c39c943e6b5f1db7576460fe5" is_pre_election: true
I20260811 16:38:29.648654 11411 raft_consensus.cc:2454] T 38536f57740048f0aedc9e17629c871c P e1d62e5c39c943e6b5f1db7576460fe5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8301d07c922b4382b3aefe28f27d0a74 in term 0.
I20260811 16:38:29.648666 11204 raft_consensus.cc:2454] T 38536f57740048f0aedc9e17629c871c P 9e52ef4b85a64f639668e7006d17b42d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8301d07c922b4382b3aefe28f27d0a74 in term 0.
I20260811 16:38:29.648826 10873 leader_election.cc:302] T 38536f57740048f0aedc9e17629c871c P 8301d07c922b4382b3aefe28f27d0a74 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8301d07c922b4382b3aefe28f27d0a74, e1d62e5c39c943e6b5f1db7576460fe5; no voters:
I20260811 16:38:29.648942 11516 raft_consensus.cc:2781] T 38536f57740048f0aedc9e17629c871c P 8301d07c922b4382b3aefe28f27d0a74 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:38:29.649003 11516 raft_consensus.cc:482] T 38536f57740048f0aedc9e17629c871c P 8301d07c922b4382b3aefe28f27d0a74 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:38:29.649017 11516 raft_consensus.cc:3037] T 38536f57740048f0aedc9e17629c871c P 8301d07c922b4382b3aefe28f27d0a74 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:38:29.649575 11516 raft_consensus.cc:504] T 38536f57740048f0aedc9e17629c871c P 8301d07c922b4382b3aefe28f27d0a74 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8301d07c922b4382b3aefe28f27d0a74" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 34617 } } peers { permanent_uuid: "e1d62e5c39c943e6b5f1db7576460fe5" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 45011 } } peers { permanent_uuid: "9e52ef4b85a64f639668e7006d17b42d" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 35503 } }
I20260811 16:38:29.649678 11516 leader_election.cc:288] T 38536f57740048f0aedc9e17629c871c P 8301d07c922b4382b3aefe28f27d0a74 [CANDIDATE]: Term 1 election: Requested vote from peers e1d62e5c39c943e6b5f1db7576460fe5 (127.24.175.195:45011), 9e52ef4b85a64f639668e7006d17b42d (127.24.175.194:35503)
I20260811 16:38:29.649839 11411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38536f57740048f0aedc9e17629c871c" candidate_uuid: "8301d07c922b4382b3aefe28f27d0a74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1d62e5c39c943e6b5f1db7576460fe5"
I20260811 16:38:29.649844 11204 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38536f57740048f0aedc9e17629c871c" candidate_uuid: "8301d07c922b4382b3aefe28f27d0a74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e52ef4b85a64f639668e7006d17b42d"
I20260811 16:38:29.649917 11204 raft_consensus.cc:3037] T 38536f57740048f0aedc9e17629c871c P 9e52ef4b85a64f639668e7006d17b42d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:38:29.649917 11411 raft_consensus.cc:3037] T 38536f57740048f0aedc9e17629c871c P e1d62e5c39c943e6b5f1db7576460fe5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:38:29.650715 11204 raft_consensus.cc:2454] T 38536f57740048f0aedc9e17629c871c P 9e52ef4b85a64f639668e7006d17b42d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8301d07c922b4382b3aefe28f27d0a74 in term 1.
I20260811 16:38:29.650715 11411 raft_consensus.cc:2454] T 38536f57740048f0aedc9e17629c871c P e1d62e5c39c943e6b5f1db7576460fe5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8301d07c922b4382b3aefe28f27d0a74 in term 1.
I20260811 16:38:29.650868 10873 leader_election.cc:302] T 38536f57740048f0aedc9e17629c871c P 8301d07c922b4382b3aefe28f27d0a74 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8301d07c922b4382b3aefe28f27d0a74, e1d62e5c39c943e6b5f1db7576460fe5; no voters:
I20260811 16:38:29.650944 11516 raft_consensus.cc:2781] T 38536f57740048f0aedc9e17629c871c P 8301d07c922b4382b3aefe28f27d0a74 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:38:29.651078 11516 raft_consensus.cc:686] T 38536f57740048f0aedc9e17629c871c P 8301d07c922b4382b3aefe28f27d0a74 [term 1 LEADER]: Becoming Leader. State: Replica: 8301d07c922b4382b3aefe28f27d0a74, State: Running, Role: LEADER
I20260811 16:38:29.651156 11516 consensus_queue.cc:237] T 38536f57740048f0aedc9e17629c871c P 8301d07c922b4382b3aefe28f27d0a74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8301d07c922b4382b3aefe28f27d0a74" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 34617 } } peers { permanent_uuid: "e1d62e5c39c943e6b5f1db7576460fe5" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 45011 } } peers { permanent_uuid: "9e52ef4b85a64f639668e7006d17b42d" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 35503 } }
I20260811 16:38:29.651863 10755 catalog_manager.cc:5495] T 38536f57740048f0aedc9e17629c871c P 8301d07c922b4382b3aefe28f27d0a74 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8301d07c922b4382b3aefe28f27d0a74 (127.24.175.193). New cstate: current_term: 1 leader_uuid: "8301d07c922b4382b3aefe28f27d0a74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8301d07c922b4382b3aefe28f27d0a74" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 34617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1d62e5c39c943e6b5f1db7576460fe5" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 45011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e52ef4b85a64f639668e7006d17b42d" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 35503 } health_report { overall_health: UNKNOWN } } }
I20260811 16:38:29.656332 11504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:29.654218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45350 (local address 127.24.175.193:34617)
0811 16:38:29.654253 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0811 16:38:29.654255 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:38:29.654287 (+ 32us) server_negotiation.cc:407] Connection header received
0811 16:38:29.654352 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:38:29.654353 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:38:29.654367 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:38:29.654432 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:38:29.654563 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:29.654988 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:29.655667 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:38:29.655838 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:38:29.655876 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:38:29.656022 (+ 146us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:38:29.656111 (+ 89us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:38:29.656179 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 16:38:29.656236 (+ 57us) server_negotiation.cc:299] Negotiation successful
0811 16:38:29.656255 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 16:38:29.657799 11411 raft_consensus.cc:1261] T 38536f57740048f0aedc9e17629c871c P e1d62e5c39c943e6b5f1db7576460fe5 [term 1 FOLLOWER]: Refusing update from remote peer 8301d07c922b4382b3aefe28f27d0a74: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:38:29.657799 11204 raft_consensus.cc:1261] T 38536f57740048f0aedc9e17629c871c P 9e52ef4b85a64f639668e7006d17b42d [term 1 FOLLOWER]: Refusing update from remote peer 8301d07c922b4382b3aefe28f27d0a74: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:38:29.658104 11521 consensus_queue.cc:1035] T 38536f57740048f0aedc9e17629c871c P 8301d07c922b4382b3aefe28f27d0a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e52ef4b85a64f639668e7006d17b42d" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:38:29.658228 11516 consensus_queue.cc:1035] T 38536f57740048f0aedc9e17629c871c P 8301d07c922b4382b3aefe28f27d0a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1d62e5c39c943e6b5f1db7576460fe5" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 45011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:38:29.660216 11529 mvcc.cc:205] Tried to move back new op lower bound from 7317366004356284416 to 7317366004331806720. Current Snapshot: MvccSnapshot[applied={T|T < 7317366004356284416}]
I20260811 16:38:29.660568 11533 mvcc.cc:205] Tried to move back new op lower bound from 7317366004356284416 to 7317366004331806720. Current Snapshot: MvccSnapshot[applied={T|T < 7317366004356284416}]
I20260811 16:38:29.660949 11532 mvcc.cc:205] Tried to move back new op lower bound from 7317366004356284416 to 7317366004331806720. Current Snapshot: MvccSnapshot[applied={T|T < 7317366004356284416}]
I20260811 16:38:29.662832 10755 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37940:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:38:29.662909 10755 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37940:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:38:29.663558 10755 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 95a40c707e224f1f895f1dee9d2be1aa: Sending DeleteTablet for 3 replicas of tablet 38536f57740048f0aedc9e17629c871c
I20260811 16:38:29.663868 10953 tablet_service.cc:1514] Processing DeleteTablet for tablet 38536f57740048f0aedc9e17629c871c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:38:29 UTC) from {username='kudu', principal='kudu/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:45342
I20260811 16:38:29.663913 11381 tablet_service.cc:1514] Processing DeleteTablet for tablet 38536f57740048f0aedc9e17629c871c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:38:29 UTC) from {username='kudu', principal='kudu/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:38242
I20260811 16:38:29.664098 11545 tablet_replica.cc:330] T 38536f57740048f0aedc9e17629c871c P 8301d07c922b4382b3aefe28f27d0a74: stopping tablet replica
I20260811 16:38:29.664080 11169 tablet_service.cc:1514] Processing DeleteTablet for tablet 38536f57740048f0aedc9e17629c871c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:38:29 UTC) from {username='kudu', principal='kudu/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:53580
I20260811 16:38:29.664172 11545 raft_consensus.cc:2229] T 38536f57740048f0aedc9e17629c871c P 8301d07c922b4382b3aefe28f27d0a74 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:38:29.664268 11545 raft_consensus.cc:2258] T 38536f57740048f0aedc9e17629c871c P 8301d07c922b4382b3aefe28f27d0a74 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:38:29.664284 11547 tablet_replica.cc:330] T 38536f57740048f0aedc9e17629c871c P 9e52ef4b85a64f639668e7006d17b42d: stopping tablet replica
I20260811 16:38:29.664444 11547 raft_consensus.cc:2229] T 38536f57740048f0aedc9e17629c871c P 9e52ef4b85a64f639668e7006d17b42d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:38:29.664547 11547 raft_consensus.cc:2258] T 38536f57740048f0aedc9e17629c871c P 9e52ef4b85a64f639668e7006d17b42d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:38:29.664623 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 10849
I20260811 16:38:29.664666 11545 ts_tablet_manager.cc:1905] T 38536f57740048f0aedc9e17629c871c P 8301d07c922b4382b3aefe28f27d0a74: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:38:29.664958 11547 ts_tablet_manager.cc:1905] T 38536f57740048f0aedc9e17629c871c P 9e52ef4b85a64f639668e7006d17b42d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:38:29.666425 11547 ts_tablet_manager.cc:1918] T 38536f57740048f0aedc9e17629c871c P 9e52ef4b85a64f639668e7006d17b42d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:38:29.666476 11547 log.cc:1196] T 38536f57740048f0aedc9e17629c871c P 9e52ef4b85a64f639668e7006d17b42d: Deleting WAL directory at /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/ts-1/wal/wals/38536f57740048f0aedc9e17629c871c
I20260811 16:38:29.666659 11547 ts_tablet_manager.cc:1939] T 38536f57740048f0aedc9e17629c871c P 9e52ef4b85a64f639668e7006d17b42d: Deleting consensus metadata
I20260811 16:38:29.667968 10729 catalog_manager.cc:4841] TS 9e52ef4b85a64f639668e7006d17b42d (127.24.175.194:35503): tablet 38536f57740048f0aedc9e17629c871c (table test-table [id=194fe8d1be8e4692971befe4b6cb4d93]) successfully deleted
I20260811 16:38:29.671298 11546 tablet_replica.cc:330] T 38536f57740048f0aedc9e17629c871c P e1d62e5c39c943e6b5f1db7576460fe5: stopping tablet replica
I20260811 16:38:29.671406 11546 raft_consensus.cc:2229] T 38536f57740048f0aedc9e17629c871c P e1d62e5c39c943e6b5f1db7576460fe5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:38:29.671504 11546 raft_consensus.cc:2258] T 38536f57740048f0aedc9e17629c871c P e1d62e5c39c943e6b5f1db7576460fe5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:38:29.672873 11546 ts_tablet_manager.cc:1905] T 38536f57740048f0aedc9e17629c871c P e1d62e5c39c943e6b5f1db7576460fe5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:38:29.674103 11546 ts_tablet_manager.cc:1918] T 38536f57740048f0aedc9e17629c871c P e1d62e5c39c943e6b5f1db7576460fe5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:38:29.674185 11546 log.cc:1196] T 38536f57740048f0aedc9e17629c871c P e1d62e5c39c943e6b5f1db7576460fe5: Deleting WAL directory at /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466249441839-25279-0/minicluster-data/ts-2/wal/wals/38536f57740048f0aedc9e17629c871c
I20260811 16:38:29.674432 11546 ts_tablet_manager.cc:1939] T 38536f57740048f0aedc9e17629c871c P e1d62e5c39c943e6b5f1db7576460fe5: Deleting consensus metadata
I20260811 16:38:29.674801 10729 catalog_manager.cc:4841] TS e1d62e5c39c943e6b5f1db7576460fe5 (127.24.175.195:45011): tablet 38536f57740048f0aedc9e17629c871c (table test-table [id=194fe8d1be8e4692971befe4b6cb4d93]) successfully deleted
W20260811 16:38:29.678376 10735 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.24.175.193:34617 (error 108)
I20260811 16:38:29.678570 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 11063
I20260811 16:38:29.681249 11505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:38:29.678716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.193:34617 (local address 127.0.0.1:45354)
0811 16:38:29.681175 (+ 2459us) negotiation.cc:107] Waiting for socket to connect
0811 16:38:29.681218 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.193:34617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2435}
W20260811 16:38:29.683153 10735 catalog_manager.cc:4584] TS 8301d07c922b4382b3aefe28f27d0a74 (127.24.175.193:34617): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 38536f57740048f0aedc9e17629c871c: Network error: Client connection negotiation failed: client connection to 127.24.175.193:34617: connect: Connection refused (error 111)
I20260811 16:38:29.690536 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 11284
I20260811 16:38:29.699710 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 10696
2026-08-11T16:38:29Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2010 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:38:29 dist-test-slave-zj8q krb5kdc[11552](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:38:29 dist-test-slave-zj8q krb5kdc[11552](info): set up 2 sockets
Aug 11 16:38:29 dist-test-slave-zj8q krb5kdc[11552](info): commencing operation
krb5kdc: starting...
W20260811 16:38:30.864825 25279 mini_kdc.cc:121] Time spent starting KDC: real 1.140s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Aug 11 16:38:30 dist-test-slave-zj8q krb5kdc[11552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466310, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:38:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:38:30Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.24.175.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.24.175.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.24.175.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/krb5kdc/rangeradmin_127.24.175.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.24.175.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/krb5kdc/rangeradmin_127.24.175.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.24.175.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.24.175.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.24.175.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/krb5kdc/rangerlookup_127.24.175.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.24.175.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/krb5kdc/rangerlookup_127.24.175.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.24.175.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.24.175.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.24.175.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/krb5kdc/HTTP_127.24.175.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.24.175.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/krb5kdc/HTTP_127.24.175.212@KRBTEST.COM.keytab.
I20260811 16:38:31.018537 25279 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskkGJqOS/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/postgres -l logfile start
2026-08-11 16:38:33.189 UTC [11611] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-11 16:38:33.189 UTC [11611] LOG: listening on IPv4 address "127.24.175.212", port 57927
2026-08-11 16:38:33.192 UTC [11611] LOG: listening on Unix socket "/tmp/.s.PGSQL.57927"
2026-08-11 16:38:33.211 UTC [11617] LOG: database system was shut down at 2026-08-11 16:38:32 UTC
2026-08-11 16:38:33.214 UTC [11611] LOG: database system is ready to accept connections
I20260811 16:38:34.304458 25279 mini_postgres.cc:96] Postgres bound to 57927
2026-08-11 16:38:34.311 UTC [11628] FATAL: database "slave" does not exist
127.24.175.212:57927 - accepting connections
I20260811 16:38:34.312057 25279 mini_ranger.cc:161] Starting Ranger...
I20260811 16:38:34.326555 25279 mini_ranger.cc:84] Created miniranger Postgres user
I20260811 16:38:34.708447 25279 mini_ranger.cc:87] Created ranger Postgres database
I20260811 16:38:34.708518 25279 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ranger-admin
2026-08-11 16:38:34,995 [I] DB FLAVOR :POSTGRES
2026-08-11 16:38:34,996 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 16:38:34,996 [I] Checking connection..
2026-08-11 16:38:34,996 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkGJqOS/build/release/bin/postgresql.jar:/tmp/dist-test-taskkGJqOS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.175.212:57927/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-11 16:38:35,253 [I] Checking connection passed.
2026-08-11 16:38:35,253 [I] --------- Verifying version history table ---------
2026-08-11 16:38:35,253 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkGJqOS/build/release/bin/postgresql.jar:/tmp/dist-test-taskkGJqOS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.175.212:57927/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 16:38:35,485 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 16:38:35,486 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkGJqOS/build/release/bin/postgresql.jar:/tmp/dist-test-taskkGJqOS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.175.212:57927/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 16:38:35,740 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 16:38:35,740 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-11 16:38:35,740 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkGJqOS/build/release/bin/postgresql.jar:/tmp/dist-test-taskkGJqOS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.175.212:57927/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskkGJqOS/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-11 16:38:35.989 UTC [11742] WARNING: there is no transaction in progress
2026-08-11 16:38:35,995 [I] create_dbversion_catalog.sql file imported successfully
2026-08-11 16:38:35,995 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkGJqOS/build/release/bin/postgresql.jar:/tmp/dist-test-taskkGJqOS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.175.212:57927/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 16:38:36,255 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-11 16:38:36,256 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 16:38:36,256 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkGJqOS/build/release/bin/postgresql.jar:/tmp/dist-test-taskkGJqOS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.175.212:57927/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-11 16:38:36,485 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkGJqOS/build/release/bin/postgresql.jar:/tmp/dist-test-taskkGJqOS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.175.212:57927/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-11 16:38:36,737 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkGJqOS/build/release/bin/postgresql.jar:/tmp/dist-test-taskkGJqOS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.175.212:57927/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-zj8q.c.gcp-upstream.internal','N') ;"
2026-08-11 16:38:36,984 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkGJqOS/build/release/bin/postgresql.jar:/tmp/dist-test-taskkGJqOS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.175.212:57927/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 16:38:37,241 [I] Table x_portal_user does not exist in database ranger
2026-08-11 16:38:37,242 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkGJqOS/build/release/bin/postgresql.jar:/tmp/dist-test-taskkGJqOS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.175.212:57927/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 16:38:37,496 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-11 16:38:37,497 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkGJqOS/build/release/bin/postgresql.jar:/tmp/dist-test-taskkGJqOS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.175.212:57927/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 16:38:37,748 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkGJqOS/build/release/bin/postgresql.jar:/tmp/dist-test-taskkGJqOS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.175.212:57927/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 16:38:37,986 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-11 16:38:37,987 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkGJqOS/build/release/bin/postgresql.jar:/tmp/dist-test-taskkGJqOS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.175.212:57927/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskkGJqOS/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-11 16:38:38.837 UTC [11925] WARNING: there is no transaction in progress
2026-08-11 16:38:38.851 UTC [11925] WARNING: there is no transaction in progress
2026-08-11 16:38:38.865 UTC [11925] WARNING: there is no transaction in progress
2026-08-11 16:38:38.878 UTC [11925] WARNING: there is no transaction in progress
2026-08-11 16:38:38.892 UTC [11925] WARNING: there is no transaction in progress
2026-08-11 16:38:38.906 UTC [11925] WARNING: there is no transaction in progress
2026-08-11 16:38:38.955 UTC [11925] WARNING: there is no transaction in progress
2026-08-11 16:38:38.962 UTC [11925] WARNING: there is no transaction in progress
2026-08-11 16:38:38.974 UTC [11925] WARNING: there is no transaction in progress
2026-08-11 16:38:38.984 UTC [11925] WARNING: there is no transaction in progress
2026-08-11 16:38:38.993 UTC [11925] WARNING: there is no transaction in progress
2026-08-11 16:38:39.004 UTC [11925] WARNING: there is no transaction in progress
2026-08-11 16:38:39.012 UTC [11925] WARNING: there is no transaction in progress
2026-08-11 16:38:39.018 UTC [11925] WARNING: there is no transaction in progress
2026-08-11 16:38:39.024 UTC [11925] WARNING: there is no transaction in progress
2026-08-11 16:38:39.029 UTC [11925] WARNING: there is no transaction in progress
2026-08-11 16:38:39,556 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-11 16:38:39,557 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkGJqOS/build/release/bin/postgresql.jar:/tmp/dist-test-taskkGJqOS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.175.212:57927/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-11 16:38:39,805 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-11 16:38:39,805 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkGJqOS/build/release/bin/postgresql.jar:/tmp/dist-test-taskkGJqOS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.175.212:57927/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 16:38:40,053 [I] Table x_portal_user already exists in database 'ranger'
2026-08-11 16:38:40,054 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkGJqOS/build/release/bin/postgresql.jar:/tmp/dist-test-taskkGJqOS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.175.212:57927/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 16:38:40,307 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-11 16:38:40,307 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkGJqOS/build/release/bin/postgresql.jar:/tmp/dist-test-taskkGJqOS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.175.212:57927/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 16:38:40,537 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkGJqOS/build/release/bin/postgresql.jar:/tmp/dist-test-taskkGJqOS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.175.212:57927/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 16:38:40,789 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkGJqOS/build/release/bin/postgresql.jar:/tmp/dist-test-taskkGJqOS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.175.212:57927/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-zj8q.c.gcp-upstream.internal';"
2026-08-11 16:38:41,036 [I] CORE_DB_SCHEMA import status has been updated
2026-08-11 16:38:41,036 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkGJqOS/build/release/bin/postgresql.jar:/tmp/dist-test-taskkGJqOS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.175.212:57927/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-11 16:38:41,288 [I] DB_PATCHES have already been applied
I20260811 16:38:41.294409 25279 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ranger-admin:/tmp/dist-test-taskkGJqOS/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskkGJqOS/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskkGJqOS/build/release/bin/postgresql.jar:/tmp/dist-test-taskkGJqOS/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260811 16:38:41.294471 25279 mini_ranger.cc:193] Using host: 127.24.175.212
I20260811 16:38:41.298110 25279 mini_ranger.cc:227] Ranger admin URL: http://127.24.175.212:41943
Aug 11, 2026 4:38:41 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 4:38:41 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 4:38:41 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ranger-admin/ews/webapp
Aug 11, 2026 4:38:41 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 11, 2026 4:38:41 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 11, 2026 4:38:42 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ranger-admin/ews/webapp].
Aug 11, 2026 4:38:42 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260811 16:38:42.504577 25279 mini_ranger.cc:160] Time spent starting Ranger: real 8.193s user 0.000s sys 0.010s
Aug 11, 2026 4:39:02 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 11, 2026 4:39:02 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 11, 2026 4:39:02 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 11, 2026 4:39:02 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 11, 2026 4:39:02 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 11, 2026 4:39:02 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 11, 2026 4:39:02 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 11, 2026 4:39:02 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 11, 2026 4:39:02 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 11, 2026 4:39:02 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 11, 2026 4:39:02 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 11, 2026 4:39:02 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 11, 2026 4:39:02 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 11, 2026 4:39:02 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 11, 2026 4:39:02 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 11, 2026 4:39:02 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 11, 2026 4:39:02 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 11, 2026 4:39:03 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260811 16:39:03.969254 25279 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.24.175.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.24.175.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.24.175.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/krb5kdc/rangerkms_127.24.175.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.24.175.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/krb5kdc/rangerkms_127.24.175.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.24.175.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.24.175.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.24.175.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/krb5kdc/HTTP_127.24.175.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.24.175.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/krb5kdc/HTTP_127.24.175.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 11 16:39:04 dist-test-slave-zj8q krb5kdc[11552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466344, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260811 16:39:04.049685 25279 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260811 16:39:04.058763 25279 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260811 16:39:04.784425 25279 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260811 16:39:04.784509 25279 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ranger-kms
I20260811 16:39:04.784524 25279 mini_ranger_kms.cc:227] Using postgres at 127.24.175.212:57927
2026-08-11 16:39:05,354 [I] DB FLAVOR :POSTGRES
2026-08-11 16:39:05,355 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 16:39:05,355 [I] Checking connection
2026-08-11 16:39:05,355 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkGJqOS/build/release/bin/postgresql.jar:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.175.212:57927/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-11 16:39:05,589 [I] connection success
2026-08-11 16:39:05,589 [I] --------- Verifying Ranger DB tables ---------
2026-08-11 16:39:05,589 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-11 16:39:05,589 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkGJqOS/build/release/bin/postgresql.jar:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.175.212:57927/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-11 16:39:05,819 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-11 16:39:05,819 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 16:39:05,819 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-11 16:39:05,819 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkGJqOS/build/release/bin/postgresql.jar:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.175.212:57927/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-11 16:39:06,066 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260811 16:39:06.522404 25279 mini_ranger_kms.cc:310] Created kms service
I20260811 16:39:06.686234 25279 mini_ranger_kms.cc:326] Created kudu user
I20260811 16:39:06.727272 25279 mini_ranger_kms.cc:343] Created rangerkms user
Aug 11 16:39:06 dist-test-slave-zj8q krb5kdc[11552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466344, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.24.175.212@KRBTEST.COM
I20260811 16:39:07.112257 25279 mini_ranger_kms.cc:384] Added ranger policy
I20260811 16:39:07.112385 25279 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ranger-kms:/tmp/dist-test-taskkGJqOS/build/release/bin/postgresql.jar:/tmp/dist-test-taskkGJqOS/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskkGJqOS/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260811 16:39:07.112412 25279 mini_ranger_kms.cc:240] Using host: 127.24.175.212
I20260811 16:39:07.117022 25279 mini_ranger_kms.cc:276] Ranger KMS PID: 12232
I20260811 16:39:07.117125 25279 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.24.175.212:59259
Aug 11, 2026 4:39:08 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 4:39:08 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 4:39:08 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 11, 2026 4:39:08 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 11, 2026 4:39:08 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ranger-kms/ews/webapp].
Aug 11, 2026 4:39:08 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 11 16:39:09 dist-test-slave-zj8q krb5kdc[11552](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786466349, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.24.175.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:39:09.707993 25279 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.658s user 0.007s sys 0.213s
I20260811 16:39:09.708101 25279 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260811 16:39:09.708182 25279 mini_ranger_kms.cc:401] 127.24.175.212:59259/kms/v1/keys
Aug 11 16:39:09 dist-test-slave-zj8q krb5kdc[11552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466349, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.24.175.212@KRBTEST.COM for HTTP/127.24.175.212@KRBTEST.COM
Aug 11 16:39:10 dist-test-slave-zj8q krb5kdc[11552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466349, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.24.175.212@KRBTEST.COM for HTTP/127.24.175.212@KRBTEST.COM
Aug 11 16:39:12 dist-test-slave-zj8q krb5kdc[11552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466352, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.24.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab.
Entry for principal kudu/127.24.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab.
I20260811 16:39:12.442962 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:32807
--webserver_interface=127.24.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:41139
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.175.254:32807
--ranger_config_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.24.175.212:59259/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:39:12.523130 12316 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:39:12.523334 12316 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:39:12.523365 12316 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:39:12.524471 12316 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:39:12.524513 12316 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:39:12.524531 12316 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:39:12.524545 12316 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:39:12.524560 12316 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:39:12.526484 12316 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:41139
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/master-0/wal
--ranger_kms_url=127.24.175.212:59259/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.24.175.254:32807
--ranger_config_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:32807
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12316
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:39:12.526732 12316 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:39:12.526932 12316 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:39:12.531916 12330 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:39:12.531957 12331 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:39:12.531970 12316 server_base.cc:1034] running on GCE node
W20260811 16:39:12.532191 12333 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:39:12.532436 12316 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:39:12.532727 12316 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:39:12.533874 12316 hybrid_clock.cc:648] HybridClock initialized: now 1786466352533857 us; error 33 us; skew 500 ppm
Aug 11 16:39:12 dist-test-slave-zj8q krb5kdc[11552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466352, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:39:12.536329 12316 init.cc:377] Logged in from keytab as kudu/127.24.175.254@KRBTEST.COM (short username kudu)
I20260811 16:39:12.536796 12316 webserver.cc:460] Webserver started at http://127.24.175.254:39861/ using document root <none> and password file <none>
I20260811 16:39:12.537026 12316 fs_manager.cc:359] Metadata directory not provided
I20260811 16:39:12.537065 12316 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:39:12.537184 12316 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 16:39:12 dist-test-slave-zj8q krb5kdc[11552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466352, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.254@KRBTEST.COM for HTTP/127.24.175.212@KRBTEST.COM
I20260811 16:39:12.592522 12316 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/master-0/data/instance:
uuid: "37451e0f3a33477b8a2d49e9f1bf156a"
format_stamp: "Formatted at 2026-08-11 16:39:12 on dist-test-slave-zj8q"
server_key: "36cd44076015a0f2d7a2c07103da8c20"
server_key_iv: "5c105674cf7da2b18d4ed93b4c63993a"
server_key_version: "kuduclusterkey@0"
I20260811 16:39:12.592893 12316 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/master-0/wal/instance:
uuid: "37451e0f3a33477b8a2d49e9f1bf156a"
format_stamp: "Formatted at 2026-08-11 16:39:12 on dist-test-slave-zj8q"
server_key: "36cd44076015a0f2d7a2c07103da8c20"
server_key_iv: "5c105674cf7da2b18d4ed93b4c63993a"
server_key_version: "kuduclusterkey@0"
I20260811 16:39:12.594295 12316 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:39:12.609198 12347 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:39:12.609387 12316 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 16:39:12.609490 12316 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/master-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/master-0/wal
uuid: "37451e0f3a33477b8a2d49e9f1bf156a"
format_stamp: "Formatted at 2026-08-11 16:39:12 on dist-test-slave-zj8q"
server_key: "36cd44076015a0f2d7a2c07103da8c20"
server_key_iv: "5c105674cf7da2b18d4ed93b4c63993a"
server_key_version: "kuduclusterkey@0"
I20260811 16:39:12.609596 12316 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:39:12.649874 12316 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:39:12.651738 12316 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:39:12.651871 12316 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:39:12.656817 12316 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.254:32807
I20260811 16:39:12.656906 12444 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.254:32807 every 8 connection(s)
I20260811 16:39:12.657235 12316 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
I20260811 16:39:12.658032 12445 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:39:12.659578 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 12316
I20260811 16:39:12.659672 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/master-0/wal/instance
I20260811 16:39:12.659832 25279 external_mini_cluster.cc:1428] Setting key 1ce76e2d4a3f8ad8fd88ea5b29f0a60a
I20260811 16:39:12.661145 12445 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 37451e0f3a33477b8a2d49e9f1bf156a: Bootstrap starting.
I20260811 16:39:12.661942 12445 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 37451e0f3a33477b8a2d49e9f1bf156a: Neither blocks nor log segments found. Creating new log.
I20260811 16:39:12.662282 12445 log.cc:824] T 00000000000000000000000000000000 P 37451e0f3a33477b8a2d49e9f1bf156a: Log is configured to *not* fsync() on all Append() calls
I20260811 16:39:12.663019 12445 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 37451e0f3a33477b8a2d49e9f1bf156a: No bootstrap required, opened a new log
I20260811 16:39:12.665386 12445 raft_consensus.cc:348] T 00000000000000000000000000000000 P 37451e0f3a33477b8a2d49e9f1bf156a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37451e0f3a33477b8a2d49e9f1bf156a" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 32807 } }
I20260811 16:39:12.665567 12445 raft_consensus.cc:374] T 00000000000000000000000000000000 P 37451e0f3a33477b8a2d49e9f1bf156a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:39:12.665648 12445 raft_consensus.cc:729] T 00000000000000000000000000000000 P 37451e0f3a33477b8a2d49e9f1bf156a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37451e0f3a33477b8a2d49e9f1bf156a, State: Initialized, Role: FOLLOWER
I20260811 16:39:12.665791 12445 consensus_queue.cc:260] T 00000000000000000000000000000000 P 37451e0f3a33477b8a2d49e9f1bf156a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37451e0f3a33477b8a2d49e9f1bf156a" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 32807 } }
I20260811 16:39:12.665865 12445 raft_consensus.cc:388] T 00000000000000000000000000000000 P 37451e0f3a33477b8a2d49e9f1bf156a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
Aug 11 16:39:12 dist-test-slave-zj8q krb5kdc[11552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466352, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:39:12.665892 12445 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37451e0f3a33477b8a2d49e9f1bf156a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:39:12.665930 12445 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 37451e0f3a33477b8a2d49e9f1bf156a [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:39:12.666633 12445 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37451e0f3a33477b8a2d49e9f1bf156a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37451e0f3a33477b8a2d49e9f1bf156a" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 32807 } }
I20260811 16:39:12.666741 12445 leader_election.cc:302] T 00000000000000000000000000000000 P 37451e0f3a33477b8a2d49e9f1bf156a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 37451e0f3a33477b8a2d49e9f1bf156a; no voters:
I20260811 16:39:12.666925 12445 leader_election.cc:288] T 00000000000000000000000000000000 P 37451e0f3a33477b8a2d49e9f1bf156a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:39:12.666980 12451 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 37451e0f3a33477b8a2d49e9f1bf156a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:39:12.667232 12445 sys_catalog.cc:564] T 00000000000000000000000000000000 P 37451e0f3a33477b8a2d49e9f1bf156a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:39:12.667572 12451 raft_consensus.cc:686] T 00000000000000000000000000000000 P 37451e0f3a33477b8a2d49e9f1bf156a [term 1 LEADER]: Becoming Leader. State: Replica: 37451e0f3a33477b8a2d49e9f1bf156a, State: Running, Role: LEADER
I20260811 16:39:12.667747 12451 consensus_queue.cc:237] T 00000000000000000000000000000000 P 37451e0f3a33477b8a2d49e9f1bf156a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37451e0f3a33477b8a2d49e9f1bf156a" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 32807 } }
I20260811 16:39:12.668159 12451 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37451e0f3a33477b8a2d49e9f1bf156a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "37451e0f3a33477b8a2d49e9f1bf156a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37451e0f3a33477b8a2d49e9f1bf156a" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 32807 } } }
I20260811 16:39:12.668390 12455 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37451e0f3a33477b8a2d49e9f1bf156a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 37451e0f3a33477b8a2d49e9f1bf156a. Latest consensus state: current_term: 1 leader_uuid: "37451e0f3a33477b8a2d49e9f1bf156a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37451e0f3a33477b8a2d49e9f1bf156a" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 32807 } } }
I20260811 16:39:12.668517 12455 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37451e0f3a33477b8a2d49e9f1bf156a [sys.catalog]: This master's current role is: LEADER
I20260811 16:39:12.668620 12451 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37451e0f3a33477b8a2d49e9f1bf156a [sys.catalog]: This master's current role is: LEADER
I20260811 16:39:12.668795 12445 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 16:39:12.672530 12448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:39:12.660282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52752 (local address 127.24.175.254:32807)
0811 16:39:12.660453 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0811 16:39:12.660462 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 16:39:12.660494 (+ 32us) server_negotiation.cc:407] Connection header received
0811 16:39:12.660930 (+ 436us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:39:12.660937 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:39:12.660983 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:39:12.661109 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:39:12.661743 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:39:12.662862 (+ 1119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:39:12.663618 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:39:12.664043 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:39:12.664143 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:39:12.666377 (+ 2234us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:39:12.666382 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:39:12.666382 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:39:12.666394 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:39:12.668267 (+ 1873us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:39:12.668614 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:39:12.668617 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:39:12.668618 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:39:12.668732 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:39:12.668929 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:39:12.668930 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:39:12.668930 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:39:12.669161 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:39:12.669302 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0811 16:39:12.669415 (+ 113us) server_negotiation.cc:299] Negotiation successful
0811 16:39:12.671988 (+ 2573us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":65,"threads_started":1}
I20260811 16:39:12.673043 12472 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:39:12.673843 12472 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:39:12.679039 12482 mvcc.cc:205] Tried to move back new op lower bound from 7317366180571140096 to 7317366180527673344. Current Snapshot: MvccSnapshot[applied={T|T < 7317366180571140096}]
I20260811 16:39:12.679564 12472 catalog_manager.cc:1347] Generated new cluster ID: c44a7cdd8bf14fe4a8a0ce28c2e41089
I20260811 16:39:12.679615 12472 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:39:12.688902 12472 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:39:12.689642 12472 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:39:12.692247 12472 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 37451e0f3a33477b8a2d49e9f1bf156a: Generated new TSK 0
I20260811 16:39:12.692457 12472 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.175.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab.
Entry for principal kudu/127.24.175.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab.
I20260811 16:39:13.397117 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.24.175.212:59259/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.193:0
--local_ip_for_outbound_sockets=127.24.175.193
--webserver_interface=127.24.175.193
--webserver_port=0
--tserver_master_addrs=127.24.175.254:32807
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab
--principal=kudu/127.24.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:41139
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:39:13.481792 12515 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:39:13.481973 12515 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:39:13.481993 12515 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:39:13.483100 12515 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:39:13.483141 12515 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:39:13.483165 12515 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.193
I20260811 16:39:13.484593 12515 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:41139
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.24.175.212:59259/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab
--principal=kudu/127.24.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.175.193
--webserver_port=0
--tserver_master_addrs=127.24.175.254:32807
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12515
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.193
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:39:13.484797 12515 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:39:13.485006 12515 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:39:13.489923 12524 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:39:13.489913 12523 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:39:13.490132 12526 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:39:13.490785 12515 server_base.cc:1034] running on GCE node
I20260811 16:39:13.490979 12515 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:39:13.491209 12515 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:39:13.492367 12515 hybrid_clock.cc:648] HybridClock initialized: now 1786466353492354 us; error 26 us; skew 500 ppm
Aug 11 16:39:13 dist-test-slave-zj8q krb5kdc[11552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466353, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:39:13.494805 12515 init.cc:377] Logged in from keytab as kudu/127.24.175.193@KRBTEST.COM (short username kudu)
I20260811 16:39:13.495188 12515 webserver.cc:460] Webserver started at http://127.24.175.193:36545/ using document root <none> and password file <none>
I20260811 16:39:13.495411 12515 fs_manager.cc:359] Metadata directory not provided
I20260811 16:39:13.495462 12515 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:39:13.495579 12515 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 16:39:13 dist-test-slave-zj8q krb5kdc[11552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466353, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.193@KRBTEST.COM for HTTP/127.24.175.212@KRBTEST.COM
I20260811 16:39:13.509059 12515 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ts-0/data/instance:
uuid: "8f15fd248a1a4fa9becb87c2e740685f"
format_stamp: "Formatted at 2026-08-11 16:39:13 on dist-test-slave-zj8q"
server_key: "13462f088616fa232fa48d99fa14ea49"
server_key_iv: "6b2c8e5b0fff907d3da1c424e41bafd7"
server_key_version: "kuduclusterkey@0"
I20260811 16:39:13.509481 12515 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ts-0/wal/instance:
uuid: "8f15fd248a1a4fa9becb87c2e740685f"
format_stamp: "Formatted at 2026-08-11 16:39:13 on dist-test-slave-zj8q"
server_key: "13462f088616fa232fa48d99fa14ea49"
server_key_iv: "6b2c8e5b0fff907d3da1c424e41bafd7"
server_key_version: "kuduclusterkey@0"
I20260811 16:39:13.512781 12515 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.004s
I20260811 16:39:13.525909 12539 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:39:13.526247 12515 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:39:13.526377 12515 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ts-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ts-0/wal
uuid: "8f15fd248a1a4fa9becb87c2e740685f"
format_stamp: "Formatted at 2026-08-11 16:39:13 on dist-test-slave-zj8q"
server_key: "13462f088616fa232fa48d99fa14ea49"
server_key_iv: "6b2c8e5b0fff907d3da1c424e41bafd7"
server_key_version: "kuduclusterkey@0"
I20260811 16:39:13.526484 12515 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:39:13.548360 12515 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:39:13.550839 12515 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:39:13.551038 12515 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:39:13.551316 12515 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:39:13.551748 12515 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:39:13.551838 12515 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:39:13.551939 12515 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:39:13.552027 12515 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:39:13.559425 12515 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.193:35337
I20260811 16:39:13.559525 12726 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.193:35337 every 8 connection(s)
I20260811 16:39:13.559900 12515 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
I20260811 16:39:13.564713 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 12515
I20260811 16:39:13.564811 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ts-0/wal/instance
I20260811 16:39:13.565006 25279 external_mini_cluster.cc:1428] Setting key 396c0522ac3cd009058ea7b3d03ec063
Aug 11 16:39:13 dist-test-slave-zj8q krb5kdc[11552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466353, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.193@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:39:13.571475 12731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:39:13.560704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:32807 (local address 127.24.175.193:55935)
0811 16:39:13.560905 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0811 16:39:13.560954 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 16:39:13.561592 (+ 638us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:39:13.562041 (+ 449us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:39:13.562046 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:39:13.562349 (+ 303us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:39:13.562627 (+ 278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:39:13.562634 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:39:13.563676 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:39:13.563677 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:39:13.564924 (+ 1247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:39:13.564927 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:39:13.565452 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:39:13.565453 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:39:13.565628 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:39:13.566214 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:39:13.566235 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:39:13.567780 (+ 1545us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:39:13.569725 (+ 1945us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:39:13.569732 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:39:13.569735 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:39:13.570012 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:39:13.570382 (+ 370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:39:13.570383 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:39:13.570383 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:39:13.570517 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:39:13.570800 (+ 283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:39:13.570807 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:39:13.570967 (+ 160us) client_negotiation.cc:769] Sending connection context
0811 16:39:13.571069 (+ 102us) client_negotiation.cc:240] Negotiation successful
0811 16:39:13.571238 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":103,"threads_started":1}
I20260811 16:39:13.572038 12732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:39:13.560716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:55935 (local address 127.24.175.254:32807)
0811 16:39:13.561795 (+ 1079us) server_negotiation.cc:206] Beginning negotiation
0811 16:39:13.561797 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:39:13.561806 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:39:13.561832 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:39:13.561833 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:39:13.561845 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:39:13.561918 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:39:13.562751 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:39:13.563574 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:39:13.565024 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:39:13.565327 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:39:13.565385 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:39:13.567883 (+ 2498us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:39:13.567885 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:39:13.567885 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:39:13.567893 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:39:13.569638 (+ 1745us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:39:13.570089 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:39:13.570090 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:39:13.570090 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:39:13.570317 (+ 227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:39:13.570582 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:39:13.570583 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:39:13.570583 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:39:13.570716 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:39:13.570775 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 16:39:13.571842 (+ 1067us) server_negotiation.cc:299] Negotiation successful
0811 16:39:13.571930 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1043,"thread_start_us":104,"threads_started":1}
I20260811 16:39:13.572750 12727 heartbeater.cc:347] Connected to a master server at 127.24.175.254:32807
I20260811 16:39:13.572845 12727 heartbeater.cc:464] Registering TS with master...
I20260811 16:39:13.573030 12727 heartbeater.cc:511] Master 127.24.175.254:32807 requested a full tablet report, sending...
I20260811 16:39:13.573614 12387 ts_manager.cc:194] Registered new tserver with Master: 8f15fd248a1a4fa9becb87c2e740685f (127.24.175.193:35337)
I20260811 16:39:13.574517 12387 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.175.193@KRBTEST.COM'} at 127.24.175.193:55935
WARNING: no policy specified for kudu/127.24.175.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab.
Entry for principal kudu/127.24.175.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab.
I20260811 16:39:13.606003 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.24.175.212:59259/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.194:0
--local_ip_for_outbound_sockets=127.24.175.194
--webserver_interface=127.24.175.194
--webserver_port=0
--tserver_master_addrs=127.24.175.254:32807
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab
--principal=kudu/127.24.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:41139
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:39:13.723958 12736 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:39:13.724323 12736 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:39:13.724421 12736 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:39:13.726342 12736 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:39:13.726444 12736 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:39:13.726533 12736 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.194
I20260811 16:39:13.728729 12736 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:41139
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.24.175.212:59259/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab
--principal=kudu/127.24.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.175.194
--webserver_port=0
--tserver_master_addrs=127.24.175.254:32807
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12736
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.194
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:39:13.729192 12736 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:39:13.729498 12736 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:39:13.739053 12756 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:39:13.739300 12753 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:39:13.739583 12749 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:39:13.741439 12736 server_base.cc:1034] running on GCE node
I20260811 16:39:13.741740 12736 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:39:13.741991 12736 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:39:13.743145 12736 hybrid_clock.cc:648] HybridClock initialized: now 1786466353743122 us; error 34 us; skew 500 ppm
Aug 11 16:39:13 dist-test-slave-zj8q krb5kdc[11552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466353, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:39:13.746577 12736 init.cc:377] Logged in from keytab as kudu/127.24.175.194@KRBTEST.COM (short username kudu)
I20260811 16:39:13.747124 12736 webserver.cc:460] Webserver started at http://127.24.175.194:35065/ using document root <none> and password file <none>
I20260811 16:39:13.747392 12736 fs_manager.cc:359] Metadata directory not provided
I20260811 16:39:13.747440 12736 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:39:13.747556 12736 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 16:39:13 dist-test-slave-zj8q krb5kdc[11552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466353, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.194@KRBTEST.COM for HTTP/127.24.175.212@KRBTEST.COM
I20260811 16:39:13.760102 12736 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ts-1/data/instance:
uuid: "1dc9186ffd234a348755fb483e9c1e97"
format_stamp: "Formatted at 2026-08-11 16:39:13 on dist-test-slave-zj8q"
server_key: "66f53cc3e712841058ad92984f12d9c9"
server_key_iv: "39db8640eb760e59936b32454cc3aacd"
server_key_version: "kuduclusterkey@0"
I20260811 16:39:13.760679 12736 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ts-1/wal/instance:
uuid: "1dc9186ffd234a348755fb483e9c1e97"
format_stamp: "Formatted at 2026-08-11 16:39:13 on dist-test-slave-zj8q"
server_key: "66f53cc3e712841058ad92984f12d9c9"
server_key_iv: "39db8640eb760e59936b32454cc3aacd"
server_key_version: "kuduclusterkey@0"
I20260811 16:39:13.762923 12736 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260811 16:39:13.782258 12766 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:39:13.782497 12736 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.001s sys 0.000s
I20260811 16:39:13.782612 12736 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ts-1/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ts-1/wal
uuid: "1dc9186ffd234a348755fb483e9c1e97"
format_stamp: "Formatted at 2026-08-11 16:39:13 on dist-test-slave-zj8q"
server_key: "66f53cc3e712841058ad92984f12d9c9"
server_key_iv: "39db8640eb760e59936b32454cc3aacd"
server_key_version: "kuduclusterkey@0"
I20260811 16:39:13.782737 12736 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
Aug 11 16:39:13 dist-test-slave-zj8q krb5kdc[11552](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786466353, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:39:13.805773 12736 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:39:13.813606 12736 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:39:13.813767 12736 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:39:13.813997 12736 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:39:13.814404 12736 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:39:13.814445 12736 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:39:13.814474 12736 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:39:13.814491 12736 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:39:13.834586 12736 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.194:38043
I20260811 16:39:13.835039 12736 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
I20260811 16:39:13.842473 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 12736
I20260811 16:39:13.842577 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ts-1/wal/instance
I20260811 16:39:13.842787 25279 external_mini_cluster.cc:1428] Setting key 4cdf16e9cd38ae3a7287b8b26538f3e3
I20260811 16:39:13.843422 12950 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.194:38043 every 8 connection(s)
Aug 11 16:39:13 dist-test-slave-zj8q krb5kdc[11552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466353, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.194@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.24.175.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.195@KRBTEST.COM" created.
I20260811 16:39:13.863384 12732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:39:13.843086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:34247 (local address 127.24.175.254:32807)
0811 16:39:13.843136 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 16:39:13.843138 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:39:13.850433 (+ 7295us) server_negotiation.cc:407] Connection header received
0811 16:39:13.851107 (+ 674us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:39:13.851108 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:39:13.851125 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:39:13.851155 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:39:13.852027 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:39:13.852811 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:39:13.854319 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:39:13.854592 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:39:13.854632 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:39:13.860026 (+ 5394us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:39:13.860028 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:39:13.860029 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:39:13.860036 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:39:13.861694 (+ 1658us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:39:13.862265 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:39:13.862267 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:39:13.862267 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:39:13.862337 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:39:13.862617 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:39:13.862618 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:39:13.862619 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:39:13.862791 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:39:13.862857 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 16:39:13.863194 (+ 337us) server_negotiation.cc:299] Negotiation successful
0811 16:39:13.863286 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 16:39:13.864123 12956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:39:13.842774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:32807 (local address 127.24.175.194:34247)
0811 16:39:13.850262 (+ 7488us) negotiation.cc:107] Waiting for socket to connect
0811 16:39:13.850320 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0811 16:39:13.850972 (+ 652us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:39:13.851357 (+ 385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:39:13.851362 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:39:13.851621 (+ 259us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:39:13.851920 (+ 299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:39:13.851926 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:39:13.852931 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:39:13.852932 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:39:13.854218 (+ 1286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:39:13.854221 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:39:13.854720 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:39:13.854721 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:39:13.854875 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:39:13.858272 (+ 3397us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:39:13.858283 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:39:13.859924 (+ 1641us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:39:13.861791 (+ 1867us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:39:13.861797 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:39:13.861800 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:39:13.862145 (+ 345us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:39:13.862407 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:39:13.862408 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:39:13.862409 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:39:13.862537 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:39:13.862889 (+ 352us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:39:13.862896 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:39:13.863054 (+ 158us) client_negotiation.cc:769] Sending connection context
0811 16:39:13.863737 (+ 683us) client_negotiation.cc:240] Negotiation successful
0811 16:39:13.863898 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7425,"thread_start_us":91,"threads_started":1}
I20260811 16:39:13.864836 12952 heartbeater.cc:347] Connected to a master server at 127.24.175.254:32807
I20260811 16:39:13.864929 12952 heartbeater.cc:464] Registering TS with master...
I20260811 16:39:13.865108 12952 heartbeater.cc:511] Master 127.24.175.254:32807 requested a full tablet report, sending...
I20260811 16:39:13.865501 12387 ts_manager.cc:194] Registered new tserver with Master: 1dc9186ffd234a348755fb483e9c1e97 (127.24.175.194:38043)
I20260811 16:39:13.865993 12387 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.175.194@KRBTEST.COM'} at 127.24.175.194:34247
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab.
Entry for principal kudu/127.24.175.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab.
I20260811 16:39:13.881002 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.24.175.212:59259/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.195:0
--local_ip_for_outbound_sockets=127.24.175.195
--webserver_interface=127.24.175.195
--webserver_port=0
--tserver_master_addrs=127.24.175.254:32807
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab
--principal=kudu/127.24.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:41139
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:39:14.013589 12961 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:39:14.014051 12961 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:39:14.014187 12961 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:39:14.016045 12961 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:39:14.016191 12961 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:39:14.016297 12961 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.195
I20260811 16:39:14.018843 12961 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:41139
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.24.175.212:59259/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab
--principal=kudu/127.24.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.175.195
--webserver_port=0
--tserver_master_addrs=127.24.175.254:32807
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12961
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.195
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:39:14.019321 12961 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:39:14.019711 12961 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:39:14.029048 12970 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:39:14.029484 12969 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:39:14.030378 12972 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:39:14.031230 12961 server_base.cc:1034] running on GCE node
I20260811 16:39:14.031631 12961 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:39:14.031953 12961 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:39:14.047411 12961 hybrid_clock.cc:648] HybridClock initialized: now 1786466354044698 us; error 2735 us; skew 500 ppm
Aug 11 16:39:14 dist-test-slave-zj8q krb5kdc[11552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466354, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:39:14.054188 12961 init.cc:377] Logged in from keytab as kudu/127.24.175.195@KRBTEST.COM (short username kudu)
I20260811 16:39:14.054793 12961 webserver.cc:460] Webserver started at http://127.24.175.195:45329/ using document root <none> and password file <none>
I20260811 16:39:14.055101 12961 fs_manager.cc:359] Metadata directory not provided
I20260811 16:39:14.055179 12961 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:39:14.055337 12961 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 16:39:14 dist-test-slave-zj8q krb5kdc[11552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466354, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.195@KRBTEST.COM for HTTP/127.24.175.212@KRBTEST.COM
I20260811 16:39:14.089100 12961 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ts-2/data/instance:
uuid: "d98cc1fbbe8247dd978e7ae13f01e70a"
format_stamp: "Formatted at 2026-08-11 16:39:14 on dist-test-slave-zj8q"
server_key: "26d3a6e797e35c97a7042dfb39b5df34"
server_key_iv: "10b46c6ddb5b8d464ece58b4bbc7cf3c"
server_key_version: "kuduclusterkey@0"
I20260811 16:39:14.089874 12961 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ts-2/wal/instance:
uuid: "d98cc1fbbe8247dd978e7ae13f01e70a"
format_stamp: "Formatted at 2026-08-11 16:39:14 on dist-test-slave-zj8q"
server_key: "26d3a6e797e35c97a7042dfb39b5df34"
server_key_iv: "10b46c6ddb5b8d464ece58b4bbc7cf3c"
server_key_version: "kuduclusterkey@0"
I20260811 16:39:14.100260 12961 fs_manager.cc:691] Time spent creating directory manager: real 0.010s user 0.002s sys 0.000s
I20260811 16:39:14.114845 12985 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:39:14.115113 12961 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 16:39:14.115231 12961 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ts-2/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ts-2/wal
uuid: "d98cc1fbbe8247dd978e7ae13f01e70a"
format_stamp: "Formatted at 2026-08-11 16:39:14 on dist-test-slave-zj8q"
server_key: "26d3a6e797e35c97a7042dfb39b5df34"
server_key_iv: "10b46c6ddb5b8d464ece58b4bbc7cf3c"
server_key_version: "kuduclusterkey@0"
I20260811 16:39:14.115329 12961 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:39:14.128961 12961 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:39:14.131271 12961 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:39:14.131434 12961 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:39:14.131732 12961 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:39:14.132138 12961 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:39:14.132211 12961 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:39:14.132252 12961 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:39:14.132270 12961 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:39:14.161849 12961 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.195:42939
I20260811 16:39:14.162751 12961 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
I20260811 16:39:14.163305 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 12961
I20260811 16:39:14.163417 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ts-2/wal/instance
I20260811 16:39:14.163695 25279 external_mini_cluster.cc:1428] Setting key 0cf98ccdbdc976bd8d2e07d1139ff51e
I20260811 16:39:14.164907 13161 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.195:42939 every 8 connection(s)
Aug 11 16:39:14 dist-test-slave-zj8q krb5kdc[11552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466354, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.195@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:39:14.177911 12732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:39:14.165773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.195:45093 (local address 127.24.175.254:32807)
0811 16:39:14.165825 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 16:39:14.165827 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:39:14.166392 (+ 565us) server_negotiation.cc:407] Connection header received
0811 16:39:14.167429 (+ 1037us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:39:14.167430 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:39:14.167442 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:39:14.167513 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:39:14.168517 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:39:14.169301 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:39:14.171006 (+ 1705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:39:14.171307 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:39:14.171377 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:39:14.174388 (+ 3011us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:39:14.174390 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:39:14.174390 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:39:14.174399 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:39:14.176273 (+ 1874us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:39:14.176814 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:39:14.176815 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:39:14.176815 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:39:14.176883 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:39:14.177163 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:39:14.177164 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:39:14.177164 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:39:14.177313 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:39:14.177381 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 16:39:14.177716 (+ 335us) server_negotiation.cc:299] Negotiation successful
0811 16:39:14.177813 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 16:39:14.178112 13166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:39:14.165757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:32807 (local address 127.24.175.195:45093)
0811 16:39:14.166204 (+ 447us) negotiation.cc:107] Waiting for socket to connect
0811 16:39:14.166260 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 16:39:14.167317 (+ 1057us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:39:14.167615 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:39:14.167620 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:39:14.167971 (+ 351us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:39:14.168422 (+ 451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:39:14.168430 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:39:14.169403 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:39:14.169405 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:39:14.170920 (+ 1515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:39:14.170924 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:39:14.171399 (+ 475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:39:14.171400 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:39:14.171567 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:39:14.172245 (+ 678us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:39:14.172257 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:39:14.174287 (+ 2030us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:39:14.176360 (+ 2073us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:39:14.176366 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:39:14.176369 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:39:14.176699 (+ 330us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:39:14.176951 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:39:14.176952 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:39:14.176952 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:39:14.177086 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:39:14.177384 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:39:14.177390 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:39:14.177553 (+ 163us) client_negotiation.cc:769] Sending connection context
0811 16:39:14.177662 (+ 109us) client_negotiation.cc:240] Negotiation successful
0811 16:39:14.177817 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":341,"thread_start_us":252,"threads_started":1}
I20260811 16:39:14.178763 13163 heartbeater.cc:347] Connected to a master server at 127.24.175.254:32807
I20260811 16:39:14.178877 13163 heartbeater.cc:464] Registering TS with master...
I20260811 16:39:14.179097 13163 heartbeater.cc:511] Master 127.24.175.254:32807 requested a full tablet report, sending...
I20260811 16:39:14.179483 12387 ts_manager.cc:194] Registered new tserver with Master: d98cc1fbbe8247dd978e7ae13f01e70a (127.24.175.195:42939)
I20260811 16:39:14.179993 12387 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.175.195@KRBTEST.COM'} at 127.24.175.195:45093
I20260811 16:39:14.187182 25279 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 16:39:14.197391 12732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:39:14.188965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59644 (local address 127.24.175.254:32807)
0811 16:39:14.189006 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 16:39:14.189008 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:39:14.189258 (+ 250us) server_negotiation.cc:407] Connection header received
0811 16:39:14.189349 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:39:14.189350 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:39:14.189360 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:39:14.189389 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:39:14.190264 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:39:14.190989 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:39:14.192483 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:39:14.192749 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:39:14.192795 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:39:14.194448 (+ 1653us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:39:14.194450 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:39:14.194450 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:39:14.194458 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:39:14.196144 (+ 1686us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:39:14.196542 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:39:14.196543 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:39:14.196543 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:39:14.196600 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:39:14.196798 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:39:14.196798 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:39:14.196799 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:39:14.196923 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:39:14.196997 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 16:39:14.197218 (+ 221us) server_negotiation.cc:299] Negotiation successful
0811 16:39:14.197295 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 16:39:14.199782 12387 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59644:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:39:14.202209 12387 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:39:14.231668 13179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:39:14.221292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.193:35337 (local address 127.0.0.1:49518)
0811 16:39:14.223041 (+ 1749us) negotiation.cc:107] Waiting for socket to connect
0811 16:39:14.223050 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:39:14.223098 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:39:14.223425 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:39:14.223428 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:39:14.223430 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:39:14.223505 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:39:14.223507 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:39:14.225027 (+ 1520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:39:14.225028 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:39:14.227278 (+ 2250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:39:14.227280 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:39:14.231389 (+ 4109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:39:14.231390 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:39:14.231463 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:39:14.231479 (+ 16us) client_negotiation.cc:769] Sending connection context
0811 16:39:14.231534 (+ 55us) client_negotiation.cc:240] Negotiation successful
0811 16:39:14.231585 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1708,"thread_start_us":177,"threads_started":1}
I20260811 16:39:14.231941 13182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:39:14.221606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49518 (local address 127.24.175.193:35337)
0811 16:39:14.222933 (+ 1327us) server_negotiation.cc:206] Beginning negotiation
0811 16:39:14.222939 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 16:39:14.223163 (+ 224us) server_negotiation.cc:407] Connection header received
0811 16:39:14.223203 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:39:14.223206 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:39:14.223222 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:39:14.223286 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:39:14.223592 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:39:14.224929 (+ 1337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:39:14.227361 (+ 2432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:39:14.228248 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:39:14.228323 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:39:14.228392 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 16:39:14.231796 (+ 3404us) server_negotiation.cc:299] Negotiation successful
0811 16:39:14.231873 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1291,"thread_start_us":51,"threads_started":1}
I20260811 16:39:14.232872 12630 tablet_service.cc:1467] Processing CreateTablet for tablet 4739501b00224fddb3ad8afb38085b5c (DEFAULT_TABLE table=test-table [id=76801fbef7dc4f92b56c4b9ba3cc5c02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:39:14.233299 12630 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4739501b00224fddb3ad8afb38085b5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:39:14.234401 13183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:39:14.221289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.194:38043 (local address 127.0.0.1:42196)
0811 16:39:14.222650 (+ 1361us) negotiation.cc:107] Waiting for socket to connect
0811 16:39:14.222697 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 16:39:14.222767 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:39:14.226887 (+ 4120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:39:14.226888 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:39:14.226890 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:39:14.226934 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:39:14.226936 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:39:14.229831 (+ 2895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:39:14.229833 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:39:14.231309 (+ 1476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:39:14.231312 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:39:14.234136 (+ 2824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:39:14.234137 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:39:14.234235 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:39:14.234239 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:39:14.234287 (+ 48us) client_negotiation.cc:240] Negotiation successful
0811 16:39:14.234327 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1303,"thread_start_us":133,"threads_started":1}
I20260811 16:39:14.236145 13184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:39:14.222022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42196 (local address 127.24.175.194:38043)
0811 16:39:14.226566 (+ 4544us) server_negotiation.cc:206] Beginning negotiation
0811 16:39:14.226570 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:39:14.226581 (+ 11us) server_negotiation.cc:407] Connection header received
0811 16:39:14.226644 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:39:14.226646 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:39:14.226662 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:39:14.226741 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:39:14.228435 (+ 1694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:39:14.229737 (+ 1302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:39:14.232765 (+ 3028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:39:14.233850 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:39:14.234030 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:39:14.234090 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 16:39:14.235939 (+ 1849us) server_negotiation.cc:299] Negotiation successful
0811 16:39:14.235983 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4471,"thread_start_us":168,"threads_started":1}
I20260811 16:39:14.236836 12815 tablet_service.cc:1467] Processing CreateTablet for tablet 4739501b00224fddb3ad8afb38085b5c (DEFAULT_TABLE table=test-table [id=76801fbef7dc4f92b56c4b9ba3cc5c02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:39:14.237262 12815 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4739501b00224fddb3ad8afb38085b5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:39:14.239217 13177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:39:14.221564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.195:42939 (local address 127.0.0.1:37832)
0811 16:39:14.226295 (+ 4731us) negotiation.cc:107] Waiting for socket to connect
0811 16:39:14.226306 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:39:14.226358 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:39:14.232522 (+ 6164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:39:14.232523 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:39:14.232525 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:39:14.232563 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:39:14.232565 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:39:14.236487 (+ 3922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:39:14.236488 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:39:14.237596 (+ 1108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:39:14.237599 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:39:14.238974 (+ 1375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:39:14.238975 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:39:14.239033 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:39:14.239039 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 16:39:14.239065 (+ 26us) client_negotiation.cc:240] Negotiation successful
0811 16:39:14.239151 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4688,"thread_start_us":129,"threads_started":1}
I20260811 16:39:14.239902 13185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:39:14.222281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37832 (local address 127.24.175.195:42939)
0811 16:39:14.232212 (+ 9931us) server_negotiation.cc:206] Beginning negotiation
0811 16:39:14.232216 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:39:14.232228 (+ 12us) server_negotiation.cc:407] Connection header received
0811 16:39:14.232289 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:39:14.232291 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:39:14.232308 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:39:14.232387 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:39:14.234556 (+ 2169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:39:14.235838 (+ 1282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:39:14.237967 (+ 2129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:39:14.238881 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:39:14.239502 (+ 621us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:39:14.239595 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 16:39:14.239683 (+ 88us) server_negotiation.cc:299] Negotiation successful
0811 16:39:14.239753 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9863,"thread_start_us":144,"threads_started":1}
I20260811 16:39:14.240722 13055 tablet_service.cc:1467] Processing CreateTablet for tablet 4739501b00224fddb3ad8afb38085b5c (DEFAULT_TABLE table=test-table [id=76801fbef7dc4f92b56c4b9ba3cc5c02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:39:14.241170 13055 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4739501b00224fddb3ad8afb38085b5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:39:14.249131 13188 tablet_bootstrap.cc:492] T 4739501b00224fddb3ad8afb38085b5c P 1dc9186ffd234a348755fb483e9c1e97: Bootstrap starting.
I20260811 16:39:14.249411 13186 tablet_bootstrap.cc:492] T 4739501b00224fddb3ad8afb38085b5c P 8f15fd248a1a4fa9becb87c2e740685f: Bootstrap starting.
I20260811 16:39:14.251148 13188 tablet_bootstrap.cc:654] T 4739501b00224fddb3ad8afb38085b5c P 1dc9186ffd234a348755fb483e9c1e97: Neither blocks nor log segments found. Creating new log.
I20260811 16:39:14.251163 13186 tablet_bootstrap.cc:654] T 4739501b00224fddb3ad8afb38085b5c P 8f15fd248a1a4fa9becb87c2e740685f: Neither blocks nor log segments found. Creating new log.
I20260811 16:39:14.251983 13186 log.cc:824] T 4739501b00224fddb3ad8afb38085b5c P 8f15fd248a1a4fa9becb87c2e740685f: Log is configured to *not* fsync() on all Append() calls
I20260811 16:39:14.252063 13188 log.cc:824] T 4739501b00224fddb3ad8afb38085b5c P 1dc9186ffd234a348755fb483e9c1e97: Log is configured to *not* fsync() on all Append() calls
I20260811 16:39:14.252593 13187 tablet_bootstrap.cc:492] T 4739501b00224fddb3ad8afb38085b5c P d98cc1fbbe8247dd978e7ae13f01e70a: Bootstrap starting.
I20260811 16:39:14.254459 13187 tablet_bootstrap.cc:654] T 4739501b00224fddb3ad8afb38085b5c P d98cc1fbbe8247dd978e7ae13f01e70a: Neither blocks nor log segments found. Creating new log.
I20260811 16:39:14.255474 13187 log.cc:824] T 4739501b00224fddb3ad8afb38085b5c P d98cc1fbbe8247dd978e7ae13f01e70a: Log is configured to *not* fsync() on all Append() calls
I20260811 16:39:14.256572 13186 tablet_bootstrap.cc:492] T 4739501b00224fddb3ad8afb38085b5c P 8f15fd248a1a4fa9becb87c2e740685f: No bootstrap required, opened a new log
I20260811 16:39:14.256695 13186 ts_tablet_manager.cc:1397] T 4739501b00224fddb3ad8afb38085b5c P 8f15fd248a1a4fa9becb87c2e740685f: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.003s
I20260811 16:39:14.261500 13186 raft_consensus.cc:348] T 4739501b00224fddb3ad8afb38085b5c P 8f15fd248a1a4fa9becb87c2e740685f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f15fd248a1a4fa9becb87c2e740685f" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 35337 } } peers { permanent_uuid: "1dc9186ffd234a348755fb483e9c1e97" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38043 } } peers { permanent_uuid: "d98cc1fbbe8247dd978e7ae13f01e70a" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42939 } }
I20260811 16:39:14.261806 13186 raft_consensus.cc:374] T 4739501b00224fddb3ad8afb38085b5c P 8f15fd248a1a4fa9becb87c2e740685f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:39:14.261904 13186 raft_consensus.cc:729] T 4739501b00224fddb3ad8afb38085b5c P 8f15fd248a1a4fa9becb87c2e740685f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f15fd248a1a4fa9becb87c2e740685f, State: Initialized, Role: FOLLOWER
I20260811 16:39:14.262131 13186 consensus_queue.cc:260] T 4739501b00224fddb3ad8afb38085b5c P 8f15fd248a1a4fa9becb87c2e740685f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f15fd248a1a4fa9becb87c2e740685f" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 35337 } } peers { permanent_uuid: "1dc9186ffd234a348755fb483e9c1e97" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38043 } } peers { permanent_uuid: "d98cc1fbbe8247dd978e7ae13f01e70a" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42939 } }
I20260811 16:39:14.262553 13186 ts_tablet_manager.cc:1428] T 4739501b00224fddb3ad8afb38085b5c P 8f15fd248a1a4fa9becb87c2e740685f: Time spent starting tablet: real 0.006s user 0.000s sys 0.005s
I20260811 16:39:14.262720 12727 heartbeater.cc:503] Master 127.24.175.254:32807 was elected leader, sending a full tablet report...
I20260811 16:39:14.263859 13188 tablet_bootstrap.cc:492] T 4739501b00224fddb3ad8afb38085b5c P 1dc9186ffd234a348755fb483e9c1e97: No bootstrap required, opened a new log
I20260811 16:39:14.263983 13188 ts_tablet_manager.cc:1397] T 4739501b00224fddb3ad8afb38085b5c P 1dc9186ffd234a348755fb483e9c1e97: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.000s
I20260811 16:39:14.264166 13187 tablet_bootstrap.cc:492] T 4739501b00224fddb3ad8afb38085b5c P d98cc1fbbe8247dd978e7ae13f01e70a: No bootstrap required, opened a new log
I20260811 16:39:14.264282 13187 ts_tablet_manager.cc:1397] T 4739501b00224fddb3ad8afb38085b5c P d98cc1fbbe8247dd978e7ae13f01e70a: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.000s
I20260811 16:39:14.267942 13197 raft_consensus.cc:482] T 4739501b00224fddb3ad8afb38085b5c P 8f15fd248a1a4fa9becb87c2e740685f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:39:14.268088 13197 raft_consensus.cc:504] T 4739501b00224fddb3ad8afb38085b5c P 8f15fd248a1a4fa9becb87c2e740685f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f15fd248a1a4fa9becb87c2e740685f" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 35337 } } peers { permanent_uuid: "1dc9186ffd234a348755fb483e9c1e97" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38043 } } peers { permanent_uuid: "d98cc1fbbe8247dd978e7ae13f01e70a" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42939 } }
I20260811 16:39:14.268884 13187 raft_consensus.cc:348] T 4739501b00224fddb3ad8afb38085b5c P d98cc1fbbe8247dd978e7ae13f01e70a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f15fd248a1a4fa9becb87c2e740685f" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 35337 } } peers { permanent_uuid: "1dc9186ffd234a348755fb483e9c1e97" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38043 } } peers { permanent_uuid: "d98cc1fbbe8247dd978e7ae13f01e70a" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42939 } }
I20260811 16:39:14.269099 13187 raft_consensus.cc:374] T 4739501b00224fddb3ad8afb38085b5c P d98cc1fbbe8247dd978e7ae13f01e70a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:39:14.269191 13187 raft_consensus.cc:729] T 4739501b00224fddb3ad8afb38085b5c P d98cc1fbbe8247dd978e7ae13f01e70a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d98cc1fbbe8247dd978e7ae13f01e70a, State: Initialized, Role: FOLLOWER
I20260811 16:39:14.269399 13187 consensus_queue.cc:260] T 4739501b00224fddb3ad8afb38085b5c P d98cc1fbbe8247dd978e7ae13f01e70a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f15fd248a1a4fa9becb87c2e740685f" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 35337 } } peers { permanent_uuid: "1dc9186ffd234a348755fb483e9c1e97" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38043 } } peers { permanent_uuid: "d98cc1fbbe8247dd978e7ae13f01e70a" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42939 } }
I20260811 16:39:14.269465 13197 leader_election.cc:288] T 4739501b00224fddb3ad8afb38085b5c P 8f15fd248a1a4fa9becb87c2e740685f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1dc9186ffd234a348755fb483e9c1e97 (127.24.175.194:38043), d98cc1fbbe8247dd978e7ae13f01e70a (127.24.175.195:42939)
I20260811 16:39:14.269809 13187 ts_tablet_manager.cc:1428] T 4739501b00224fddb3ad8afb38085b5c P d98cc1fbbe8247dd978e7ae13f01e70a: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260811 16:39:14.270001 13163 heartbeater.cc:503] Master 127.24.175.254:32807 was elected leader, sending a full tablet report...
I20260811 16:39:14.270726 13188 raft_consensus.cc:348] T 4739501b00224fddb3ad8afb38085b5c P 1dc9186ffd234a348755fb483e9c1e97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f15fd248a1a4fa9becb87c2e740685f" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 35337 } } peers { permanent_uuid: "1dc9186ffd234a348755fb483e9c1e97" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38043 } } peers { permanent_uuid: "d98cc1fbbe8247dd978e7ae13f01e70a" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42939 } }
I20260811 16:39:14.271024 13188 raft_consensus.cc:374] T 4739501b00224fddb3ad8afb38085b5c P 1dc9186ffd234a348755fb483e9c1e97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:39:14.271131 13188 raft_consensus.cc:729] T 4739501b00224fddb3ad8afb38085b5c P 1dc9186ffd234a348755fb483e9c1e97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1dc9186ffd234a348755fb483e9c1e97, State: Initialized, Role: FOLLOWER
I20260811 16:39:14.271411 13188 consensus_queue.cc:260] T 4739501b00224fddb3ad8afb38085b5c P 1dc9186ffd234a348755fb483e9c1e97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f15fd248a1a4fa9becb87c2e740685f" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 35337 } } peers { permanent_uuid: "1dc9186ffd234a348755fb483e9c1e97" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38043 } } peers { permanent_uuid: "d98cc1fbbe8247dd978e7ae13f01e70a" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42939 } }
I20260811 16:39:14.271814 13188 ts_tablet_manager.cc:1428] T 4739501b00224fddb3ad8afb38085b5c P 1dc9186ffd234a348755fb483e9c1e97: Time spent starting tablet: real 0.008s user 0.000s sys 0.005s
I20260811 16:39:14.271976 12952 heartbeater.cc:503] Master 127.24.175.254:32807 was elected leader, sending a full tablet report...
I20260811 16:39:14.280501 13184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:39:14.268928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:36915 (local address 127.24.175.194:38043)
0811 16:39:14.268970 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 16:39:14.268972 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:39:14.272210 (+ 3238us) server_negotiation.cc:407] Connection header received
0811 16:39:14.272311 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:39:14.272312 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:39:14.272321 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:39:14.272349 (+ 28us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:39:14.273419 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:39:14.274219 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:39:14.278557 (+ 4338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:39:14.279104 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:39:14.279155 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:39:14.279166 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 16:39:14.280384 (+ 1218us) server_negotiation.cc:299] Negotiation successful
0811 16:39:14.280429 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 16:39:14.280927 13201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:39:14.268689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.194:38043 (local address 127.24.175.193:36915)
0811 16:39:14.272138 (+ 3449us) negotiation.cc:107] Waiting for socket to connect
0811 16:39:14.272151 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 16:39:14.272239 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:39:14.272416 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:39:14.272417 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:39:14.272496 (+ 79us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:39:14.272750 (+ 254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:39:14.272754 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:39:14.274463 (+ 1709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:39:14.274464 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:39:14.275920 (+ 1456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:39:14.275923 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:39:14.279226 (+ 3303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:39:14.279227 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:39:14.279371 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:39:14.279377 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 16:39:14.280787 (+ 1410us) client_negotiation.cc:240] Negotiation successful
0811 16:39:14.280839 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3406,"thread_start_us":146,"threads_started":1}
I20260811 16:39:14.281288 13185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:39:14.269409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:60703 (local address 127.24.175.195:42939)
0811 16:39:14.269446 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 16:39:14.269448 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:39:14.272928 (+ 3480us) server_negotiation.cc:407] Connection header received
0811 16:39:14.273019 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:39:14.273020 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:39:14.273029 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:39:14.273056 (+ 27us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:39:14.276032 (+ 2976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:39:14.276736 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:39:14.279479 (+ 2743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:39:14.280017 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:39:14.280072 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:39:14.280082 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 16:39:14.281179 (+ 1097us) server_negotiation.cc:299] Negotiation successful
0811 16:39:14.281225 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 16:39:14.282231 12865 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4739501b00224fddb3ad8afb38085b5c" candidate_uuid: "8f15fd248a1a4fa9becb87c2e740685f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dc9186ffd234a348755fb483e9c1e97" is_pre_election: true
I20260811 16:39:14.282442 12865 raft_consensus.cc:2454] T 4739501b00224fddb3ad8afb38085b5c P 1dc9186ffd234a348755fb483e9c1e97 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f15fd248a1a4fa9becb87c2e740685f in term 0.
I20260811 16:39:14.282829 12540 leader_election.cc:302] T 4739501b00224fddb3ad8afb38085b5c P 8f15fd248a1a4fa9becb87c2e740685f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dc9186ffd234a348755fb483e9c1e97, 8f15fd248a1a4fa9becb87c2e740685f; no voters:
I20260811 16:39:14.283110 13198 raft_consensus.cc:2781] T 4739501b00224fddb3ad8afb38085b5c P 8f15fd248a1a4fa9becb87c2e740685f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:39:14.283262 13198 raft_consensus.cc:482] T 4739501b00224fddb3ad8afb38085b5c P 8f15fd248a1a4fa9becb87c2e740685f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:39:14.283341 13198 raft_consensus.cc:3037] T 4739501b00224fddb3ad8afb38085b5c P 8f15fd248a1a4fa9becb87c2e740685f [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:39:14.284996 13198 raft_consensus.cc:504] T 4739501b00224fddb3ad8afb38085b5c P 8f15fd248a1a4fa9becb87c2e740685f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f15fd248a1a4fa9becb87c2e740685f" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 35337 } } peers { permanent_uuid: "1dc9186ffd234a348755fb483e9c1e97" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38043 } } peers { permanent_uuid: "d98cc1fbbe8247dd978e7ae13f01e70a" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42939 } }
I20260811 16:39:14.285339 12865 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4739501b00224fddb3ad8afb38085b5c" candidate_uuid: "8f15fd248a1a4fa9becb87c2e740685f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dc9186ffd234a348755fb483e9c1e97"
I20260811 16:39:14.285415 12865 raft_consensus.cc:3037] T 4739501b00224fddb3ad8afb38085b5c P 1dc9186ffd234a348755fb483e9c1e97 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:39:14.286875 12865 raft_consensus.cc:2454] T 4739501b00224fddb3ad8afb38085b5c P 1dc9186ffd234a348755fb483e9c1e97 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f15fd248a1a4fa9becb87c2e740685f in term 1.
I20260811 16:39:14.287125 12540 leader_election.cc:302] T 4739501b00224fddb3ad8afb38085b5c P 8f15fd248a1a4fa9becb87c2e740685f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dc9186ffd234a348755fb483e9c1e97, 8f15fd248a1a4fa9becb87c2e740685f; no voters:
I20260811 16:39:14.287256 13197 raft_consensus.cc:2781] T 4739501b00224fddb3ad8afb38085b5c P 8f15fd248a1a4fa9becb87c2e740685f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:39:14.287448 13197 raft_consensus.cc:686] T 4739501b00224fddb3ad8afb38085b5c P 8f15fd248a1a4fa9becb87c2e740685f [term 1 LEADER]: Becoming Leader. State: Replica: 8f15fd248a1a4fa9becb87c2e740685f, State: Running, Role: LEADER
I20260811 16:39:14.287627 13197 consensus_queue.cc:237] T 4739501b00224fddb3ad8afb38085b5c P 8f15fd248a1a4fa9becb87c2e740685f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f15fd248a1a4fa9becb87c2e740685f" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 35337 } } peers { permanent_uuid: "1dc9186ffd234a348755fb483e9c1e97" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38043 } } peers { permanent_uuid: "d98cc1fbbe8247dd978e7ae13f01e70a" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42939 } }
I20260811 16:39:14.288666 12387 catalog_manager.cc:5495] T 4739501b00224fddb3ad8afb38085b5c P 8f15fd248a1a4fa9becb87c2e740685f reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f15fd248a1a4fa9becb87c2e740685f (127.24.175.193). New cstate: current_term: 1 leader_uuid: "8f15fd248a1a4fa9becb87c2e740685f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f15fd248a1a4fa9becb87c2e740685f" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 35337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1dc9186ffd234a348755fb483e9c1e97" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d98cc1fbbe8247dd978e7ae13f01e70a" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42939 } health_report { overall_health: UNKNOWN } } }
I20260811 16:39:14.289877 13198 leader_election.cc:288] T 4739501b00224fddb3ad8afb38085b5c P 8f15fd248a1a4fa9becb87c2e740685f [CANDIDATE]: Term 1 election: Requested vote from peers 1dc9186ffd234a348755fb483e9c1e97 (127.24.175.194:38043), d98cc1fbbe8247dd978e7ae13f01e70a (127.24.175.195:42939)
I20260811 16:39:14.281812 13199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:39:14.269127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.195:42939 (local address 127.24.175.193:60703)
0811 16:39:14.272875 (+ 3748us) negotiation.cc:107] Waiting for socket to connect
0811 16:39:14.272885 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:39:14.272954 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:39:14.273133 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:39:14.273134 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:39:14.273136 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:39:14.273322 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:39:14.273324 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:39:14.276974 (+ 3650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:39:14.276975 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:39:14.278448 (+ 1473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:39:14.278451 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:39:14.280137 (+ 1686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:39:14.280138 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:39:14.280289 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:39:14.280294 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 16:39:14.281510 (+ 1216us) client_negotiation.cc:240] Negotiation successful
0811 16:39:14.281560 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3733,"thread_start_us":137,"threads_started":1}
I20260811 16:39:14.290583 13089 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4739501b00224fddb3ad8afb38085b5c" candidate_uuid: "8f15fd248a1a4fa9becb87c2e740685f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d98cc1fbbe8247dd978e7ae13f01e70a" is_pre_election: true
I20260811 16:39:14.290732 13089 raft_consensus.cc:2454] T 4739501b00224fddb3ad8afb38085b5c P d98cc1fbbe8247dd978e7ae13f01e70a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f15fd248a1a4fa9becb87c2e740685f in term 0.
I20260811 16:39:14.290891 13085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4739501b00224fddb3ad8afb38085b5c" candidate_uuid: "8f15fd248a1a4fa9becb87c2e740685f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d98cc1fbbe8247dd978e7ae13f01e70a"
I20260811 16:39:14.290994 13085 raft_consensus.cc:3037] T 4739501b00224fddb3ad8afb38085b5c P d98cc1fbbe8247dd978e7ae13f01e70a [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:39:14.292410 13085 raft_consensus.cc:2454] T 4739501b00224fddb3ad8afb38085b5c P d98cc1fbbe8247dd978e7ae13f01e70a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f15fd248a1a4fa9becb87c2e740685f in term 1.
I20260811 16:39:14.302091 13182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:39:14.298578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49530 (local address 127.24.175.193:35337)
0811 16:39:14.298618 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 16:39:14.298620 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:39:14.298631 (+ 11us) server_negotiation.cc:407] Connection header received
0811 16:39:14.298691 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:39:14.298692 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:39:14.298711 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:39:14.298786 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:39:14.298972 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:39:14.299716 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:39:14.300836 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:39:14.301137 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:39:14.301203 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:39:14.301408 (+ 205us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:39:14.301563 (+ 155us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:39:14.301648 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 16:39:14.301893 (+ 245us) server_negotiation.cc:299] Negotiation successful
0811 16:39:14.301916 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 16:39:14.306977 13085 raft_consensus.cc:1261] T 4739501b00224fddb3ad8afb38085b5c P d98cc1fbbe8247dd978e7ae13f01e70a [term 1 FOLLOWER]: Refusing update from remote peer 8f15fd248a1a4fa9becb87c2e740685f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:39:14.307431 13207 consensus_queue.cc:1035] T 4739501b00224fddb3ad8afb38085b5c P 8f15fd248a1a4fa9becb87c2e740685f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d98cc1fbbe8247dd978e7ae13f01e70a" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:39:14.309513 12865 raft_consensus.cc:1261] T 4739501b00224fddb3ad8afb38085b5c P 1dc9186ffd234a348755fb483e9c1e97 [term 1 FOLLOWER]: Refusing update from remote peer 8f15fd248a1a4fa9becb87c2e740685f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:39:14.309811 13207 consensus_queue.cc:1035] T 4739501b00224fddb3ad8afb38085b5c P 8f15fd248a1a4fa9becb87c2e740685f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dc9186ffd234a348755fb483e9c1e97" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 16:39:14.311017 12730 tablet.cc:2369] T 4739501b00224fddb3ad8afb38085b5c P 8f15fd248a1a4fa9becb87c2e740685f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:39:14.316743 13217 mvcc.cc:205] Tried to move back new op lower bound from 7317366187237650432 to 7317366187163250688. Current Snapshot: MvccSnapshot[applied={T|T < 7317366187237650432}]
I20260811 16:39:14.316642 13212 mvcc.cc:205] Tried to move back new op lower bound from 7317366187237650432 to 7317366187163250688. Current Snapshot: MvccSnapshot[applied={T|T < 7317366187237650432}]
I20260811 16:39:14.318753 13213 mvcc.cc:205] Tried to move back new op lower bound from 7317366187237650432 to 7317366187163250688. Current Snapshot: MvccSnapshot[applied={T|T < 7317366187237650432}]
I20260811 16:39:14.322068 12386 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59644:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:39:14.322201 12386 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59644:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:39:14.322983 12386 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 37451e0f3a33477b8a2d49e9f1bf156a: Sending DeleteTablet for 3 replicas of tablet 4739501b00224fddb3ad8afb38085b5c
I20260811 16:39:14.323402 12815 tablet_service.cc:1514] Processing DeleteTablet for tablet 4739501b00224fddb3ad8afb38085b5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:39:14 UTC) from {username='kudu', principal='kudu/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:42196
I20260811 16:39:14.323634 13055 tablet_service.cc:1514] Processing DeleteTablet for tablet 4739501b00224fddb3ad8afb38085b5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:39:14 UTC) from {username='kudu', principal='kudu/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:37832
I20260811 16:39:14.323968 12630 tablet_service.cc:1514] Processing DeleteTablet for tablet 4739501b00224fddb3ad8afb38085b5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:39:14 UTC) from {username='kudu', principal='kudu/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:49518
I20260811 16:39:14.324656 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 12515
I20260811 16:39:14.330129 13225 tablet_replica.cc:330] T 4739501b00224fddb3ad8afb38085b5c P 1dc9186ffd234a348755fb483e9c1e97: stopping tablet replica
I20260811 16:39:14.330263 13225 raft_consensus.cc:2229] T 4739501b00224fddb3ad8afb38085b5c P 1dc9186ffd234a348755fb483e9c1e97 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:39:14.330374 13225 raft_consensus.cc:2258] T 4739501b00224fddb3ad8afb38085b5c P 1dc9186ffd234a348755fb483e9c1e97 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:39:14.333725 13225 ts_tablet_manager.cc:1905] T 4739501b00224fddb3ad8afb38085b5c P 1dc9186ffd234a348755fb483e9c1e97: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:39:14.335244 13227 tablet_replica.cc:330] T 4739501b00224fddb3ad8afb38085b5c P d98cc1fbbe8247dd978e7ae13f01e70a: stopping tablet replica
I20260811 16:39:14.335386 13227 raft_consensus.cc:2229] T 4739501b00224fddb3ad8afb38085b5c P d98cc1fbbe8247dd978e7ae13f01e70a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:39:14.335505 13227 raft_consensus.cc:2258] T 4739501b00224fddb3ad8afb38085b5c P d98cc1fbbe8247dd978e7ae13f01e70a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:39:14.336078 13225 ts_tablet_manager.cc:1918] T 4739501b00224fddb3ad8afb38085b5c P 1dc9186ffd234a348755fb483e9c1e97: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:39:14.336192 13225 log.cc:1196] T 4739501b00224fddb3ad8afb38085b5c P 1dc9186ffd234a348755fb483e9c1e97: Deleting WAL directory at /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ts-1/wal/wals/4739501b00224fddb3ad8afb38085b5c
I20260811 16:39:14.336513 13225 ts_tablet_manager.cc:1939] T 4739501b00224fddb3ad8afb38085b5c P 1dc9186ffd234a348755fb483e9c1e97: Deleting consensus metadata
I20260811 16:39:14.337574 12350 catalog_manager.cc:4841] TS 1dc9186ffd234a348755fb483e9c1e97 (127.24.175.194:38043): tablet 4739501b00224fddb3ad8afb38085b5c (table test-table [id=76801fbef7dc4f92b56c4b9ba3cc5c02]) successfully deleted
I20260811 16:39:14.340173 13227 ts_tablet_manager.cc:1905] T 4739501b00224fddb3ad8afb38085b5c P d98cc1fbbe8247dd978e7ae13f01e70a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:39:14.341822 13227 ts_tablet_manager.cc:1918] T 4739501b00224fddb3ad8afb38085b5c P d98cc1fbbe8247dd978e7ae13f01e70a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:39:14.341974 13227 log.cc:1196] T 4739501b00224fddb3ad8afb38085b5c P d98cc1fbbe8247dd978e7ae13f01e70a: Deleting WAL directory at /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466249441839-25279-0/minicluster-data/ts-2/wal/wals/4739501b00224fddb3ad8afb38085b5c
I20260811 16:39:14.342686 13227 ts_tablet_manager.cc:1939] T 4739501b00224fddb3ad8afb38085b5c P d98cc1fbbe8247dd978e7ae13f01e70a: Deleting consensus metadata
I20260811 16:39:14.343170 12350 catalog_manager.cc:4841] TS d98cc1fbbe8247dd978e7ae13f01e70a (127.24.175.195:42939): tablet 4739501b00224fddb3ad8afb38085b5c (table test-table [id=76801fbef7dc4f92b56c4b9ba3cc5c02]) successfully deleted
W20260811 16:39:14.345079 12352 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.24.175.193:35337 (error 108)
I20260811 16:39:14.345434 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 12736
I20260811 16:39:14.356829 13177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:39:14.356693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.193:35337 (local address 127.0.0.1:49540)
0811 16:39:14.356747 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0811 16:39:14.356787 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.193:35337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260811 16:39:14.356978 12352 catalog_manager.cc:4584] TS 8f15fd248a1a4fa9becb87c2e740685f (127.24.175.193:35337): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4739501b00224fddb3ad8afb38085b5c: Network error: Client connection negotiation failed: client connection to 127.24.175.193:35337: connect: Connection refused (error 111)
I20260811 16:39:14.360926 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 12961
I20260811 16:39:14.370692 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 12316
I20260811 16:39:14.385450 25279 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260811 16:39:14.731062 25279 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260811 16:39:14.731179 25279 mini_ranger.cc:66] Stopping Ranger...
I20260811 16:39:15.074792 25279 mini_ranger.cc:68] Stopped Ranger
2026-08-11 16:39:15.074 UTC [11611] LOG: received smart shutdown request
2026-08-11 16:39:15.078 UTC [11611] LOG: background worker "logical replication launcher" (PID 11626) exited with exit code 1
2026-08-11 16:39:15.078 UTC [11618] LOG: shutting down
2026-08-11 16:39:15.206 UTC [11611] LOG: database system is shut down
2026-08-11T16:39:15Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (45593 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:39:15 dist-test-slave-zj8q krb5kdc[13243](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:39:15 dist-test-slave-zj8q krb5kdc[13243](info): set up 2 sockets
Aug 11 16:39:15 dist-test-slave-zj8q krb5kdc[13243](info): commencing operation
krb5kdc: starting...
W20260811 16:39:16.486088 25279 mini_kdc.cc:121] Time spent starting KDC: real 1.168s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Aug 11 16:39:16 dist-test-slave-zj8q krb5kdc[13243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466356, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:39:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:39:16Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.24.175.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.24.175.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.24.175.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/krb5kdc/rangeradmin_127.24.175.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.24.175.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/krb5kdc/rangeradmin_127.24.175.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.24.175.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.24.175.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.24.175.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/krb5kdc/rangerlookup_127.24.175.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.24.175.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/krb5kdc/rangerlookup_127.24.175.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.24.175.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.24.175.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.24.175.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/krb5kdc/HTTP_127.24.175.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.24.175.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/krb5kdc/HTTP_127.24.175.212@KRBTEST.COM.keytab.
I20260811 16:39:16.638361 25279 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskkGJqOS/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/postgres -l logfile start
2026-08-11 16:39:18.795 UTC [13298] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-11 16:39:18.795 UTC [13298] LOG: listening on IPv4 address "127.24.175.212", port 36143
2026-08-11 16:39:18.797 UTC [13298] LOG: listening on Unix socket "/tmp/.s.PGSQL.36143"
2026-08-11 16:39:18.824 UTC [13307] LOG: database system was shut down at 2026-08-11 16:39:17 UTC
2026-08-11 16:39:18.828 UTC [13298] LOG: database system is ready to accept connections
I20260811 16:39:19.909485 25279 mini_postgres.cc:96] Postgres bound to 36143
2026-08-11 16:39:19.916 UTC [13318] FATAL: database "slave" does not exist
127.24.175.212:36143 - accepting connections
I20260811 16:39:19.916535 25279 mini_ranger.cc:161] Starting Ranger...
I20260811 16:39:19.930554 25279 mini_ranger.cc:84] Created miniranger Postgres user
I20260811 16:39:20.341579 25279 mini_ranger.cc:87] Created ranger Postgres database
I20260811 16:39:20.341648 25279 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ranger-admin
2026-08-11 16:39:20,620 [I] DB FLAVOR :POSTGRES
2026-08-11 16:39:20,621 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 16:39:20,621 [I] Checking connection..
2026-08-11 16:39:20,621 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkGJqOS/build/release/bin/postgresql.jar:/tmp/dist-test-taskkGJqOS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.175.212:36143/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-11 16:39:20,872 [I] Checking connection passed.
2026-08-11 16:39:20,872 [I] --------- Verifying version history table ---------
2026-08-11 16:39:20,872 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkGJqOS/build/release/bin/postgresql.jar:/tmp/dist-test-taskkGJqOS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.175.212:36143/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 16:39:21,122 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 16:39:21,123 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkGJqOS/build/release/bin/postgresql.jar:/tmp/dist-test-taskkGJqOS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.175.212:36143/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 16:39:21,380 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 16:39:21,381 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-11 16:39:21,381 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkGJqOS/build/release/bin/postgresql.jar:/tmp/dist-test-taskkGJqOS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.175.212:36143/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskkGJqOS/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-11 16:39:21.627 UTC [13424] WARNING: there is no transaction in progress
2026-08-11 16:39:21,635 [I] create_dbversion_catalog.sql file imported successfully
2026-08-11 16:39:21,635 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkGJqOS/build/release/bin/postgresql.jar:/tmp/dist-test-taskkGJqOS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.175.212:36143/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 16:39:21,893 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-11 16:39:21,893 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 16:39:21,893 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkGJqOS/build/release/bin/postgresql.jar:/tmp/dist-test-taskkGJqOS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.175.212:36143/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-11 16:39:22,123 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkGJqOS/build/release/bin/postgresql.jar:/tmp/dist-test-taskkGJqOS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.175.212:36143/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-11 16:39:22,365 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkGJqOS/build/release/bin/postgresql.jar:/tmp/dist-test-taskkGJqOS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.175.212:36143/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-zj8q.c.gcp-upstream.internal','N') ;"
2026-08-11 16:39:22,596 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkGJqOS/build/release/bin/postgresql.jar:/tmp/dist-test-taskkGJqOS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.175.212:36143/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 16:39:22,833 [I] Table x_portal_user does not exist in database ranger
2026-08-11 16:39:22,833 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkGJqOS/build/release/bin/postgresql.jar:/tmp/dist-test-taskkGJqOS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.175.212:36143/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 16:39:23,083 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-11 16:39:23,083 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkGJqOS/build/release/bin/postgresql.jar:/tmp/dist-test-taskkGJqOS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.175.212:36143/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 16:39:23,332 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkGJqOS/build/release/bin/postgresql.jar:/tmp/dist-test-taskkGJqOS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.175.212:36143/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 16:39:23,584 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-11 16:39:23,584 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkGJqOS/build/release/bin/postgresql.jar:/tmp/dist-test-taskkGJqOS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.175.212:36143/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskkGJqOS/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-11 16:39:24.471 UTC [13595] WARNING: there is no transaction in progress
2026-08-11 16:39:24.485 UTC [13595] WARNING: there is no transaction in progress
2026-08-11 16:39:24.499 UTC [13595] WARNING: there is no transaction in progress
2026-08-11 16:39:24.513 UTC [13595] WARNING: there is no transaction in progress
2026-08-11 16:39:24.526 UTC [13595] WARNING: there is no transaction in progress
2026-08-11 16:39:24.541 UTC [13595] WARNING: there is no transaction in progress
2026-08-11 16:39:24.589 UTC [13595] WARNING: there is no transaction in progress
2026-08-11 16:39:24.595 UTC [13595] WARNING: there is no transaction in progress
2026-08-11 16:39:24.608 UTC [13595] WARNING: there is no transaction in progress
2026-08-11 16:39:24.617 UTC [13595] WARNING: there is no transaction in progress
2026-08-11 16:39:24.625 UTC [13595] WARNING: there is no transaction in progress
2026-08-11 16:39:24.637 UTC [13595] WARNING: there is no transaction in progress
2026-08-11 16:39:24.646 UTC [13595] WARNING: there is no transaction in progress
2026-08-11 16:39:24.652 UTC [13595] WARNING: there is no transaction in progress
2026-08-11 16:39:24.657 UTC [13595] WARNING: there is no transaction in progress
2026-08-11 16:39:24.663 UTC [13595] WARNING: there is no transaction in progress
2026-08-11 16:39:25,185 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-11 16:39:25,186 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkGJqOS/build/release/bin/postgresql.jar:/tmp/dist-test-taskkGJqOS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.175.212:36143/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-11 16:39:25,437 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-11 16:39:25,437 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkGJqOS/build/release/bin/postgresql.jar:/tmp/dist-test-taskkGJqOS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.175.212:36143/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 16:39:25,690 [I] Table x_portal_user already exists in database 'ranger'
2026-08-11 16:39:25,691 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkGJqOS/build/release/bin/postgresql.jar:/tmp/dist-test-taskkGJqOS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.175.212:36143/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 16:39:25,949 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-11 16:39:25,949 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkGJqOS/build/release/bin/postgresql.jar:/tmp/dist-test-taskkGJqOS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.175.212:36143/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 16:39:26,191 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkGJqOS/build/release/bin/postgresql.jar:/tmp/dist-test-taskkGJqOS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.175.212:36143/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 16:39:26,443 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkGJqOS/build/release/bin/postgresql.jar:/tmp/dist-test-taskkGJqOS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.175.212:36143/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-zj8q.c.gcp-upstream.internal';"
2026-08-11 16:39:26,691 [I] CORE_DB_SCHEMA import status has been updated
2026-08-11 16:39:26,692 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkGJqOS/build/release/bin/postgresql.jar:/tmp/dist-test-taskkGJqOS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.175.212:36143/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-11 16:39:26,932 [I] DB_PATCHES have already been applied
I20260811 16:39:26.937829 25279 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ranger-admin:/tmp/dist-test-taskkGJqOS/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskkGJqOS/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskkGJqOS/build/release/bin/postgresql.jar:/tmp/dist-test-taskkGJqOS/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260811 16:39:26.937893 25279 mini_ranger.cc:193] Using host: 127.24.175.212
I20260811 16:39:26.941658 25279 mini_ranger.cc:227] Ranger admin URL: http://127.24.175.212:46335
Aug 11, 2026 4:39:27 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 4:39:27 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 4:39:27 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ranger-admin/ews/webapp
Aug 11, 2026 4:39:27 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 11, 2026 4:39:27 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 11, 2026 4:39:27 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ranger-admin/ews/webapp].
Aug 11, 2026 4:39:27 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260811 16:39:28.156687 25279 mini_ranger.cc:160] Time spent starting Ranger: real 8.240s user 0.002s sys 0.008s
Aug 11, 2026 4:39:47 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 11, 2026 4:39:47 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 11, 2026 4:39:47 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 11, 2026 4:39:47 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 11, 2026 4:39:47 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 11, 2026 4:39:47 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 11, 2026 4:39:47 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 11, 2026 4:39:47 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 11, 2026 4:39:47 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 11, 2026 4:39:47 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 11, 2026 4:39:47 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 11, 2026 4:39:47 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 11, 2026 4:39:47 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 11, 2026 4:39:47 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 11, 2026 4:39:47 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 11, 2026 4:39:47 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 11, 2026 4:39:47 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 11, 2026 4:39:48 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260811 16:39:49.350472 25279 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.24.175.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.24.175.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.24.175.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/krb5kdc/rangerkms_127.24.175.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.24.175.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/krb5kdc/rangerkms_127.24.175.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.24.175.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.24.175.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.24.175.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/krb5kdc/HTTP_127.24.175.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.24.175.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/krb5kdc/HTTP_127.24.175.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 11 16:39:49 dist-test-slave-zj8q krb5kdc[13243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466389, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260811 16:39:49.442739 25279 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260811 16:39:49.452409 25279 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260811 16:39:50.177876 25279 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260811 16:39:50.177945 25279 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ranger-kms
I20260811 16:39:50.177963 25279 mini_ranger_kms.cc:227] Using postgres at 127.24.175.212:36143
2026-08-11 16:39:50,339 [I] DB FLAVOR :POSTGRES
2026-08-11 16:39:50,339 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 16:39:50,339 [I] Checking connection
2026-08-11 16:39:50,339 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkGJqOS/build/release/bin/postgresql.jar:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.175.212:36143/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-11 16:39:50,568 [I] connection success
2026-08-11 16:39:50,568 [I] --------- Verifying Ranger DB tables ---------
2026-08-11 16:39:50,568 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-11 16:39:50,568 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkGJqOS/build/release/bin/postgresql.jar:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.175.212:36143/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-11 16:39:50,804 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-11 16:39:50,804 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 16:39:50,804 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-11 16:39:50,804 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkGJqOS/build/release/bin/postgresql.jar:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.175.212:36143/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-11 16:39:51,069 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260811 16:39:51.495138 25279 mini_ranger_kms.cc:310] Created kms service
I20260811 16:39:51.707561 25279 mini_ranger_kms.cc:326] Created kudu user
I20260811 16:39:51.747960 25279 mini_ranger_kms.cc:343] Created rangerkms user
Aug 11 16:39:51 dist-test-slave-zj8q krb5kdc[13243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466389, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.24.175.212@KRBTEST.COM
I20260811 16:39:52.134567 25279 mini_ranger_kms.cc:384] Added ranger policy
I20260811 16:39:52.134685 25279 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ranger-kms:/tmp/dist-test-taskkGJqOS/build/release/bin/postgresql.jar:/tmp/dist-test-taskkGJqOS/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskkGJqOS/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260811 16:39:52.134702 25279 mini_ranger_kms.cc:240] Using host: 127.24.175.212
I20260811 16:39:52.139185 25279 mini_ranger_kms.cc:276] Ranger KMS PID: 13917
I20260811 16:39:52.139276 25279 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.24.175.212:32985
Aug 11, 2026 4:39:53 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 4:39:53 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 4:39:53 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 11, 2026 4:39:53 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 11, 2026 4:39:53 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ranger-kms/ews/webapp].
Aug 11, 2026 4:39:53 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 11 16:39:54 dist-test-slave-zj8q krb5kdc[13243](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786466394, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.24.175.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:39:54.633049 25279 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.190s user 0.003s sys 0.141s
I20260811 16:39:54.633143 25279 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260811 16:39:54.633190 25279 mini_ranger_kms.cc:401] 127.24.175.212:32985/kms/v1/keys
Aug 11 16:39:54 dist-test-slave-zj8q krb5kdc[13243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466394, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.24.175.212@KRBTEST.COM for HTTP/127.24.175.212@KRBTEST.COM
Aug 11 16:39:55 dist-test-slave-zj8q krb5kdc[13243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466394, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.24.175.212@KRBTEST.COM for HTTP/127.24.175.212@KRBTEST.COM
Aug 11 16:39:57 dist-test-slave-zj8q krb5kdc[13243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466397, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.24.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab.
Entry for principal kudu/127.24.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab.
I20260811 16:39:57.406874 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:39683
--webserver_interface=127.24.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:39909
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.175.254:39683
--ranger_config_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.24.175.212:32985/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:39:57.488055 14004 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:39:57.488245 14004 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:39:57.488265 14004 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:39:57.489387 14004 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:39:57.489426 14004 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:39:57.489439 14004 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:39:57.489451 14004 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:39:57.489461 14004 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:39:57.491019 14004 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:39909
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/master-0/wal
--ranger_kms_url=127.24.175.212:32985/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.24.175.254:39683
--ranger_config_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:39683
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14004
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:39:57.491243 14004 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:39:57.491447 14004 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:39:57.496256 14016 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:39:57.496258 14019 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:39:57.496304 14017 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:39:57.497149 14004 server_base.cc:1034] running on GCE node
I20260811 16:39:57.497372 14004 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:39:57.497622 14004 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:39:57.498764 14004 hybrid_clock.cc:648] HybridClock initialized: now 1786466397498744 us; error 38 us; skew 500 ppm
Aug 11 16:39:57 dist-test-slave-zj8q krb5kdc[13243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466397, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:39:57.503813 14004 init.cc:377] Logged in from keytab as kudu/127.24.175.254@KRBTEST.COM (short username kudu)
I20260811 16:39:57.504225 14004 webserver.cc:460] Webserver started at http://127.24.175.254:37853/ using document root <none> and password file <none>
I20260811 16:39:57.504415 14004 fs_manager.cc:359] Metadata directory not provided
I20260811 16:39:57.504451 14004 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:39:57.504558 14004 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 16:39:57 dist-test-slave-zj8q krb5kdc[13243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466397, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.254@KRBTEST.COM for HTTP/127.24.175.212@KRBTEST.COM
I20260811 16:39:57.553311 14004 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/master-0/data/instance:
uuid: "4976c8c8cdc543fab0c5c64928e15d90"
format_stamp: "Formatted at 2026-08-11 16:39:57 on dist-test-slave-zj8q"
server_key: "1a82d3d21f302a26e16664831053a988"
server_key_iv: "73b29b8728bf03eb5085a26294a3d701"
server_key_version: "kuduclusterkey@0"
I20260811 16:39:57.553785 14004 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/master-0/wal/instance:
uuid: "4976c8c8cdc543fab0c5c64928e15d90"
format_stamp: "Formatted at 2026-08-11 16:39:57 on dist-test-slave-zj8q"
server_key: "1a82d3d21f302a26e16664831053a988"
server_key_iv: "73b29b8728bf03eb5085a26294a3d701"
server_key_version: "kuduclusterkey@0"
I20260811 16:39:57.555627 14004 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260811 16:39:57.569213 14034 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:39:57.569473 14004 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:39:57.569578 14004 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/master-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/master-0/wal
uuid: "4976c8c8cdc543fab0c5c64928e15d90"
format_stamp: "Formatted at 2026-08-11 16:39:57 on dist-test-slave-zj8q"
server_key: "1a82d3d21f302a26e16664831053a988"
server_key_iv: "73b29b8728bf03eb5085a26294a3d701"
server_key_version: "kuduclusterkey@0"
I20260811 16:39:57.569679 14004 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:39:57.593807 14004 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:39:57.595877 14004 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:39:57.596051 14004 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:39:57.601159 14004 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.254:39683
I20260811 16:39:57.601192 14128 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.254:39683 every 8 connection(s)
I20260811 16:39:57.601614 14004 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
I20260811 16:39:57.602447 14129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:39:57.602478 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 14004
I20260811 16:39:57.602572 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/master-0/wal/instance
I20260811 16:39:57.602787 25279 external_mini_cluster.cc:1428] Setting key 30a8f9f8351a000ccb4c4ea93a7983a2
I20260811 16:39:57.605983 14129 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4976c8c8cdc543fab0c5c64928e15d90: Bootstrap starting.
I20260811 16:39:57.606659 14129 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4976c8c8cdc543fab0c5c64928e15d90: Neither blocks nor log segments found. Creating new log.
I20260811 16:39:57.606943 14129 log.cc:824] T 00000000000000000000000000000000 P 4976c8c8cdc543fab0c5c64928e15d90: Log is configured to *not* fsync() on all Append() calls
I20260811 16:39:57.607744 14129 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4976c8c8cdc543fab0c5c64928e15d90: No bootstrap required, opened a new log
Aug 11 16:39:57 dist-test-slave-zj8q krb5kdc[13243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466397, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:39:57.610843 14129 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4976c8c8cdc543fab0c5c64928e15d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4976c8c8cdc543fab0c5c64928e15d90" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 39683 } }
I20260811 16:39:57.610978 14129 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4976c8c8cdc543fab0c5c64928e15d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:39:57.611011 14129 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4976c8c8cdc543fab0c5c64928e15d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4976c8c8cdc543fab0c5c64928e15d90, State: Initialized, Role: FOLLOWER
I20260811 16:39:57.611147 14129 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4976c8c8cdc543fab0c5c64928e15d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4976c8c8cdc543fab0c5c64928e15d90" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 39683 } }
I20260811 16:39:57.611223 14129 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4976c8c8cdc543fab0c5c64928e15d90 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:39:57.611284 14129 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4976c8c8cdc543fab0c5c64928e15d90 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:39:57.611339 14129 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4976c8c8cdc543fab0c5c64928e15d90 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:39:57.611918 14129 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4976c8c8cdc543fab0c5c64928e15d90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4976c8c8cdc543fab0c5c64928e15d90" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 39683 } }
I20260811 16:39:57.612020 14129 leader_election.cc:302] T 00000000000000000000000000000000 P 4976c8c8cdc543fab0c5c64928e15d90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4976c8c8cdc543fab0c5c64928e15d90; no voters:
I20260811 16:39:57.612188 14129 leader_election.cc:288] T 00000000000000000000000000000000 P 4976c8c8cdc543fab0c5c64928e15d90 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:39:57.612252 14143 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4976c8c8cdc543fab0c5c64928e15d90 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:39:57.612457 14129 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4976c8c8cdc543fab0c5c64928e15d90 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:39:57.612830 14143 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4976c8c8cdc543fab0c5c64928e15d90 [term 1 LEADER]: Becoming Leader. State: Replica: 4976c8c8cdc543fab0c5c64928e15d90, State: Running, Role: LEADER
I20260811 16:39:57.613003 14143 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4976c8c8cdc543fab0c5c64928e15d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4976c8c8cdc543fab0c5c64928e15d90" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 39683 } }
I20260811 16:39:57.614252 14144 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4976c8c8cdc543fab0c5c64928e15d90 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4976c8c8cdc543fab0c5c64928e15d90" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4976c8c8cdc543fab0c5c64928e15d90" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 39683 } } }
I20260811 16:39:57.614310 14129 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 16:39:57.614341 14144 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4976c8c8cdc543fab0c5c64928e15d90 [sys.catalog]: This master's current role is: LEADER
I20260811 16:39:57.614467 14144 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4976c8c8cdc543fab0c5c64928e15d90 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4976c8c8cdc543fab0c5c64928e15d90. Latest consensus state: current_term: 1 leader_uuid: "4976c8c8cdc543fab0c5c64928e15d90" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4976c8c8cdc543fab0c5c64928e15d90" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 39683 } } }
I20260811 16:39:57.614508 14144 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4976c8c8cdc543fab0c5c64928e15d90 [sys.catalog]: This master's current role is: LEADER
I20260811 16:39:57.616667 14163 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:39:57.617340 14135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:39:57.603328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44410 (local address 127.24.175.254:39683)
0811 16:39:57.603517 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0811 16:39:57.603527 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 16:39:57.603564 (+ 37us) server_negotiation.cc:407] Connection header received
0811 16:39:57.604355 (+ 791us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:39:57.604366 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:39:57.604434 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:39:57.604591 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:39:57.605362 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:39:57.606847 (+ 1485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:39:57.607746 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:39:57.608386 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:39:57.608496 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:39:57.611169 (+ 2673us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:39:57.611173 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:39:57.611174 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:39:57.611186 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:39:57.613225 (+ 2039us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:39:57.613604 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:39:57.613607 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:39:57.613607 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:39:57.613706 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:39:57.613920 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:39:57.613921 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:39:57.613921 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:39:57.614260 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:39:57.614428 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0811 16:39:57.616378 (+ 1950us) server_negotiation.cc:299] Negotiation successful
0811 16:39:57.617029 (+ 651us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":77,"threads_started":1}
I20260811 16:39:57.617856 14163 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:39:57.620266 14163 catalog_manager.cc:1347] Generated new cluster ID: fdd85376da844d7c9520d8f7499eddf5
I20260811 16:39:57.620317 14163 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:39:57.636642 14163 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:39:57.637449 14163 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:39:57.639999 14163 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4976c8c8cdc543fab0c5c64928e15d90: Generated new TSK 0
I20260811 16:39:57.640206 14163 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.175.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab.
Entry for principal kudu/127.24.175.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab.
I20260811 16:39:58.343081 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.24.175.212:32985/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.193:0
--local_ip_for_outbound_sockets=127.24.175.193
--webserver_interface=127.24.175.193
--webserver_port=0
--tserver_master_addrs=127.24.175.254:39683
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab
--principal=kudu/127.24.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:39909
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:39:58.456158 14209 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:39:58.456348 14209 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:39:58.456372 14209 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:39:58.457577 14209 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:39:58.457628 14209 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:39:58.457662 14209 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.193
I20260811 16:39:58.459203 14209 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:39909
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.24.175.212:32985/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab
--principal=kudu/127.24.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.175.193
--webserver_port=0
--tserver_master_addrs=127.24.175.254:39683
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14209
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.193
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:39:58.459424 14209 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:39:58.459656 14209 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:39:58.465592 14225 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:39:58.465610 14220 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:39:58.465874 14221 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:39:58.466109 14209 server_base.cc:1034] running on GCE node
I20260811 16:39:58.466312 14209 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:39:58.466531 14209 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:39:58.467708 14209 hybrid_clock.cc:648] HybridClock initialized: now 1786466398467696 us; error 25 us; skew 500 ppm
Aug 11 16:39:58 dist-test-slave-zj8q krb5kdc[13243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466398, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:39:58.470300 14209 init.cc:377] Logged in from keytab as kudu/127.24.175.193@KRBTEST.COM (short username kudu)
I20260811 16:39:58.470690 14209 webserver.cc:460] Webserver started at http://127.24.175.193:43425/ using document root <none> and password file <none>
I20260811 16:39:58.470896 14209 fs_manager.cc:359] Metadata directory not provided
I20260811 16:39:58.470943 14209 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:39:58.471077 14209 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 16:39:58 dist-test-slave-zj8q krb5kdc[13243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466398, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.193@KRBTEST.COM for HTTP/127.24.175.212@KRBTEST.COM
I20260811 16:39:58.483417 14209 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-0/data/instance:
uuid: "f0d61129793b4a4db94ca6ca70a7f400"
format_stamp: "Formatted at 2026-08-11 16:39:58 on dist-test-slave-zj8q"
server_key: "3b84f13af9795876e61da3fc8d0a2d51"
server_key_iv: "9a804277de45b18c775bb6181b0fc1f3"
server_key_version: "kuduclusterkey@0"
I20260811 16:39:58.483927 14209 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-0/wal/instance:
uuid: "f0d61129793b4a4db94ca6ca70a7f400"
format_stamp: "Formatted at 2026-08-11 16:39:58 on dist-test-slave-zj8q"
server_key: "3b84f13af9795876e61da3fc8d0a2d51"
server_key_iv: "9a804277de45b18c775bb6181b0fc1f3"
server_key_version: "kuduclusterkey@0"
I20260811 16:39:58.486529 14209 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.000s
I20260811 16:39:58.502894 14239 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:39:58.503686 14209 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 16:39:58.503813 14209 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-0/wal
uuid: "f0d61129793b4a4db94ca6ca70a7f400"
format_stamp: "Formatted at 2026-08-11 16:39:58 on dist-test-slave-zj8q"
server_key: "3b84f13af9795876e61da3fc8d0a2d51"
server_key_iv: "9a804277de45b18c775bb6181b0fc1f3"
server_key_version: "kuduclusterkey@0"
I20260811 16:39:58.503913 14209 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:39:58.526479 14209 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:39:58.529043 14209 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:39:58.529253 14209 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:39:58.529556 14209 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:39:58.529986 14209 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:39:58.530076 14209 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:39:58.530195 14209 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:39:58.530274 14209 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:39:58.536686 14209 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.193:45969
I20260811 16:39:58.537173 14209 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
I20260811 16:39:58.539640 14416 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.193:45969 every 8 connection(s)
I20260811 16:39:58.541960 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 14209
I20260811 16:39:58.542065 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-0/wal/instance
I20260811 16:39:58.542271 25279 external_mini_cluster.cc:1428] Setting key 11aedb10d353725ccc3789d6a720077b
Aug 11 16:39:58 dist-test-slave-zj8q krb5kdc[13243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466398, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.193@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:39:58.552254 14421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:39:58.540344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:35963 (local address 127.24.175.254:39683)
0811 16:39:58.540606 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0811 16:39:58.540608 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:39:58.540621 (+ 13us) server_negotiation.cc:407] Connection header received
0811 16:39:58.541246 (+ 625us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:39:58.541248 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:39:58.541263 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:39:58.541358 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:39:58.542053 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:39:58.543179 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:39:58.544684 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:39:58.544989 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:39:58.545056 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:39:58.547644 (+ 2588us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:39:58.547645 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:39:58.547646 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:39:58.547654 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:39:58.549459 (+ 1805us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:39:58.550627 (+ 1168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:39:58.550628 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:39:58.550629 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:39:58.550698 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:39:58.550955 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:39:58.550956 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:39:58.550956 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:39:58.551106 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:39:58.551169 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 16:39:58.551977 (+ 808us) server_negotiation.cc:299] Negotiation successful
0811 16:39:58.552103 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":231,"thread_start_us":85,"threads_started":1}
I20260811 16:39:58.552717 14419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:39:58.540193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:39683 (local address 127.24.175.193:35963)
0811 16:39:58.540437 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0811 16:39:58.540485 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 16:39:58.541134 (+ 649us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:39:58.541426 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:39:58.541430 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:39:58.541676 (+ 246us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:39:58.541943 (+ 267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:39:58.541949 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:39:58.543286 (+ 1337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:39:58.543288 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:39:58.544573 (+ 1285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:39:58.544576 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:39:58.545140 (+ 564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:39:58.545142 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:39:58.545283 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:39:58.545875 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:39:58.545885 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:39:58.547524 (+ 1639us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:39:58.550218 (+ 2694us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:39:58.550225 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:39:58.550228 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:39:58.550532 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:39:58.550764 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:39:58.550764 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:39:58.550765 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:39:58.550888 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:39:58.551196 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:39:58.551202 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:39:58.551361 (+ 159us) client_negotiation.cc:769] Sending connection context
0811 16:39:58.551467 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 16:39:58.551625 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":84,"threads_started":1}
I20260811 16:39:58.553503 14417 heartbeater.cc:347] Connected to a master server at 127.24.175.254:39683
I20260811 16:39:58.553622 14417 heartbeater.cc:464] Registering TS with master...
I20260811 16:39:58.553824 14417 heartbeater.cc:511] Master 127.24.175.254:39683 requested a full tablet report, sending...
I20260811 16:39:58.554414 14065 ts_manager.cc:194] Registered new tserver with Master: f0d61129793b4a4db94ca6ca70a7f400 (127.24.175.193:45969)
I20260811 16:39:58.555313 14065 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.175.193@KRBTEST.COM'} at 127.24.175.193:35963
WARNING: no policy specified for kudu/127.24.175.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab.
Entry for principal kudu/127.24.175.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab.
I20260811 16:39:58.610145 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.24.175.212:32985/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.194:0
--local_ip_for_outbound_sockets=127.24.175.194
--webserver_interface=127.24.175.194
--webserver_port=0
--tserver_master_addrs=127.24.175.254:39683
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab
--principal=kudu/127.24.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:39909
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 16:39:58 dist-test-slave-zj8q krb5kdc[13243](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786466398, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260811 16:39:58.733376 14432 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:39:58.733762 14432 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:39:58.733847 14432 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:39:58.735530 14432 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:39:58.735648 14432 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:39:58.735726 14432 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.194
I20260811 16:39:58.737991 14432 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:39909
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.24.175.212:32985/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab
--principal=kudu/127.24.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.175.194
--webserver_port=0
--tserver_master_addrs=127.24.175.254:39683
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14432
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.194
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:39:58.738458 14432 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:39:58.738811 14432 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:39:58.745352 14448 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:39:58.745666 14444 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:39:58.745364 14443 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:39:58.746820 14432 server_base.cc:1034] running on GCE node
I20260811 16:39:58.747124 14432 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:39:58.747402 14432 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:39:58.748577 14432 hybrid_clock.cc:648] HybridClock initialized: now 1786466398748554 us; error 38 us; skew 500 ppm
Aug 11 16:39:58 dist-test-slave-zj8q krb5kdc[13243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466398, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:39:58.751940 14432 init.cc:377] Logged in from keytab as kudu/127.24.175.194@KRBTEST.COM (short username kudu)
I20260811 16:39:58.752467 14432 webserver.cc:460] Webserver started at http://127.24.175.194:35719/ using document root <none> and password file <none>
I20260811 16:39:58.752753 14432 fs_manager.cc:359] Metadata directory not provided
I20260811 16:39:58.752811 14432 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:39:58.752939 14432 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 16:39:58 dist-test-slave-zj8q krb5kdc[13243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466398, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.194@KRBTEST.COM for HTTP/127.24.175.212@KRBTEST.COM
I20260811 16:39:58.767211 14432 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-1/data/instance:
uuid: "8255d43e28824a80bf7ffb7ad8d593a9"
format_stamp: "Formatted at 2026-08-11 16:39:58 on dist-test-slave-zj8q"
server_key: "99739d16ac4600d48bc4c6d324830ac2"
server_key_iv: "d217feb9c67dea052081caacb70fef51"
server_key_version: "kuduclusterkey@0"
I20260811 16:39:58.767624 14432 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-1/wal/instance:
uuid: "8255d43e28824a80bf7ffb7ad8d593a9"
format_stamp: "Formatted at 2026-08-11 16:39:58 on dist-test-slave-zj8q"
server_key: "99739d16ac4600d48bc4c6d324830ac2"
server_key_iv: "d217feb9c67dea052081caacb70fef51"
server_key_version: "kuduclusterkey@0"
I20260811 16:39:58.769251 14432 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 16:39:58.781960 14461 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:39:58.786279 14432 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.001s sys 0.000s
I20260811 16:39:58.786474 14432 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-1/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-1/wal
uuid: "8255d43e28824a80bf7ffb7ad8d593a9"
format_stamp: "Formatted at 2026-08-11 16:39:58 on dist-test-slave-zj8q"
server_key: "99739d16ac4600d48bc4c6d324830ac2"
server_key_iv: "d217feb9c67dea052081caacb70fef51"
server_key_version: "kuduclusterkey@0"
I20260811 16:39:58.786675 14432 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:39:58.825557 14432 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:39:58.828030 14432 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:39:58.828235 14432 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:39:58.828505 14432 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:39:58.828924 14432 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:39:58.829018 14432 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:39:58.829093 14432 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:39:58.829154 14432 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:39:58.837950 14432 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.194:41361
I20260811 16:39:58.838316 14645 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.194:41361 every 8 connection(s)
I20260811 16:39:58.838472 14432 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
I20260811 16:39:58.848201 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 14432
I20260811 16:39:58.848299 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-1/wal/instance
I20260811 16:39:58.848515 25279 external_mini_cluster.cc:1428] Setting key b359b73c866c2afea1eeecf90ea920e8
Aug 11 16:39:58 dist-test-slave-zj8q krb5kdc[13243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466398, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.194@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:39:58.853260 14421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:39:58.839247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:34933 (local address 127.24.175.254:39683)
0811 16:39:58.839310 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 16:39:58.839312 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:39:58.842574 (+ 3262us) server_negotiation.cc:407] Connection header received
0811 16:39:58.843256 (+ 682us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:39:58.843257 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:39:58.843278 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:39:58.843344 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:39:58.844124 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:39:58.844889 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:39:58.846485 (+ 1596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:39:58.846791 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:39:58.846859 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:39:58.849925 (+ 3066us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:39:58.849927 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:39:58.849927 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:39:58.849936 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:39:58.851626 (+ 1690us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:39:58.852151 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:39:58.852152 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:39:58.852152 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:39:58.852217 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:39:58.852485 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:39:58.852486 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:39:58.852487 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:39:58.852636 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:39:58.852681 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 16:39:58.853066 (+ 385us) server_negotiation.cc:299] Negotiation successful
0811 16:39:58.853160 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 16:39:58.854511 14649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:39:58.839242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:39683 (local address 127.24.175.194:34933)
0811 16:39:58.842405 (+ 3163us) negotiation.cc:107] Waiting for socket to connect
0811 16:39:58.842455 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 16:39:58.843135 (+ 680us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:39:58.843442 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:39:58.843447 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:39:58.843727 (+ 280us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:39:58.844018 (+ 291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:39:58.844025 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:39:58.844996 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:39:58.844997 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:39:58.846391 (+ 1394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:39:58.846395 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:39:58.846900 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:39:58.846901 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:39:58.847047 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:39:58.847626 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:39:58.847637 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:39:58.849812 (+ 2175us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:39:58.851721 (+ 1909us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:39:58.851727 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:39:58.851730 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:39:58.852061 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:39:58.852287 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:39:58.852287 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:39:58.852288 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:39:58.852418 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:39:58.852730 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:39:58.852737 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:39:58.852905 (+ 168us) client_negotiation.cc:769] Sending connection context
0811 16:39:58.854082 (+ 1177us) client_negotiation.cc:240] Negotiation successful
0811 16:39:58.854280 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3119,"thread_start_us":82,"threads_started":1}
I20260811 16:39:58.855211 14646 heartbeater.cc:347] Connected to a master server at 127.24.175.254:39683
I20260811 16:39:58.855355 14646 heartbeater.cc:464] Registering TS with master...
I20260811 16:39:58.855597 14646 heartbeater.cc:511] Master 127.24.175.254:39683 requested a full tablet report, sending...
I20260811 16:39:58.855999 14065 ts_manager.cc:194] Registered new tserver with Master: 8255d43e28824a80bf7ffb7ad8d593a9 (127.24.175.194:41361)
I20260811 16:39:58.856462 14065 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.175.194@KRBTEST.COM'} at 127.24.175.194:34933
WARNING: no policy specified for kudu/127.24.175.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab.
Entry for principal kudu/127.24.175.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab.
I20260811 16:39:58.894542 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.24.175.212:32985/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.195:0
--local_ip_for_outbound_sockets=127.24.175.195
--webserver_interface=127.24.175.195
--webserver_port=0
--tserver_master_addrs=127.24.175.254:39683
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab
--principal=kudu/127.24.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:39909
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:39:59.038937 14656 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:39:59.039146 14656 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:39:59.039178 14656 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:39:59.040409 14656 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:39:59.040454 14656 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:39:59.040488 14656 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.195
I20260811 16:39:59.041970 14656 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:39909
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.24.175.212:32985/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab
--principal=kudu/127.24.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.175.195
--webserver_port=0
--tserver_master_addrs=127.24.175.254:39683
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14656
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.195
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:39:59.042390 14656 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:39:59.042663 14656 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:39:59.049044 14665 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:39:59.049075 14663 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:39:59.049355 14669 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:39:59.049613 14656 server_base.cc:1034] running on GCE node
I20260811 16:39:59.049804 14656 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:39:59.050029 14656 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:39:59.051186 14656 hybrid_clock.cc:648] HybridClock initialized: now 1786466399051175 us; error 27 us; skew 500 ppm
Aug 11 16:39:59 dist-test-slave-zj8q krb5kdc[13243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466399, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:39:59.053813 14656 init.cc:377] Logged in from keytab as kudu/127.24.175.195@KRBTEST.COM (short username kudu)
I20260811 16:39:59.054374 14656 webserver.cc:460] Webserver started at http://127.24.175.195:43629/ using document root <none> and password file <none>
I20260811 16:39:59.054773 14656 fs_manager.cc:359] Metadata directory not provided
I20260811 16:39:59.054848 14656 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:39:59.054993 14656 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 16:39:59 dist-test-slave-zj8q krb5kdc[13243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466399, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.195@KRBTEST.COM for HTTP/127.24.175.212@KRBTEST.COM
I20260811 16:39:59.073477 14656 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-2/data/instance:
uuid: "d5db4ad0fdf84691b96c8e6080cd0fe8"
format_stamp: "Formatted at 2026-08-11 16:39:59 on dist-test-slave-zj8q"
server_key: "f8b52f30c48dbb69d72187aa0c543ce4"
server_key_iv: "2f45192fc1f40aef9ad6abfc5679f5a5"
server_key_version: "kuduclusterkey@0"
I20260811 16:39:59.073997 14656 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-2/wal/instance:
uuid: "d5db4ad0fdf84691b96c8e6080cd0fe8"
format_stamp: "Formatted at 2026-08-11 16:39:59 on dist-test-slave-zj8q"
server_key: "f8b52f30c48dbb69d72187aa0c543ce4"
server_key_iv: "2f45192fc1f40aef9ad6abfc5679f5a5"
server_key_version: "kuduclusterkey@0"
I20260811 16:39:59.076628 14656 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.001s
I20260811 16:39:59.090262 14684 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:39:59.090420 14656 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:39:59.090512 14656 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-2/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-2/wal
uuid: "d5db4ad0fdf84691b96c8e6080cd0fe8"
format_stamp: "Formatted at 2026-08-11 16:39:59 on dist-test-slave-zj8q"
server_key: "f8b52f30c48dbb69d72187aa0c543ce4"
server_key_iv: "2f45192fc1f40aef9ad6abfc5679f5a5"
server_key_version: "kuduclusterkey@0"
I20260811 16:39:59.090601 14656 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:39:59.108745 14656 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:39:59.111182 14656 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:39:59.111332 14656 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:39:59.111581 14656 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:39:59.111945 14656 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:39:59.111994 14656 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:39:59.112028 14656 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:39:59.112046 14656 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:39:59.120147 14882 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.195:34429 every 8 connection(s)
I20260811 16:39:59.120147 14656 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.195:34429
I20260811 16:39:59.120661 14656 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
Aug 11 16:39:59 dist-test-slave-zj8q krb5kdc[13243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466399, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.195@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:39:59.130300 14421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:39:59.121774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.195:54175 (local address 127.24.175.254:39683)
0811 16:39:59.121825 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 16:39:59.121827 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:39:59.121837 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:39:59.122447 (+ 610us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:39:59.122448 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:39:59.122463 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:39:59.122494 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:39:59.123358 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:39:59.123867 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:39:59.125081 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:39:59.125279 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:39:59.125332 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:39:59.127722 (+ 2390us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:39:59.127724 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:39:59.127724 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:39:59.127732 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:39:59.129056 (+ 1324us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:39:59.129408 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:39:59.129409 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:39:59.129409 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:39:59.129468 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:39:59.129680 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:39:59.129681 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:39:59.129682 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:39:59.129795 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:39:59.129851 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 16:39:59.130096 (+ 245us) server_negotiation.cc:299] Negotiation successful
0811 16:39:59.130208 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 16:39:59.130340 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 14656
I20260811 16:39:59.130420 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-2/wal/instance
I20260811 16:39:59.130669 25279 external_mini_cluster.cc:1428] Setting key d29f051aeea79143fd0bad80267e16ce
I20260811 16:39:59.131312 14886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:39:59.121524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:39683 (local address 127.24.175.195:54175)
0811 16:39:59.121703 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 16:39:59.121747 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 16:39:59.122315 (+ 568us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:39:59.122694 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:39:59.122699 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:39:59.122952 (+ 253us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:39:59.123245 (+ 293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:39:59.123252 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:39:59.123953 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:39:59.123953 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:39:59.124983 (+ 1030us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:39:59.124986 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:39:59.125360 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:39:59.125361 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:39:59.125472 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:39:59.125940 (+ 468us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:39:59.125948 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:39:59.127635 (+ 1687us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:39:59.129131 (+ 1496us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:39:59.129137 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:39:59.129139 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:39:59.129341 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:39:59.129521 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:39:59.129521 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:39:59.129522 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:39:59.129624 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:39:59.129849 (+ 225us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:39:59.129856 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:39:59.129977 (+ 121us) client_negotiation.cc:769] Sending connection context
0811 16:39:59.130066 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 16:39:59.130942 (+ 876us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":81,"threads_started":1}
I20260811 16:39:59.131883 14883 heartbeater.cc:347] Connected to a master server at 127.24.175.254:39683
I20260811 16:39:59.131975 14883 heartbeater.cc:464] Registering TS with master...
I20260811 16:39:59.132158 14883 heartbeater.cc:511] Master 127.24.175.254:39683 requested a full tablet report, sending...
I20260811 16:39:59.132507 14065 ts_manager.cc:194] Registered new tserver with Master: d5db4ad0fdf84691b96c8e6080cd0fe8 (127.24.175.195:34429)
I20260811 16:39:59.133287 14065 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.175.195@KRBTEST.COM'} at 127.24.175.195:54175
I20260811 16:39:59.143692 25279 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 16:39:59.144315 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 14209
I20260811 16:39:59.181936 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 14432
I20260811 16:39:59.194875 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 14656
I20260811 16:39:59.205212 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 14004
I20260811 16:39:59.221001 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:39683
--webserver_interface=127.24.175.254
--webserver_port=37853
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:39909
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.175.254:39683
--ranger_config_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.24.175.212:32985/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.24.175.212:32985/kms with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:39:59.302460 14887 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:39:59.302673 14887 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:39:59.302693 14887 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:39:59.303785 14887 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:39:59.303818 14887 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:39:59.303830 14887 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:39:59.303841 14887 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:39:59.303853 14887 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:39:59.305363 14887 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:39909
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.24.175.212:32985/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.24.175.254:39683
--ranger_config_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:39683
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.175.254
--webserver_port=37853
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14887
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:39:59.305611 14887 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:39:59.305810 14887 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:39:59.310515 14897 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:39:59.310529 14894 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:39:59.310556 14887 server_base.cc:1034] running on GCE node
W20260811 16:39:59.310527 14895 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:39:59.310920 14887 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:39:59.311187 14887 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:39:59.312331 14887 hybrid_clock.cc:648] HybridClock initialized: now 1786466399312318 us; error 29 us; skew 500 ppm
Aug 11 16:39:59 dist-test-slave-zj8q krb5kdc[13243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466399, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:39:59.314733 14887 init.cc:377] Logged in from keytab as kudu/127.24.175.254@KRBTEST.COM (short username kudu)
I20260811 16:39:59.315095 14887 webserver.cc:460] Webserver started at http://127.24.175.254:37853/ using document root <none> and password file <none>
I20260811 16:39:59.315263 14887 fs_manager.cc:359] Metadata directory not provided
I20260811 16:39:59.315311 14887 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 16:39:59 dist-test-slave-zj8q krb5kdc[13243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466399, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.254@KRBTEST.COM for HTTP/127.24.175.212@KRBTEST.COM
I20260811 16:39:59.382903 14887 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:39:59.383553 14912 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:39:59.383740 14887 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 16:39:59.383833 14887 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/master-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/master-0/wal
uuid: "4976c8c8cdc543fab0c5c64928e15d90"
format_stamp: "Formatted at 2026-08-11 16:39:57 on dist-test-slave-zj8q"
server_key: "1a82d3d21f302a26e16664831053a988"
server_key_iv: "73b29b8728bf03eb5085a26294a3d701"
server_key_version: "kuduclusterkey@0"
I20260811 16:39:59.384197 14887 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:39:59.396912 14887 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:39:59.398357 14887 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:39:59.398471 14887 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:39:59.402328 14887 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.254:39683
I20260811 16:39:59.402381 15013 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.254:39683 every 8 connection(s)
I20260811 16:39:59.402734 14887 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
I20260811 16:39:59.403929 15014 sys_catalog.cc:263] Verifying existing consensus state
I20260811 16:39:59.404699 15014 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4976c8c8cdc543fab0c5c64928e15d90: Bootstrap starting.
I20260811 16:39:59.406672 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 14887
I20260811 16:39:59.406931 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.24.175.212:32985/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.193:45969
--local_ip_for_outbound_sockets=127.24.175.193
--tserver_master_addrs=127.24.175.254:39683
--webserver_port=43425
--webserver_interface=127.24.175.193
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab
--principal=kudu/127.24.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:39909
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.24.175.212:32985/kms with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 16:39:59.412351 15014 log.cc:824] T 00000000000000000000000000000000 P 4976c8c8cdc543fab0c5c64928e15d90: Log is configured to *not* fsync() on all Append() calls
I20260811 16:39:59.413954 15014 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4976c8c8cdc543fab0c5c64928e15d90: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:39:59.414238 15014 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4976c8c8cdc543fab0c5c64928e15d90: Bootstrap complete.
I20260811 16:39:59.416378 15014 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4976c8c8cdc543fab0c5c64928e15d90 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4976c8c8cdc543fab0c5c64928e15d90" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 39683 } }
I20260811 16:39:59.416603 15014 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4976c8c8cdc543fab0c5c64928e15d90 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4976c8c8cdc543fab0c5c64928e15d90, State: Initialized, Role: FOLLOWER
I20260811 16:39:59.416757 15014 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4976c8c8cdc543fab0c5c64928e15d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4976c8c8cdc543fab0c5c64928e15d90" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 39683 } }
I20260811 16:39:59.416833 15014 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4976c8c8cdc543fab0c5c64928e15d90 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:39:59.416882 15014 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4976c8c8cdc543fab0c5c64928e15d90 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:39:59.416927 15014 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4976c8c8cdc543fab0c5c64928e15d90 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:39:59.417855 15014 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4976c8c8cdc543fab0c5c64928e15d90 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4976c8c8cdc543fab0c5c64928e15d90" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 39683 } }
I20260811 16:39:59.417970 15014 leader_election.cc:302] T 00000000000000000000000000000000 P 4976c8c8cdc543fab0c5c64928e15d90 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4976c8c8cdc543fab0c5c64928e15d90; no voters:
I20260811 16:39:59.418126 15014 leader_election.cc:288] T 00000000000000000000000000000000 P 4976c8c8cdc543fab0c5c64928e15d90 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 16:39:59.418196 15020 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4976c8c8cdc543fab0c5c64928e15d90 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:39:59.418344 15020 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4976c8c8cdc543fab0c5c64928e15d90 [term 2 LEADER]: Becoming Leader. State: Replica: 4976c8c8cdc543fab0c5c64928e15d90, State: Running, Role: LEADER
I20260811 16:39:59.418414 15014 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4976c8c8cdc543fab0c5c64928e15d90 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:39:59.418447 15020 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4976c8c8cdc543fab0c5c64928e15d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4976c8c8cdc543fab0c5c64928e15d90" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 39683 } }
I20260811 16:39:59.418720 15023 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4976c8c8cdc543fab0c5c64928e15d90 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "4976c8c8cdc543fab0c5c64928e15d90" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4976c8c8cdc543fab0c5c64928e15d90" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 39683 } } }
I20260811 16:39:59.418737 15028 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4976c8c8cdc543fab0c5c64928e15d90 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4976c8c8cdc543fab0c5c64928e15d90. Latest consensus state: current_term: 2 leader_uuid: "4976c8c8cdc543fab0c5c64928e15d90" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4976c8c8cdc543fab0c5c64928e15d90" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 39683 } } }
I20260811 16:39:59.418814 15023 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4976c8c8cdc543fab0c5c64928e15d90 [sys.catalog]: This master's current role is: LEADER
I20260811 16:39:59.418821 15028 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4976c8c8cdc543fab0c5c64928e15d90 [sys.catalog]: This master's current role is: LEADER
I20260811 16:39:59.418992 15031 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:39:59.419524 15031 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:39:59.419672 15031 catalog_manager.cc:1259] Loaded cluster ID: fdd85376da844d7c9520d8f7499eddf5
I20260811 16:39:59.419708 15031 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:39:59.419876 15014 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 16:39:59.423064 15031 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:39:59.423681 15031 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 4976c8c8cdc543fab0c5c64928e15d90: Loaded TSK: 0
I20260811 16:39:59.423980 15031 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 16:39:59.516952 15017 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:39:59.517202 15017 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:39:59.517235 15017 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:39:59.518888 15017 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:39:59.518939 15017 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:39:59.518975 15017 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.193
I20260811 16:39:59.521031 15017 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:39909
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.24.175.212:32985/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab
--principal=kudu/127.24.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.193:45969
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.175.193
--webserver_port=43425
--tserver_master_addrs=127.24.175.254:39683
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15017
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.193
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:39:59.521255 15017 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:39:59.521498 15017 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:39:59.527779 15087 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:39:59.527798 15084 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:39:59.528569 15092 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:39:59.530624 15017 server_base.cc:1034] running on GCE node
I20260811 16:39:59.530891 15017 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:39:59.531160 15017 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:39:59.538520 15017 hybrid_clock.cc:648] HybridClock initialized: now 1786466399538053 us; error 477 us; skew 500 ppm
Aug 11 16:39:59 dist-test-slave-zj8q krb5kdc[13243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466399, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:39:59.541703 15017 init.cc:377] Logged in from keytab as kudu/127.24.175.193@KRBTEST.COM (short username kudu)
I20260811 16:39:59.542303 15017 webserver.cc:460] Webserver started at http://127.24.175.193:43425/ using document root <none> and password file <none>
I20260811 16:39:59.542569 15017 fs_manager.cc:359] Metadata directory not provided
I20260811 16:39:59.542661 15017 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 16:39:59 dist-test-slave-zj8q krb5kdc[13243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466399, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.193@KRBTEST.COM for HTTP/127.24.175.212@KRBTEST.COM
I20260811 16:39:59.559561 15017 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:39:59.560433 15103 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:39:59.560583 15017 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:39:59.560704 15017 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-0/wal
uuid: "f0d61129793b4a4db94ca6ca70a7f400"
format_stamp: "Formatted at 2026-08-11 16:39:58 on dist-test-slave-zj8q"
server_key: "3b84f13af9795876e61da3fc8d0a2d51"
server_key_iv: "9a804277de45b18c775bb6181b0fc1f3"
server_key_version: "kuduclusterkey@0"
I20260811 16:39:59.561916 15017 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:39:59.582949 15017 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:39:59.585318 15017 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:39:59.585471 15017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:39:59.585770 15017 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:39:59.586185 15017 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:39:59.586241 15017 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:39:59.586273 15017 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:39:59.586298 15017 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:39:59.593098 15017 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.193:45969
I20260811 16:39:59.593185 15322 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.193:45969 every 8 connection(s)
I20260811 16:39:59.593503 15017 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
Aug 11 16:39:59 dist-test-slave-zj8q krb5kdc[13243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466399, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.193@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:39:59.603334 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 15017
I20260811 16:39:59.603633 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.24.175.212:32985/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.194:41361
--local_ip_for_outbound_sockets=127.24.175.194
--tserver_master_addrs=127.24.175.254:39683
--webserver_port=35719
--webserver_interface=127.24.175.194
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab
--principal=kudu/127.24.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:39909
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.24.175.212:32985/kms with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 16:39:59.607071 15327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:39:59.594365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:33651 (local address 127.24.175.254:39683)
0811 16:39:59.594565 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0811 16:39:59.594574 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 16:39:59.594614 (+ 40us) server_negotiation.cc:407] Connection header received
0811 16:39:59.595296 (+ 682us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:39:59.595305 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:39:59.595367 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:39:59.595514 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:39:59.596031 (+ 517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:39:59.597430 (+ 1399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:39:59.598426 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:39:59.599071 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:39:59.599186 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:39:59.601266 (+ 2080us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:39:59.601270 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:39:59.601271 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:39:59.601283 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:39:59.602996 (+ 1713us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:39:59.603535 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:39:59.603538 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:39:59.603539 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:39:59.603661 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:39:59.604146 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:39:59.604147 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:39:59.604148 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:39:59.604441 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:39:59.604523 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 16:39:59.606742 (+ 2219us) server_negotiation.cc:299] Negotiation successful
0811 16:39:59.606872 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":92,"threads_started":1}
I20260811 16:39:59.607884 15326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:39:59.594259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:39683 (local address 127.24.175.193:33651)
0811 16:39:59.594435 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0811 16:39:59.594477 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 16:39:59.595032 (+ 555us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:39:59.595550 (+ 518us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:39:59.595554 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:39:59.595726 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:39:59.595910 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:39:59.595915 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:39:59.597521 (+ 1606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:39:59.597522 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:39:59.598344 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:39:59.598346 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:39:59.599176 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:39:59.599176 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:39:59.599264 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:39:59.599714 (+ 450us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:39:59.599723 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:39:59.601158 (+ 1435us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:39:59.603071 (+ 1913us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:39:59.603077 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:39:59.603079 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:39:59.603361 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:39:59.603950 (+ 589us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:39:59.603951 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:39:59.603952 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:39:59.604080 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:39:59.606365 (+ 2285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:39:59.606372 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:39:59.606535 (+ 163us) client_negotiation.cc:769] Sending connection context
0811 16:39:59.607475 (+ 940us) client_negotiation.cc:240] Negotiation successful
0811 16:39:59.607631 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":88,"threads_started":1}
I20260811 16:39:59.608861 15324 heartbeater.cc:347] Connected to a master server at 127.24.175.254:39683
I20260811 16:39:59.608954 15324 heartbeater.cc:464] Registering TS with master...
I20260811 16:39:59.609135 15324 heartbeater.cc:511] Master 127.24.175.254:39683 requested a full tablet report, sending...
W20260811 16:39:59.610071 15324 heartbeater.cc:644] Failed to heartbeat to 127.24.175.254:39683 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 16:39:59.610138 15324 heartbeater.cc:464] Registering TS with master...
I20260811 16:39:59.610224 15324 heartbeater.cc:511] Master 127.24.175.254:39683 requested a full tablet report, sending...
I20260811 16:39:59.610626 15324 heartbeater.cc:464] Registering TS with master...
I20260811 16:39:59.610713 15324 heartbeater.cc:511] Master 127.24.175.254:39683 requested a full tablet report, sending...
W20260811 16:39:59.611055 15324 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 16:39:59.710839 15328 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:39:59.711107 15328 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:39:59.711143 15328 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:39:59.712740 15328 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:39:59.712798 15328 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:39:59.712826 15328 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.194
I20260811 16:39:59.714354 15328 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:39909
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.24.175.212:32985/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab
--principal=kudu/127.24.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.194:41361
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.175.194
--webserver_port=35719
--tserver_master_addrs=127.24.175.254:39683
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15328
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.194
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:39:59.714577 15328 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:39:59.714805 15328 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:39:59.721395 15337 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:39:59.721697 15339 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:39:59.721873 15328 server_base.cc:1034] running on GCE node
W20260811 16:39:59.722312 15342 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:39:59.722554 15328 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:39:59.722842 15328 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:39:59.724025 15328 hybrid_clock.cc:648] HybridClock initialized: now 1786466399723998 us; error 39 us; skew 500 ppm
Aug 11 16:39:59 dist-test-slave-zj8q krb5kdc[13243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466399, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:39:59.727221 15328 init.cc:377] Logged in from keytab as kudu/127.24.175.194@KRBTEST.COM (short username kudu)
I20260811 16:39:59.727766 15328 webserver.cc:460] Webserver started at http://127.24.175.194:35719/ using document root <none> and password file <none>
I20260811 16:39:59.728051 15328 fs_manager.cc:359] Metadata directory not provided
I20260811 16:39:59.728137 15328 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 16:39:59 dist-test-slave-zj8q krb5kdc[13243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466399, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.194@KRBTEST.COM for HTTP/127.24.175.212@KRBTEST.COM
I20260811 16:39:59.743309 15328 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.000s
I20260811 16:39:59.749095 15354 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:39:59.749315 15328 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.001s sys 0.000s
I20260811 16:39:59.749405 15328 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-1/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-1/wal
uuid: "8255d43e28824a80bf7ffb7ad8d593a9"
format_stamp: "Formatted at 2026-08-11 16:39:58 on dist-test-slave-zj8q"
server_key: "99739d16ac4600d48bc4c6d324830ac2"
server_key_iv: "d217feb9c67dea052081caacb70fef51"
server_key_version: "kuduclusterkey@0"
I20260811 16:39:59.749826 15328 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:39:59.780215 15328 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:39:59.782087 15328 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:39:59.782263 15328 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:39:59.782493 15328 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:39:59.782861 15328 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:39:59.782917 15328 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:39:59.782959 15328 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:39:59.782982 15328 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:39:59.789074 15328 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.194:41361
I20260811 16:39:59.789172 15560 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.194:41361 every 8 connection(s)
I20260811 16:39:59.789485 15328 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
I20260811 16:39:59.791508 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 15328
I20260811 16:39:59.791782 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.24.175.212:32985/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.195:34429
--local_ip_for_outbound_sockets=127.24.175.195
--tserver_master_addrs=127.24.175.254:39683
--webserver_port=43629
--webserver_interface=127.24.175.195
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab
--principal=kudu/127.24.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:39909
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.24.175.212:32985/kms with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 16:39:59 dist-test-slave-zj8q krb5kdc[13243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466399, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.194@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:39:59.800608 15327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:39:59.790207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:44439 (local address 127.24.175.254:39683)
0811 16:39:59.790253 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 16:39:59.790255 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:39:59.790493 (+ 238us) server_negotiation.cc:407] Connection header received
0811 16:39:59.791028 (+ 535us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:39:59.791030 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:39:59.791046 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:39:59.791093 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:39:59.791725 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:39:59.792506 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:39:59.795248 (+ 2742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:39:59.795508 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:39:59.795546 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:39:59.797960 (+ 2414us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:39:59.797962 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:39:59.797962 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:39:59.797969 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:39:59.799365 (+ 1396us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:39:59.799742 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:39:59.799743 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:39:59.799743 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:39:59.799795 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:39:59.800015 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:39:59.800016 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:39:59.800017 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:39:59.800121 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:39:59.800177 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 16:39:59.800434 (+ 257us) server_negotiation.cc:299] Negotiation successful
0811 16:39:59.800518 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 16:39:59.800942 15567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:39:59.790213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:39683 (local address 127.24.175.194:44439)
0811 16:39:59.790370 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 16:39:59.790411 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 16:39:59.790921 (+ 510us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:39:59.791175 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:39:59.791179 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:39:59.791345 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:39:59.791608 (+ 263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:39:59.791615 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:39:59.794331 (+ 2716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:39:59.794333 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:39:59.795139 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:39:59.795143 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:39:59.795657 (+ 514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:39:59.795658 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:39:59.795797 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:39:59.796307 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:39:59.796318 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:39:59.797854 (+ 1536us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:39:59.799447 (+ 1593us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:39:59.799454 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:39:59.799456 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:39:59.799673 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:39:59.799849 (+ 176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:39:59.799850 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:39:59.799850 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:39:59.799959 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:39:59.800180 (+ 221us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:39:59.800186 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:39:59.800318 (+ 132us) client_negotiation.cc:769] Sending connection context
0811 16:39:59.800404 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 16:39:59.800542 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":88,"threads_started":1}
I20260811 16:39:59.801425 15563 heartbeater.cc:347] Connected to a master server at 127.24.175.254:39683
I20260811 16:39:59.801522 15563 heartbeater.cc:464] Registering TS with master...
I20260811 16:39:59.801723 15563 heartbeater.cc:511] Master 127.24.175.254:39683 requested a full tablet report, sending...
W20260811 16:39:59.802364 15563 heartbeater.cc:644] Failed to heartbeat to 127.24.175.254:39683 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 16:39:59.802435 15563 heartbeater.cc:464] Registering TS with master...
I20260811 16:39:59.802496 15563 heartbeater.cc:511] Master 127.24.175.254:39683 requested a full tablet report, sending...
I20260811 16:39:59.802834 15563 heartbeater.cc:464] Registering TS with master...
I20260811 16:39:59.802917 15563 heartbeater.cc:511] Master 127.24.175.254:39683 requested a full tablet report, sending...
W20260811 16:39:59.803198 15563 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 16:39:59.913148 15568 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:39:59.913422 15568 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:39:59.913457 15568 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:39:59.915074 15568 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:39:59.915136 15568 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:39:59.915182 15568 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.195
I20260811 16:39:59.917338 15568 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:39909
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.24.175.212:32985/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab
--principal=kudu/127.24.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.195:34429
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.175.195
--webserver_port=43629
--tserver_master_addrs=127.24.175.254:39683
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15568
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.195
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:39:59.917577 15568 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:39:59.917834 15568 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:39:59.923313 15584 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:39:59.923652 15568 server_base.cc:1034] running on GCE node
W20260811 16:39:59.926108 15582 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:39:59.930058 15578 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:39:59.930336 15568 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:39:59.930603 15568 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:39:59.931777 15568 hybrid_clock.cc:648] HybridClock initialized: now 1786466399931759 us; error 29 us; skew 500 ppm
Aug 11 16:39:59 dist-test-slave-zj8q krb5kdc[13243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466399, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:39:59.935010 15568 init.cc:377] Logged in from keytab as kudu/127.24.175.195@KRBTEST.COM (short username kudu)
I20260811 16:39:59.935546 15568 webserver.cc:460] Webserver started at http://127.24.175.195:43629/ using document root <none> and password file <none>
I20260811 16:39:59.935822 15568 fs_manager.cc:359] Metadata directory not provided
I20260811 16:39:59.935909 15568 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 16:39:59 dist-test-slave-zj8q krb5kdc[13243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466399, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.195@KRBTEST.COM for HTTP/127.24.175.212@KRBTEST.COM
I20260811 16:39:59.953612 15568 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.000s
I20260811 16:39:59.954775 15604 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:39:59.954953 15568 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 16:39:59.955050 15568 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-2/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-2/wal
uuid: "d5db4ad0fdf84691b96c8e6080cd0fe8"
format_stamp: "Formatted at 2026-08-11 16:39:59 on dist-test-slave-zj8q"
server_key: "f8b52f30c48dbb69d72187aa0c543ce4"
server_key_iv: "2f45192fc1f40aef9ad6abfc5679f5a5"
server_key_version: "kuduclusterkey@0"
I20260811 16:39:59.955420 15568 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:39:59.968924 15568 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:39:59.970851 15568 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:39:59.971004 15568 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:39:59.971247 15568 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:39:59.971634 15568 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:39:59.971697 15568 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:39:59.971727 15568 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:39:59.971743 15568 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:39:59.980731 15568 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.195:34429
I20260811 16:39:59.980772 15841 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.195:34429 every 8 connection(s)
I20260811 16:39:59.981107 15568 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
Aug 11 16:39:59 dist-test-slave-zj8q krb5kdc[13243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466399, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.195@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:39:59.990883 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 15568
I20260811 16:39:59.991725 15327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:39:59.981904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.195:42227 (local address 127.24.175.254:39683)
0811 16:39:59.981962 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 16:39:59.981964 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:39:59.982207 (+ 243us) server_negotiation.cc:407] Connection header received
0811 16:39:59.982885 (+ 678us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:39:59.982887 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:39:59.982902 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:39:59.982973 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:39:59.983699 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:39:59.984474 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:39:59.985856 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:39:59.986200 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:39:59.986251 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:39:59.988650 (+ 2399us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:39:59.988652 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:39:59.988652 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:39:59.988659 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:39:59.990111 (+ 1452us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:39:59.990608 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:39:59.990610 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:39:59.990610 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:39:59.990694 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:39:59.990994 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:39:59.990995 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:39:59.990995 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:39:59.991143 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:39:59.991190 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 16:39:59.991551 (+ 361us) server_negotiation.cc:299] Negotiation successful
0811 16:39:59.991636 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 16:39:59.991889 15848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:39:59.981879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:39683 (local address 127.24.175.195:42227)
0811 16:39:59.982073 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0811 16:39:59.982111 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 16:39:59.982727 (+ 616us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:39:59.983060 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:39:59.983065 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:39:59.983304 (+ 239us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:39:59.983577 (+ 273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:39:59.983584 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:39:59.984599 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:39:59.984600 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:39:59.985754 (+ 1154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:39:59.985757 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:39:59.986367 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:39:59.986368 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:39:59.986475 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:39:59.986959 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:39:59.986967 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:39:59.988559 (+ 1592us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:39:59.990237 (+ 1678us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:39:59.990244 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:39:59.990246 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:39:59.990531 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:39:59.990770 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:39:59.990771 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:39:59.990771 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:39:59.990910 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:39:59.991237 (+ 327us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:39:59.991243 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:39:59.991412 (+ 169us) client_negotiation.cc:769] Sending connection context
0811 16:39:59.991522 (+ 110us) client_negotiation.cc:240] Negotiation successful
0811 16:39:59.991669 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":92,"threads_started":1}
I20260811 16:39:59.992377 15842 heartbeater.cc:347] Connected to a master server at 127.24.175.254:39683
I20260811 16:39:59.992478 15842 heartbeater.cc:464] Registering TS with master...
I20260811 16:39:59.992671 15842 heartbeater.cc:511] Master 127.24.175.254:39683 requested a full tablet report, sending...
W20260811 16:39:59.993266 15842 heartbeater.cc:644] Failed to heartbeat to 127.24.175.254:39683 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 16:39:59.993331 15842 heartbeater.cc:464] Registering TS with master...
I20260811 16:39:59.993395 15842 heartbeater.cc:511] Master 127.24.175.254:39683 requested a full tablet report, sending...
I20260811 16:39:59.993716 15842 heartbeater.cc:464] Registering TS with master...
I20260811 16:39:59.993795 15842 heartbeater.cc:511] Master 127.24.175.254:39683 requested a full tablet report, sending...
W20260811 16:39:59.994059 15842 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 16:39:59.999579 15852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:39:59.991322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44412 (local address 127.24.175.254:39683)
0811 16:39:59.991444 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0811 16:39:59.991446 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:39:59.992201 (+ 755us) server_negotiation.cc:407] Connection header received
0811 16:39:59.992219 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:39:59.992219 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:39:59.992289 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:39:59.992839 (+ 550us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:39:59.993479 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:39:59.994202 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:39:59.995289 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:39:59.995508 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:39:59.995571 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:39:59.996941 (+ 1370us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:39:59.996943 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:39:59.996943 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:39:59.996949 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:39:59.998313 (+ 1364us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:39:59.998713 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:39:59.998715 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:39:59.998715 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:39:59.998778 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:39:59.999017 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:39:59.999019 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:39:59.999019 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:39:59.999149 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:39:59.999284 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0811 16:39:59.999420 (+ 136us) server_negotiation.cc:299] Negotiation successful
0811 16:39:59.999500 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103,"thread_start_us":72,"threads_started":1}
Aug 11 16:40:00 dist-test-slave-zj8q krb5kdc[13243](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786466400, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:40:00.611228 15324 heartbeater.cc:464] Registering TS with master...
I20260811 16:40:00.611388 15324 heartbeater.cc:511] Master 127.24.175.254:39683 requested a full tablet report, sending...
I20260811 16:40:00.611824 14955 ts_manager.cc:194] Registered new tserver with Master: f0d61129793b4a4db94ca6ca70a7f400 (127.24.175.193:45969)
I20260811 16:40:00.612869 14955 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.175.193@KRBTEST.COM'} at 127.24.175.193:33651
I20260811 16:40:00.803362 15563 heartbeater.cc:464] Registering TS with master...
I20260811 16:40:00.803508 15563 heartbeater.cc:511] Master 127.24.175.254:39683 requested a full tablet report, sending...
I20260811 16:40:00.803814 14955 ts_manager.cc:194] Registered new tserver with Master: 8255d43e28824a80bf7ffb7ad8d593a9 (127.24.175.194:41361)
I20260811 16:40:00.804324 14955 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.175.194@KRBTEST.COM'} at 127.24.175.194:44439
Aug 11 16:40:00 dist-test-slave-zj8q krb5kdc[13243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466400, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.254@KRBTEST.COM for HTTP/127.24.175.212@KRBTEST.COM
I20260811 16:40:00.994230 15842 heartbeater.cc:464] Registering TS with master...
I20260811 16:40:00.994381 15842 heartbeater.cc:511] Master 127.24.175.254:39683 requested a full tablet report, sending...
I20260811 16:40:00.994652 14955 ts_manager.cc:194] Registered new tserver with Master: d5db4ad0fdf84691b96c8e6080cd0fe8 (127.24.175.195:34429)
I20260811 16:40:00.995146 14955 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.175.195@KRBTEST.COM'} at 127.24.175.195:42227
I20260811 16:40:01.001451 25279 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 16:40:01.010300 15886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:01.002435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44424 (local address 127.24.175.254:39683)
0811 16:40:01.002564 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:01.002567 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:01.002665 (+ 98us) server_negotiation.cc:407] Connection header received
0811 16:40:01.002718 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:01.002718 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:01.002732 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:01.002811 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:40:01.003461 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:01.004291 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:01.005370 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:01.005699 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:01.005778 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:01.007234 (+ 1456us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:40:01.007236 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:40:01.007236 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:40:01.007244 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:40:01.009032 (+ 1788us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:01.009422 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:01.009423 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:01.009424 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:01.009493 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:01.009689 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:01.009690 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:01.009690 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:01.009855 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:40:01.009966 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 16:40:01.010070 (+ 104us) server_negotiation.cc:299] Negotiation successful
0811 16:40:01.010196 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104,"thread_start_us":74,"threads_started":1}
I20260811 16:40:01.012931 14955 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44424:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:40:01.015302 14955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:40:01.023416 15905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:01.018489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.194:41361 (local address 127.0.0.1:46100)
0811 16:40:01.019084 (+ 595us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:01.019093 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:40:01.019139 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:40:01.019334 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:40:01.019337 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:40:01.019340 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:40:01.019426 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:01.019427 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:01.020703 (+ 1276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:01.020704 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:01.022094 (+ 1390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:01.022097 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:01.023086 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:01.023087 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:01.023195 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:01.023210 (+ 15us) client_negotiation.cc:769] Sending connection context
0811 16:40:01.023285 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 16:40:01.023336 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":579,"thread_start_us":108,"threads_started":1}
I20260811 16:40:01.023432 15901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:01.018592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46100 (local address 127.24.175.194:41361)
0811 16:40:01.018941 (+ 349us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:01.018946 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:01.019155 (+ 209us) server_negotiation.cc:407] Connection header received
0811 16:40:01.019199 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:01.019201 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:01.019219 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:01.019312 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:40:01.019505 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:01.020610 (+ 1105us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:01.022203 (+ 1593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:01.022983 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:01.023079 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:01.023160 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 16:40:01.023308 (+ 148us) server_negotiation.cc:299] Negotiation successful
0811 16:40:01.023353 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":317,"thread_start_us":62,"threads_started":1}
I20260811 16:40:01.024374 15446 tablet_service.cc:1467] Processing CreateTablet for tablet 9f23c2762cc044dbb5f4a1c1b43d2c37 (DEFAULT_TABLE table=test-table [id=1fd40324067a4018b2e5a6847e5438b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:40:01.024714 15446 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f23c2762cc044dbb5f4a1c1b43d2c37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:40:01.029309 15905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:01.018726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.193:45969 (local address 127.0.0.1:36634)
0811 16:40:01.023958 (+ 5232us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:01.023968 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:40:01.024000 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:40:01.026424 (+ 2424us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:40:01.026425 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:40:01.026427 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:40:01.026462 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:01.026463 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:01.027629 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:01.027630 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:01.028443 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:01.028446 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:01.029090 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:01.029091 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:01.029150 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:01.029154 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:40:01.029200 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 16:40:01.029238 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5164,"thread_start_us":71,"threads_started":1}
I20260811 16:40:01.029887 15906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:01.018827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36634 (local address 127.24.175.193:45969)
0811 16:40:01.026254 (+ 7427us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:01.026259 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:01.026271 (+ 12us) server_negotiation.cc:407] Connection header received
0811 16:40:01.026313 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:01.026315 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:01.026331 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:01.026428 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:40:01.026514 (+ 86us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:01.027532 (+ 1018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:01.028520 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:01.029001 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:01.029077 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:01.029134 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 16:40:01.029764 (+ 630us) server_negotiation.cc:299] Negotiation successful
0811 16:40:01.029809 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7383,"thread_start_us":61,"threads_started":1}
I20260811 16:40:01.030319 15900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:01.018483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.195:34429 (local address 127.0.0.1:42996)
0811 16:40:01.018761 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:01.018803 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 16:40:01.018977 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:40:01.026647 (+ 7670us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:40:01.026649 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:40:01.026650 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:40:01.026694 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:01.026696 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:01.028095 (+ 1399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:01.028096 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:01.029123 (+ 1027us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:01.029127 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:01.030077 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:01.030079 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:01.030140 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:01.030144 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:40:01.030213 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 16:40:01.030252 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":95,"threads_started":1}
I20260811 16:40:01.030505 15915 tablet_bootstrap.cc:492] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P 8255d43e28824a80bf7ffb7ad8d593a9: Bootstrap starting.
I20260811 16:40:01.030694 15907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:01.018925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42996 (local address 127.24.175.195:34429)
0811 16:40:01.026350 (+ 7425us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:01.026355 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:01.026366 (+ 11us) server_negotiation.cc:407] Connection header received
0811 16:40:01.026524 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:01.026527 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:01.026555 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:01.026923 (+ 368us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:40:01.027002 (+ 79us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:01.027990 (+ 988us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:01.029229 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:01.029972 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:01.030476 (+ 504us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:01.030541 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 16:40:01.030567 (+ 26us) server_negotiation.cc:299] Negotiation successful
0811 16:40:01.030607 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7392,"thread_start_us":59,"threads_started":1}
I20260811 16:40:01.031009 15200 tablet_service.cc:1467] Processing CreateTablet for tablet 9f23c2762cc044dbb5f4a1c1b43d2c37 (DEFAULT_TABLE table=test-table [id=1fd40324067a4018b2e5a6847e5438b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:40:01.031174 15915 tablet_bootstrap.cc:654] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P 8255d43e28824a80bf7ffb7ad8d593a9: Neither blocks nor log segments found. Creating new log.
I20260811 16:40:01.031396 15200 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f23c2762cc044dbb5f4a1c1b43d2c37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:40:01.031347 15699 tablet_service.cc:1467] Processing CreateTablet for tablet 9f23c2762cc044dbb5f4a1c1b43d2c37 (DEFAULT_TABLE table=test-table [id=1fd40324067a4018b2e5a6847e5438b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:40:01.031478 15915 log.cc:824] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P 8255d43e28824a80bf7ffb7ad8d593a9: Log is configured to *not* fsync() on all Append() calls
I20260811 16:40:01.031679 15699 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f23c2762cc044dbb5f4a1c1b43d2c37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:40:01.035252 15918 tablet_bootstrap.cc:492] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P d5db4ad0fdf84691b96c8e6080cd0fe8: Bootstrap starting.
I20260811 16:40:01.035776 15919 tablet_bootstrap.cc:492] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P f0d61129793b4a4db94ca6ca70a7f400: Bootstrap starting.
I20260811 16:40:01.036057 15918 tablet_bootstrap.cc:654] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P d5db4ad0fdf84691b96c8e6080cd0fe8: Neither blocks nor log segments found. Creating new log.
I20260811 16:40:01.036365 15918 log.cc:824] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P d5db4ad0fdf84691b96c8e6080cd0fe8: Log is configured to *not* fsync() on all Append() calls
I20260811 16:40:01.036770 15919 tablet_bootstrap.cc:654] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P f0d61129793b4a4db94ca6ca70a7f400: Neither blocks nor log segments found. Creating new log.
I20260811 16:40:01.037133 15919 log.cc:824] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P f0d61129793b4a4db94ca6ca70a7f400: Log is configured to *not* fsync() on all Append() calls
I20260811 16:40:01.037199 15915 tablet_bootstrap.cc:492] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P 8255d43e28824a80bf7ffb7ad8d593a9: No bootstrap required, opened a new log
I20260811 16:40:01.037271 15915 ts_tablet_manager.cc:1397] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P 8255d43e28824a80bf7ffb7ad8d593a9: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20260811 16:40:01.037987 15919 tablet_bootstrap.cc:492] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P f0d61129793b4a4db94ca6ca70a7f400: No bootstrap required, opened a new log
I20260811 16:40:01.038118 15919 ts_tablet_manager.cc:1397] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P f0d61129793b4a4db94ca6ca70a7f400: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:40:01.039455 15915 raft_consensus.cc:348] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P 8255d43e28824a80bf7ffb7ad8d593a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5db4ad0fdf84691b96c8e6080cd0fe8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 34429 } } peers { permanent_uuid: "f0d61129793b4a4db94ca6ca70a7f400" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 45969 } } peers { permanent_uuid: "8255d43e28824a80bf7ffb7ad8d593a9" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 41361 } }
I20260811 16:40:01.039881 15915 raft_consensus.cc:374] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P 8255d43e28824a80bf7ffb7ad8d593a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:40:01.039929 15915 raft_consensus.cc:729] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P 8255d43e28824a80bf7ffb7ad8d593a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8255d43e28824a80bf7ffb7ad8d593a9, State: Initialized, Role: FOLLOWER
I20260811 16:40:01.040072 15915 consensus_queue.cc:260] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P 8255d43e28824a80bf7ffb7ad8d593a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5db4ad0fdf84691b96c8e6080cd0fe8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 34429 } } peers { permanent_uuid: "f0d61129793b4a4db94ca6ca70a7f400" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 45969 } } peers { permanent_uuid: "8255d43e28824a80bf7ffb7ad8d593a9" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 41361 } }
I20260811 16:40:01.040340 15915 ts_tablet_manager.cc:1428] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P 8255d43e28824a80bf7ffb7ad8d593a9: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 16:40:01.040460 15563 heartbeater.cc:503] Master 127.24.175.254:39683 was elected leader, sending a full tablet report...
W20260811 16:40:01.041211 15564 tablet.cc:2369] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P 8255d43e28824a80bf7ffb7ad8d593a9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:40:01.041241 15919 raft_consensus.cc:348] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P f0d61129793b4a4db94ca6ca70a7f400 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5db4ad0fdf84691b96c8e6080cd0fe8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 34429 } } peers { permanent_uuid: "f0d61129793b4a4db94ca6ca70a7f400" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 45969 } } peers { permanent_uuid: "8255d43e28824a80bf7ffb7ad8d593a9" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 41361 } }
I20260811 16:40:01.041471 15919 raft_consensus.cc:374] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P f0d61129793b4a4db94ca6ca70a7f400 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:40:01.041522 15919 raft_consensus.cc:729] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P f0d61129793b4a4db94ca6ca70a7f400 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0d61129793b4a4db94ca6ca70a7f400, State: Initialized, Role: FOLLOWER
I20260811 16:40:01.041667 15919 consensus_queue.cc:260] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P f0d61129793b4a4db94ca6ca70a7f400 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5db4ad0fdf84691b96c8e6080cd0fe8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 34429 } } peers { permanent_uuid: "f0d61129793b4a4db94ca6ca70a7f400" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 45969 } } peers { permanent_uuid: "8255d43e28824a80bf7ffb7ad8d593a9" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 41361 } }
I20260811 16:40:01.041937 15919 ts_tablet_manager.cc:1428] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P f0d61129793b4a4db94ca6ca70a7f400: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260811 16:40:01.042044 15324 heartbeater.cc:503] Master 127.24.175.254:39683 was elected leader, sending a full tablet report...
I20260811 16:40:01.043218 15918 tablet_bootstrap.cc:492] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P d5db4ad0fdf84691b96c8e6080cd0fe8: No bootstrap required, opened a new log
I20260811 16:40:01.043336 15918 ts_tablet_manager.cc:1397] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P d5db4ad0fdf84691b96c8e6080cd0fe8: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20260811 16:40:01.045789 15918 raft_consensus.cc:348] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P d5db4ad0fdf84691b96c8e6080cd0fe8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5db4ad0fdf84691b96c8e6080cd0fe8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 34429 } } peers { permanent_uuid: "f0d61129793b4a4db94ca6ca70a7f400" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 45969 } } peers { permanent_uuid: "8255d43e28824a80bf7ffb7ad8d593a9" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 41361 } }
I20260811 16:40:01.045995 15918 raft_consensus.cc:374] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P d5db4ad0fdf84691b96c8e6080cd0fe8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:40:01.046070 15918 raft_consensus.cc:729] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P d5db4ad0fdf84691b96c8e6080cd0fe8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5db4ad0fdf84691b96c8e6080cd0fe8, State: Initialized, Role: FOLLOWER
I20260811 16:40:01.046232 15918 consensus_queue.cc:260] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P d5db4ad0fdf84691b96c8e6080cd0fe8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5db4ad0fdf84691b96c8e6080cd0fe8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 34429 } } peers { permanent_uuid: "f0d61129793b4a4db94ca6ca70a7f400" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 45969 } } peers { permanent_uuid: "8255d43e28824a80bf7ffb7ad8d593a9" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 41361 } }
I20260811 16:40:01.046486 15918 ts_tablet_manager.cc:1428] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P d5db4ad0fdf84691b96c8e6080cd0fe8: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 16:40:01.046522 15842 heartbeater.cc:503] Master 127.24.175.254:39683 was elected leader, sending a full tablet report...
Aug 11 16:40:01 dist-test-slave-zj8q krb5kdc[13243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466400, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.254@KRBTEST.COM for HTTP/127.24.175.212@KRBTEST.COM
W20260811 16:40:01.094936 15325 tablet.cc:2369] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P f0d61129793b4a4db94ca6ca70a7f400: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 16:40:01.232437 15844 tablet.cc:2369] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P d5db4ad0fdf84691b96c8e6080cd0fe8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:40:01.323511 15925 raft_consensus.cc:482] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P f0d61129793b4a4db94ca6ca70a7f400 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:40:01.323642 15925 raft_consensus.cc:504] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P f0d61129793b4a4db94ca6ca70a7f400 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5db4ad0fdf84691b96c8e6080cd0fe8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 34429 } } peers { permanent_uuid: "f0d61129793b4a4db94ca6ca70a7f400" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 45969 } } peers { permanent_uuid: "8255d43e28824a80bf7ffb7ad8d593a9" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 41361 } }
I20260811 16:40:01.324033 15925 leader_election.cc:288] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P f0d61129793b4a4db94ca6ca70a7f400 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5db4ad0fdf84691b96c8e6080cd0fe8 (127.24.175.195:34429), 8255d43e28824a80bf7ffb7ad8d593a9 (127.24.175.194:41361)
I20260811 16:40:01.327502 15907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:01.324350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:43849 (local address 127.24.175.195:34429)
0811 16:40:01.324399 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:01.324401 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:01.324539 (+ 138us) server_negotiation.cc:407] Connection header received
0811 16:40:01.324595 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:01.324596 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:01.324607 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:01.324662 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:40:01.324989 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:01.325696 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:01.326775 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:01.327166 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:01.327238 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:01.327247 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 16:40:01.327393 (+ 146us) server_negotiation.cc:299] Negotiation successful
0811 16:40:01.327433 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 16:40:01.327526 15955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:01.324209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.195:34429 (local address 127.24.175.193:43849)
0811 16:40:01.324462 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:01.324474 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:40:01.324540 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:40:01.324814 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:40:01.324815 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:40:01.324818 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:40:01.324908 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:01.324910 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:01.325778 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:01.325780 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:01.326693 (+ 913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:01.326696 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:01.327261 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:01.327262 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:01.327327 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:01.327332 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 16:40:01.327383 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 16:40:01.327421 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":235,"mutex_wait_us":42,"thread_start_us":107,"threads_started":1}
I20260811 16:40:01.328033 15901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:01.324384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:57183 (local address 127.24.175.194:41361)
0811 16:40:01.324423 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:01.324425 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:01.324559 (+ 134us) server_negotiation.cc:407] Connection header received
0811 16:40:01.324655 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:01.324656 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:01.324669 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:01.324716 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:40:01.324889 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:01.325659 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:01.327139 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:01.327630 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:01.327698 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:01.327707 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 16:40:01.327921 (+ 214us) server_negotiation.cc:299] Negotiation successful
0811 16:40:01.327966 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 16:40:01.328076 15702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f23c2762cc044dbb5f4a1c1b43d2c37" candidate_uuid: "f0d61129793b4a4db94ca6ca70a7f400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5db4ad0fdf84691b96c8e6080cd0fe8" is_pre_election: true
I20260811 16:40:01.328248 15951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:01.324218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.194:41361 (local address 127.24.175.193:57183)
0811 16:40:01.324486 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:01.324498 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:40:01.324591 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:40:01.324758 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:40:01.324759 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:40:01.324760 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:40:01.324830 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:01.324832 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:01.325749 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:01.325750 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:01.327050 (+ 1300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:01.327053 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:01.327698 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:01.327699 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:01.327771 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:01.327775 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:40:01.328115 (+ 340us) client_negotiation.cc:240] Negotiation successful
0811 16:40:01.328158 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":247,"mutex_wait_us":50,"thread_start_us":102,"threads_started":1}
I20260811 16:40:01.328261 15702 raft_consensus.cc:2454] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P d5db4ad0fdf84691b96c8e6080cd0fe8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0d61129793b4a4db94ca6ca70a7f400 in term 0.
I20260811 16:40:01.328573 15111 leader_election.cc:302] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P f0d61129793b4a4db94ca6ca70a7f400 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d5db4ad0fdf84691b96c8e6080cd0fe8, f0d61129793b4a4db94ca6ca70a7f400; no voters:
I20260811 16:40:01.328601 15482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f23c2762cc044dbb5f4a1c1b43d2c37" candidate_uuid: "f0d61129793b4a4db94ca6ca70a7f400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8255d43e28824a80bf7ffb7ad8d593a9" is_pre_election: true
I20260811 16:40:01.328749 15482 raft_consensus.cc:2454] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P 8255d43e28824a80bf7ffb7ad8d593a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0d61129793b4a4db94ca6ca70a7f400 in term 0.
I20260811 16:40:01.328866 15925 raft_consensus.cc:2781] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P f0d61129793b4a4db94ca6ca70a7f400 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:40:01.328936 15925 raft_consensus.cc:482] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P f0d61129793b4a4db94ca6ca70a7f400 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:40:01.328969 15925 raft_consensus.cc:3037] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P f0d61129793b4a4db94ca6ca70a7f400 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:40:01.329643 15925 raft_consensus.cc:504] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P f0d61129793b4a4db94ca6ca70a7f400 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5db4ad0fdf84691b96c8e6080cd0fe8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 34429 } } peers { permanent_uuid: "f0d61129793b4a4db94ca6ca70a7f400" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 45969 } } peers { permanent_uuid: "8255d43e28824a80bf7ffb7ad8d593a9" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 41361 } }
I20260811 16:40:01.329754 15925 leader_election.cc:288] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P f0d61129793b4a4db94ca6ca70a7f400 [CANDIDATE]: Term 1 election: Requested vote from peers d5db4ad0fdf84691b96c8e6080cd0fe8 (127.24.175.195:34429), 8255d43e28824a80bf7ffb7ad8d593a9 (127.24.175.194:41361)
I20260811 16:40:01.329916 15482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f23c2762cc044dbb5f4a1c1b43d2c37" candidate_uuid: "f0d61129793b4a4db94ca6ca70a7f400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8255d43e28824a80bf7ffb7ad8d593a9"
I20260811 16:40:01.329978 15702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f23c2762cc044dbb5f4a1c1b43d2c37" candidate_uuid: "f0d61129793b4a4db94ca6ca70a7f400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5db4ad0fdf84691b96c8e6080cd0fe8"
I20260811 16:40:01.330001 15482 raft_consensus.cc:3037] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P 8255d43e28824a80bf7ffb7ad8d593a9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:40:01.330055 15702 raft_consensus.cc:3037] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P d5db4ad0fdf84691b96c8e6080cd0fe8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:40:01.330869 15482 raft_consensus.cc:2454] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P 8255d43e28824a80bf7ffb7ad8d593a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0d61129793b4a4db94ca6ca70a7f400 in term 1.
I20260811 16:40:01.330870 15702 raft_consensus.cc:2454] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P d5db4ad0fdf84691b96c8e6080cd0fe8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0d61129793b4a4db94ca6ca70a7f400 in term 1.
I20260811 16:40:01.331049 15111 leader_election.cc:302] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P f0d61129793b4a4db94ca6ca70a7f400 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d5db4ad0fdf84691b96c8e6080cd0fe8, f0d61129793b4a4db94ca6ca70a7f400; no voters:
I20260811 16:40:01.331148 15925 raft_consensus.cc:2781] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P f0d61129793b4a4db94ca6ca70a7f400 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:40:01.331398 15925 raft_consensus.cc:686] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P f0d61129793b4a4db94ca6ca70a7f400 [term 1 LEADER]: Becoming Leader. State: Replica: f0d61129793b4a4db94ca6ca70a7f400, State: Running, Role: LEADER
I20260811 16:40:01.331511 15925 consensus_queue.cc:237] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P f0d61129793b4a4db94ca6ca70a7f400 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5db4ad0fdf84691b96c8e6080cd0fe8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 34429 } } peers { permanent_uuid: "f0d61129793b4a4db94ca6ca70a7f400" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 45969 } } peers { permanent_uuid: "8255d43e28824a80bf7ffb7ad8d593a9" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 41361 } }
I20260811 16:40:01.332342 14955 catalog_manager.cc:5495] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P f0d61129793b4a4db94ca6ca70a7f400 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0d61129793b4a4db94ca6ca70a7f400 (127.24.175.193). New cstate: current_term: 1 leader_uuid: "f0d61129793b4a4db94ca6ca70a7f400" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5db4ad0fdf84691b96c8e6080cd0fe8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 34429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0d61129793b4a4db94ca6ca70a7f400" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 45969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8255d43e28824a80bf7ffb7ad8d593a9" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 41361 } health_report { overall_health: UNKNOWN } } }
I20260811 16:40:01.374429 15906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:01.371773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36638 (local address 127.24.175.193:45969)
0811 16:40:01.371829 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:01.371831 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:01.371839 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:40:01.371934 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:01.371935 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:01.371953 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:01.372012 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:40:01.372158 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:01.372623 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:01.373689 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:01.373863 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:01.373904 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:01.374056 (+ 152us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:40:01.374195 (+ 139us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:40:01.374264 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 16:40:01.374312 (+ 48us) server_negotiation.cc:299] Negotiation successful
0811 16:40:01.374345 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 16:40:01.376430 15702 raft_consensus.cc:1261] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P d5db4ad0fdf84691b96c8e6080cd0fe8 [term 1 FOLLOWER]: Refusing update from remote peer f0d61129793b4a4db94ca6ca70a7f400: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:40:01.376447 15482 raft_consensus.cc:1261] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P 8255d43e28824a80bf7ffb7ad8d593a9 [term 1 FOLLOWER]: Refusing update from remote peer f0d61129793b4a4db94ca6ca70a7f400: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:40:01.376777 15925 consensus_queue.cc:1035] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P f0d61129793b4a4db94ca6ca70a7f400 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8255d43e28824a80bf7ffb7ad8d593a9" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 41361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:40:01.376919 15956 consensus_queue.cc:1035] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P f0d61129793b4a4db94ca6ca70a7f400 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5db4ad0fdf84691b96c8e6080cd0fe8" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 34429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:40:01.379935 15959 mvcc.cc:205] Tried to move back new op lower bound from 7317366380035280896 to 7317366379854430208. Current Snapshot: MvccSnapshot[applied={T|T < 7317366380035280896}]
I20260811 16:40:01.380100 15960 mvcc.cc:205] Tried to move back new op lower bound from 7317366380035280896 to 7317366379854430208. Current Snapshot: MvccSnapshot[applied={T|T < 7317366380035280896}]
I20260811 16:40:01.380146 15961 mvcc.cc:205] Tried to move back new op lower bound from 7317366380035280896 to 7317366379854430208. Current Snapshot: MvccSnapshot[applied={T|T < 7317366380035280896}]
I20260811 16:40:01.382457 14955 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44424:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:40:01.382545 14955 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44424:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:40:01.383279 14955 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4976c8c8cdc543fab0c5c64928e15d90: Sending DeleteTablet for 3 replicas of tablet 9f23c2762cc044dbb5f4a1c1b43d2c37
I20260811 16:40:01.383601 15200 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f23c2762cc044dbb5f4a1c1b43d2c37 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:40:01 UTC) from {username='kudu', principal='kudu/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:36634
I20260811 16:40:01.383705 15699 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f23c2762cc044dbb5f4a1c1b43d2c37 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:40:01 UTC) from {username='kudu', principal='kudu/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:42996
I20260811 16:40:01.383881 15446 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f23c2762cc044dbb5f4a1c1b43d2c37 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:40:01 UTC) from {username='kudu', principal='kudu/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:46100
I20260811 16:40:01.384001 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 15017
I20260811 16:40:01.390286 15981 tablet_replica.cc:330] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P d5db4ad0fdf84691b96c8e6080cd0fe8: stopping tablet replica
I20260811 16:40:01.390479 15981 raft_consensus.cc:2229] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P d5db4ad0fdf84691b96c8e6080cd0fe8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:40:01.390658 15981 raft_consensus.cc:2258] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P d5db4ad0fdf84691b96c8e6080cd0fe8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:40:01.391867 15981 ts_tablet_manager.cc:1905] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P d5db4ad0fdf84691b96c8e6080cd0fe8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:40:01.393719 15981 ts_tablet_manager.cc:1918] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P d5db4ad0fdf84691b96c8e6080cd0fe8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:40:01.393857 15981 log.cc:1196] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P d5db4ad0fdf84691b96c8e6080cd0fe8: Deleting WAL directory at /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-2/wal/wals/9f23c2762cc044dbb5f4a1c1b43d2c37
I20260811 16:40:01.394208 15981 ts_tablet_manager.cc:1939] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P d5db4ad0fdf84691b96c8e6080cd0fe8: Deleting consensus metadata
I20260811 16:40:01.394675 14924 catalog_manager.cc:4841] TS d5db4ad0fdf84691b96c8e6080cd0fe8 (127.24.175.195:34429): tablet 9f23c2762cc044dbb5f4a1c1b43d2c37 (table test-table [id=1fd40324067a4018b2e5a6847e5438b3]) successfully deleted
I20260811 16:40:01.395231 15985 tablet_replica.cc:330] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P 8255d43e28824a80bf7ffb7ad8d593a9: stopping tablet replica
I20260811 16:40:01.395393 15985 raft_consensus.cc:2229] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P 8255d43e28824a80bf7ffb7ad8d593a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:40:01.395555 15985 raft_consensus.cc:2258] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P 8255d43e28824a80bf7ffb7ad8d593a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:40:01.396466 15985 ts_tablet_manager.cc:1905] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P 8255d43e28824a80bf7ffb7ad8d593a9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:40:01.398362 15985 ts_tablet_manager.cc:1918] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P 8255d43e28824a80bf7ffb7ad8d593a9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:40:01.398433 15985 log.cc:1196] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P 8255d43e28824a80bf7ffb7ad8d593a9: Deleting WAL directory at /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466249441839-25279-0/minicluster-data/ts-1/wal/wals/9f23c2762cc044dbb5f4a1c1b43d2c37
I20260811 16:40:01.398671 15985 ts_tablet_manager.cc:1939] T 9f23c2762cc044dbb5f4a1c1b43d2c37 P 8255d43e28824a80bf7ffb7ad8d593a9: Deleting consensus metadata
I20260811 16:40:01.399706 14927 catalog_manager.cc:4841] TS 8255d43e28824a80bf7ffb7ad8d593a9 (127.24.175.194:41361): tablet 9f23c2762cc044dbb5f4a1c1b43d2c37 (table test-table [id=1fd40324067a4018b2e5a6847e5438b3]) successfully deleted
W20260811 16:40:01.405387 14924 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.24.175.193:45969 (error 108)
I20260811 16:40:01.405925 15900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:01.405818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.193:45969 (local address 127.0.0.1:36654)
0811 16:40:01.405857 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:01.405895 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.193:45969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
I20260811 16:40:01.406037 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 15328
W20260811 16:40:01.416216 14924 catalog_manager.cc:4584] TS f0d61129793b4a4db94ca6ca70a7f400 (127.24.175.193:45969): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9f23c2762cc044dbb5f4a1c1b43d2c37: Network error: Client connection negotiation failed: client connection to 127.24.175.193:45969: connect: Connection refused (error 111)
I20260811 16:40:01.420650 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 15568
I20260811 16:40:01.456243 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 14887
I20260811 16:40:01.469820 25279 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260811 16:40:01.816910 25279 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260811 16:40:01.817018 25279 mini_ranger.cc:66] Stopping Ranger...
I20260811 16:40:02.160787 25279 mini_ranger.cc:68] Stopped Ranger
2026-08-11 16:40:02.161 UTC [13298] LOG: received smart shutdown request
2026-08-11 16:40:02.165 UTC [13298] LOG: background worker "logical replication launcher" (PID 13315) exited with exit code 1
2026-08-11 16:40:02.165 UTC [13308] LOG: shutting down
2026-08-11 16:40:02.286 UTC [13298] LOG: database system is shut down
2026-08-11T16:40:02Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (47087 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:40:02 dist-test-slave-zj8q krb5kdc[16008](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:40:02 dist-test-slave-zj8q krb5kdc[16008](info): set up 2 sockets
Aug 11 16:40:02 dist-test-slave-zj8q krb5kdc[16008](info): commencing operation
krb5kdc: starting...
W20260811 16:40:03.560855 25279 mini_kdc.cc:121] Time spent starting KDC: real 1.155s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Aug 11 16:40:03 dist-test-slave-zj8q krb5kdc[16008](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466403, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:40:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:40:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab.
Entry for principal kudu/127.24.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab.
I20260811 16:40:03.678020 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:45215
--webserver_interface=127.24.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:37291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.175.254:45215,127.24.175.253:40525,127.24.175.252:39725
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:40:03.759161 16032 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:40:03.759361 16032 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:40:03.759392 16032 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:40:03.760505 16032 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:40:03.760553 16032 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:40:03.760571 16032 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:40:03.760588 16032 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:40:03.760602 16032 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:40:03.762065 16032 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:37291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.175.254:45215,127.24.175.253:40525,127.24.175.252:39725
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:45215
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16032
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:40:03.762337 16032 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:40:03.762547 16032 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 16:40:03.767235 16032 server_base.cc:1034] running on GCE node
W20260811 16:40:03.767242 16042 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:40:03.767359 16044 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:40:03.767277 16041 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:40:03.767762 16032 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:40:03.768018 16032 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:40:03.769156 16032 hybrid_clock.cc:648] HybridClock initialized: now 1786466403769143 us; error 31 us; skew 500 ppm
Aug 11 16:40:03 dist-test-slave-zj8q krb5kdc[16008](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466403, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:40:03.785846 16032 init.cc:377] Logged in from keytab as kudu/127.24.175.254@KRBTEST.COM (short username kudu)
I20260811 16:40:03.786345 16032 webserver.cc:460] Webserver started at http://127.24.175.254:39845/ using document root <none> and password file <none>
I20260811 16:40:03.786545 16032 fs_manager.cc:359] Metadata directory not provided
I20260811 16:40:03.786588 16032 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:40:03.786715 16032 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:40:03.787772 16032 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/minicluster-data/master-0/data/instance:
uuid: "e1e2a859d1a44107a3054a45ce993961"
format_stamp: "Formatted at 2026-08-11 16:40:03 on dist-test-slave-zj8q"
server_key: "7e8f0b876af72cb34be1857a2c276397"
server_key_iv: "a8f6854848ea4b342dcc2c15d39edf0c"
server_key_version: "encryptionkey@0"
I20260811 16:40:03.788106 16032 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/minicluster-data/master-0/wal/instance:
uuid: "e1e2a859d1a44107a3054a45ce993961"
format_stamp: "Formatted at 2026-08-11 16:40:03 on dist-test-slave-zj8q"
server_key: "7e8f0b876af72cb34be1857a2c276397"
server_key_iv: "a8f6854848ea4b342dcc2c15d39edf0c"
server_key_version: "encryptionkey@0"
I20260811 16:40:03.789309 16032 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:40:03.789933 16053 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:40:03.790083 16032 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:40:03.790189 16032 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/minicluster-data/master-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/minicluster-data/master-0/wal
uuid: "e1e2a859d1a44107a3054a45ce993961"
format_stamp: "Formatted at 2026-08-11 16:40:03 on dist-test-slave-zj8q"
server_key: "7e8f0b876af72cb34be1857a2c276397"
server_key_iv: "a8f6854848ea4b342dcc2c15d39edf0c"
server_key_version: "encryptionkey@0"
I20260811 16:40:03.790256 16032 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:40:03.804533 16032 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:40:03.806277 16032 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:40:03.806412 16032 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:40:03.810292 16032 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.254:45215
I20260811 16:40:03.810329 16148 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.254:45215 every 8 connection(s)
I20260811 16:40:03.810640 16032 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
I20260811 16:40:03.811503 16150 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:40:03.812323 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 16032
I20260811 16:40:03.812400 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/minicluster-data/master-0/wal/instance
I20260811 16:40:03.812575 25279 external_mini_cluster.cc:1428] Setting key 54a521ad40dd069961cbaf50060d49bd
I20260811 16:40:03.813210 16150 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.175.254" port: 45215 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 16:40:03 dist-test-slave-zj8q krb5kdc[16008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466403, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.254@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.24.175.253@KRBTEST.COM; defaulting to no policy
I20260811 16:40:03.822540 16158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:03.813909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:45215 (local address 127.0.0.1:46790)
0811 16:40:03.814084 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:03.814122 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 16:40:03.814665 (+ 543us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:40:03.814924 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:40:03.814926 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:40:03.815187 (+ 261us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:40:03.815344 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:03.815349 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:03.816330 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:03.816331 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:03.817068 (+ 737us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:03.817071 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:03.817632 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:03.817633 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:03.817703 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:03.818221 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:40:03.818232 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:40:03.819564 (+ 1332us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:40:03.821186 (+ 1622us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:40:03.821192 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:40:03.821194 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:40:03.821383 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:40:03.821603 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:40:03.821603 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:40:03.821604 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:40:03.821684 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:40:03.821992 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:40:03.821999 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:40:03.822063 (+ 64us) client_negotiation.cc:769] Sending connection context
0811 16:40:03.822144 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 16:40:03.822340 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":91,"threads_started":1}
I20260811 16:40:03.822544 16155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:03.813921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46790 (local address 127.24.175.254:45215)
0811 16:40:03.814088 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:03.814098 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:03.814224 (+ 126us) server_negotiation.cc:407] Connection header received
0811 16:40:03.814818 (+ 594us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:03.814820 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:03.814837 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:03.814911 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:40:03.815442 (+ 531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:03.816241 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:03.817142 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:03.817549 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:03.817647 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:03.819640 (+ 1993us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:40:03.819647 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:40:03.819648 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:40:03.819654 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:40:03.821110 (+ 1456us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:03.821458 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:03.821461 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:03.821461 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:03.821543 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:03.821731 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:03.821732 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:03.821732 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:03.821916 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:40:03.821974 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 16:40:03.822193 (+ 219us) server_negotiation.cc:299] Negotiation successful
0811 16:40:03.822421 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":77,"server-negotiator.queue_time_us":125,"thread_start_us":75,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.253@KRBTEST.COM" created.
I20260811 16:40:03.823290 16150 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.175.253" port: 40525 } has no permanent_uuid. Determining permanent_uuid...
I20260811 16:40:03.823606 16158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:03.823486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.253:40525 (local address 127.0.0.1:50516)
0811 16:40:03.823529 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:03.823582 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.253:40525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260811 16:40:03.823777 16059 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.24.175.253:40525: connect: Connection refused (error 111)
I20260811 16:40:03.824167 16158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:03.824081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.253:40525 (local address 127.0.0.1:50524)
0811 16:40:03.824118 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:03.824146 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.253:40525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260811 16:40:03.824270 16150 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.175.253:40525: Network error: Client connection negotiation failed: client connection to 127.24.175.253:40525: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.253.keytab.
Entry for principal kudu/127.24.175.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.253.keytab.
I20260811 16:40:03.836385 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.253:40525
--webserver_interface=127.24.175.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.253.keytab
--principal=kudu/127.24.175.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:37291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.175.254:45215,127.24.175.253:40525,127.24.175.252:39725
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 16:40:03.873503 16150 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.175.253" port: 40525 } attempt: 1
I20260811 16:40:03.873988 16158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:03.873856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.253:40525 (local address 127.0.0.1:50532)
0811 16:40:03.873917 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:03.873948 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.253:40525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260811 16:40:03.874353 16158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:03.874266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.253:40525 (local address 127.0.0.1:50548)
0811 16:40:03.874307 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:03.874331 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.253:40525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260811 16:40:03.874445 16150 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.175.253:40525: Network error: Client connection negotiation failed: client connection to 127.24.175.253:40525: connect: Connection refused (error 111)
W20260811 16:40:03.916690 16162 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:40:03.916886 16162 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:40:03.916915 16162 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:40:03.917986 16162 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:40:03.918022 16162 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:40:03.918041 16162 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:40:03.918056 16162 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:40:03.918071 16162 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:40:03.919510 16162 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:37291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.24.175.254:45215,127.24.175.253:40525,127.24.175.252:39725
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.253.keytab
--principal=kudu/127.24.175.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.253:40525
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.24.175.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16162
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:40:03.919746 16162 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:40:03.919936 16162 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:40:03.924631 16177 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:40:03.924672 16170 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:40:03.924723 16162 server_base.cc:1034] running on GCE node
W20260811 16:40:03.924671 16174 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:40:03.925027 16162 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:40:03.925276 16162 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:40:03.926407 16162 hybrid_clock.cc:648] HybridClock initialized: now 1786466403926390 us; error 33 us; skew 500 ppm
Aug 11 16:40:03 dist-test-slave-zj8q krb5kdc[16008](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466403, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:40:03.928730 16162 init.cc:377] Logged in from keytab as kudu/127.24.175.253@KRBTEST.COM (short username kudu)
I20260811 16:40:03.929101 16162 webserver.cc:460] Webserver started at http://127.24.175.253:43171/ using document root <none> and password file <none>
I20260811 16:40:03.929287 16162 fs_manager.cc:359] Metadata directory not provided
I20260811 16:40:03.929327 16162 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:40:03.929414 16162 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:40:03.930408 16162 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/minicluster-data/master-1/data/instance:
uuid: "0f54c6eb004242468f87c4fc0fdafda3"
format_stamp: "Formatted at 2026-08-11 16:40:03 on dist-test-slave-zj8q"
server_key: "cb06417592e0ab87c400cf6468c048e0"
server_key_iv: "5015c5088244f63731fe666d6fe69ce4"
server_key_version: "encryptionkey@0"
I20260811 16:40:03.930714 16162 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/minicluster-data/master-1/wal/instance:
uuid: "0f54c6eb004242468f87c4fc0fdafda3"
format_stamp: "Formatted at 2026-08-11 16:40:03 on dist-test-slave-zj8q"
server_key: "cb06417592e0ab87c400cf6468c048e0"
server_key_iv: "5015c5088244f63731fe666d6fe69ce4"
server_key_version: "encryptionkey@0"
I20260811 16:40:03.931838 16162 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:40:03.932466 16186 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:40:03.932667 16162 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:40:03.932742 16162 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/minicluster-data/master-1/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/minicluster-data/master-1/wal
uuid: "0f54c6eb004242468f87c4fc0fdafda3"
format_stamp: "Formatted at 2026-08-11 16:40:03 on dist-test-slave-zj8q"
server_key: "cb06417592e0ab87c400cf6468c048e0"
server_key_iv: "5015c5088244f63731fe666d6fe69ce4"
server_key_version: "encryptionkey@0"
I20260811 16:40:03.932801 16162 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:40:03.942572 16150 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.175.253" port: 40525 } attempt: 2
I20260811 16:40:03.942950 16158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:03.942825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.253:40525 (local address 127.0.0.1:50554)
0811 16:40:03.942881 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:03.942919 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.253:40525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260811 16:40:03.943221 16158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:03.943144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.253:40525 (local address 127.0.0.1:50558)
0811 16:40:03.943183 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:03.943205 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.253:40525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260811 16:40:03.943297 16150 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.175.253:40525: Network error: Client connection negotiation failed: client connection to 127.24.175.253:40525: connect: Connection refused (error 111)
I20260811 16:40:03.959815 16162 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:40:03.961486 16162 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:40:03.961596 16162 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:40:03.965453 16162 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.253:40525
I20260811 16:40:03.965494 16273 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.253:40525 every 8 connection(s)
I20260811 16:40:03.965833 16162 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/minicluster-data/master-1/data/info.pb
I20260811 16:40:03.966701 16276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:40:03.968315 16276 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.175.254" port: 45215 } has no permanent_uuid. Determining permanent_uuid...
I20260811 16:40:03.970835 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 16162
I20260811 16:40:03.970919 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/minicluster-data/master-1/wal/instance
I20260811 16:40:03.971088 25279 external_mini_cluster.cc:1428] Setting key e12c6b5fb8ca81adee2ae54e42ea62ca
Aug 11 16:40:03 dist-test-slave-zj8q krb5kdc[16008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466403, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.253@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:40:03.976773 16155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:03.968993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46802 (local address 127.24.175.254:45215)
0811 16:40:03.969050 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:03.969052 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:03.969241 (+ 189us) server_negotiation.cc:407] Connection header received
0811 16:40:03.969687 (+ 446us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:03.969689 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:03.969702 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:03.969753 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:40:03.970354 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:03.970847 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:03.971860 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:03.972068 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:03.972124 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:03.974130 (+ 2006us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:40:03.974132 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:40:03.974132 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:40:03.974139 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:40:03.975417 (+ 1278us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:03.975892 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:03.975892 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:03.975893 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:03.975940 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:03.976195 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:03.976196 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:03.976196 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:03.976289 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:40:03.976331 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0811 16:40:03.976645 (+ 314us) server_negotiation.cc:299] Negotiation successful
0811 16:40:03.976706 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 16:40:03.977041 16278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:03.968965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:45215 (local address 127.0.0.1:46802)
0811 16:40:03.969119 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:03.969153 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 16:40:03.969596 (+ 443us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:40:03.969820 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:40:03.969823 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:40:03.970053 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:40:03.970272 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:03.970277 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:03.970959 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:03.970960 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:03.971776 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:03.971779 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:03.972135 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:03.972136 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:03.972259 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:03.972704 (+ 445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:40:03.972713 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:40:03.974043 (+ 1330us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:40:03.975501 (+ 1458us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:40:03.975510 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:40:03.975512 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:40:03.975822 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:40:03.975997 (+ 175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:40:03.975997 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:40:03.975998 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:40:03.976138 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:40:03.976341 (+ 203us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:40:03.976348 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:40:03.976517 (+ 169us) client_negotiation.cc:769] Sending connection context
0811 16:40:03.976638 (+ 121us) client_negotiation.cc:240] Negotiation successful
0811 16:40:03.976817 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":69,"threads_started":1}
I20260811 16:40:03.977593 16276 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.175.253" port: 40525 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.24.175.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.252@KRBTEST.COM" created.
Aug 11 16:40:03 dist-test-slave-zj8q krb5kdc[16008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466403, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.253@KRBTEST.COM for kudu/127.24.175.253@KRBTEST.COM
I20260811 16:40:03.985383 16278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:03.977820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.253:40525 (local address 127.0.0.1:50574)
0811 16:40:03.977869 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:03.977881 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:40:03.977924 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:40:03.978135 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:40:03.978136 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:40:03.978294 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:40:03.978350 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:03.978352 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:03.979148 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:03.979149 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:03.979880 (+ 731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:03.979883 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:03.980299 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:03.980300 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:03.980363 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:03.980725 (+ 362us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:40:03.980729 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:40:03.982784 (+ 2055us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:40:03.984437 (+ 1653us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:40:03.984439 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:40:03.984439 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:40:03.984644 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:40:03.984845 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:40:03.984845 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:40:03.984846 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:40:03.984896 (+ 50us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:40:03.985166 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:40:03.985166 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:40:03.985198 (+ 32us) client_negotiation.cc:769] Sending connection context
0811 16:40:03.985253 (+ 55us) client_negotiation.cc:240] Negotiation successful
0811 16:40:03.985325 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260811 16:40:03.985488 16281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:03.977875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50574 (local address 127.24.175.253:40525)
0811 16:40:03.978005 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:03.978010 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:03.978028 (+ 18us) server_negotiation.cc:407] Connection header received
0811 16:40:03.978048 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:03.978050 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:03.978060 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:03.978117 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:40:03.978416 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:03.979064 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:03.979946 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:03.980231 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:03.980282 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:03.982864 (+ 2582us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:40:03.982873 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:40:03.982873 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:40:03.982881 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:40:03.984338 (+ 1457us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:03.984726 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:03.984729 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:03.984729 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:03.984788 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:03.984943 (+ 155us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:03.984943 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:03.984944 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:03.985109 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:40:03.985194 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 16:40:03.985288 (+ 94us) server_negotiation.cc:299] Negotiation successful
0811 16:40:03.985388 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":21,"server-negotiator.queue_time_us":103,"thread_start_us":68,"threads_started":1}
I20260811 16:40:03.986068 16276 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.175.252" port: 39725 } has no permanent_uuid. Determining permanent_uuid...
I20260811 16:40:03.986404 16278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:03.986303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.252:39725 (local address 127.0.0.1:57032)
0811 16:40:03.986343 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:03.986385 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.252:39725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260811 16:40:03.986521 16191 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.24.175.252:39725: connect: Connection refused (error 111)
I20260811 16:40:03.986898 16278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:03.986814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.252:39725 (local address 127.0.0.1:57036)
0811 16:40:03.986854 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:03.986877 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.252:39725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260811 16:40:03.986989 16276 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.175.252:39725: Network error: Client connection negotiation failed: client connection to 127.24.175.252:39725: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.252.keytab.
Entry for principal kudu/127.24.175.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.252.keytab.
I20260811 16:40:03.996088 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.252:39725
--webserver_interface=127.24.175.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.252.keytab
--principal=kudu/127.24.175.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:37291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.175.254:45215,127.24.175.253:40525,127.24.175.252:39725
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 16:40:04.034443 16150 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.175.253" port: 40525 } attempt: 3
I20260811 16:40:04.036166 16276 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.175.252" port: 39725 } attempt: 1
I20260811 16:40:04.036507 16278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:04.036404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.252:39725 (local address 127.0.0.1:57052)
0811 16:40:04.036447 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:04.036478 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.252:39725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260811 16:40:04.036865 16278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:04.036779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.252:39725 (local address 127.0.0.1:57056)
0811 16:40:04.036815 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:04.036839 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.252:39725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260811 16:40:04.036980 16276 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.175.252:39725: Network error: Client connection negotiation failed: client connection to 127.24.175.252:39725: connect: Connection refused (error 111)
Aug 11 16:40:04 dist-test-slave-zj8q krb5kdc[16008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466403, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.254@KRBTEST.COM for kudu/127.24.175.253@KRBTEST.COM
I20260811 16:40:04.041706 16281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:04.034863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50586 (local address 127.24.175.253:40525)
0811 16:40:04.034918 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:04.034920 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:04.034930 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:40:04.035011 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:04.035012 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:04.035022 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:04.035098 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:40:04.035466 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:04.036037 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:04.037036 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:04.037361 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:04.037424 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:04.039351 (+ 1927us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:40:04.039353 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:40:04.039353 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:40:04.039359 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:40:04.040728 (+ 1369us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:04.041099 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:04.041100 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:04.041100 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:04.041148 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:04.041316 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:04.041316 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:04.041316 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:04.041412 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:40:04.041456 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 16:40:04.041596 (+ 140us) server_negotiation.cc:299] Negotiation successful
0811 16:40:04.041652 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 16:40:04.041785 16158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:04.034792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.253:40525 (local address 127.0.0.1:50586)
0811 16:40:04.034861 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:04.034878 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 16:40:04.034945 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:40:04.035114 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:40:04.035115 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:40:04.035312 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:40:04.035392 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:04.035394 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:04.036108 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:04.036109 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:04.036934 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:04.036937 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:04.037448 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:04.037449 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:04.037531 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:04.037933 (+ 402us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:40:04.037938 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:40:04.039266 (+ 1328us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:40:04.040807 (+ 1541us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:40:04.040808 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:40:04.040809 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:40:04.041033 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:40:04.041200 (+ 167us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:40:04.041200 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:40:04.041201 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:40:04.041265 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:40:04.041461 (+ 196us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:40:04.041462 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:40:04.041510 (+ 48us) client_negotiation.cc:769] Sending connection context
0811 16:40:04.041581 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 16:40:04.041689 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260811 16:40:04.042229 16150 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.175.252" port: 39725 } has no permanent_uuid. Determining permanent_uuid...
I20260811 16:40:04.042551 16158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:04.042441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.252:39725 (local address 127.0.0.1:57062)
0811 16:40:04.042487 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:04.042523 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.252:39725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260811 16:40:04.042874 16158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:04.042794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.252:39725 (local address 127.0.0.1:57068)
0811 16:40:04.042829 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:04.042855 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.252:39725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260811 16:40:04.042963 16150 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.175.252:39725: Network error: Client connection negotiation failed: client connection to 127.24.175.252:39725: connect: Connection refused (error 111)
I20260811 16:40:04.074111 16150 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.175.252" port: 39725 } attempt: 1
I20260811 16:40:04.074596 16158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:04.074459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.252:39725 (local address 127.0.0.1:57076)
0811 16:40:04.074520 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:04.074562 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.252:39725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260811 16:40:04.074950 16158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:04.074868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.252:39725 (local address 127.0.0.1:57084)
0811 16:40:04.074908 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:04.074932 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.252:39725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260811 16:40:04.075043 16150 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.175.252:39725: Network error: Client connection negotiation failed: client connection to 127.24.175.252:39725: connect: Connection refused (error 111)
W20260811 16:40:04.081432 16285 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:40:04.081614 16285 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:40:04.081633 16285 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:40:04.082760 16285 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:40:04.082801 16285 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:40:04.082815 16285 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:40:04.082826 16285 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:40:04.082840 16285 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:40:04.084271 16285 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:37291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.24.175.254:45215,127.24.175.253:40525,127.24.175.252:39725
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.252.keytab
--principal=kudu/127.24.175.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.252:39725
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.24.175.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16285
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:40:04.084461 16285 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:40:04.084628 16285 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:40:04.089272 16294 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:40:04.089264 16295 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:40:04.089263 16298 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:40:04.089308 16285 server_base.cc:1034] running on GCE node
I20260811 16:40:04.089696 16285 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:40:04.089958 16285 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:40:04.091091 16285 hybrid_clock.cc:648] HybridClock initialized: now 1786466404091077 us; error 26 us; skew 500 ppm
Aug 11 16:40:04 dist-test-slave-zj8q krb5kdc[16008](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466404, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:40:04.093528 16285 init.cc:377] Logged in from keytab as kudu/127.24.175.252@KRBTEST.COM (short username kudu)
I20260811 16:40:04.094090 16285 webserver.cc:460] Webserver started at http://127.24.175.252:35013/ using document root <none> and password file <none>
I20260811 16:40:04.094393 16285 fs_manager.cc:359] Metadata directory not provided
I20260811 16:40:04.094455 16285 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:40:04.094583 16285 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:40:04.095923 16285 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/minicluster-data/master-2/data/instance:
uuid: "bdad2279508a4133a93a59e755884fb1"
format_stamp: "Formatted at 2026-08-11 16:40:04 on dist-test-slave-zj8q"
server_key: "f273a3146885974fe3fc9f904582d281"
server_key_iv: "b479d8d95f8ecb2e780553b2f379e5f8"
server_key_version: "encryptionkey@0"
I20260811 16:40:04.096354 16285 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/minicluster-data/master-2/wal/instance:
uuid: "bdad2279508a4133a93a59e755884fb1"
format_stamp: "Formatted at 2026-08-11 16:40:04 on dist-test-slave-zj8q"
server_key: "f273a3146885974fe3fc9f904582d281"
server_key_iv: "b479d8d95f8ecb2e780553b2f379e5f8"
server_key_version: "encryptionkey@0"
I20260811 16:40:04.098047 16285 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260811 16:40:04.098955 16309 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:40:04.099148 16285 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:40:04.099236 16285 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/minicluster-data/master-2/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/minicluster-data/master-2/wal
uuid: "bdad2279508a4133a93a59e755884fb1"
format_stamp: "Formatted at 2026-08-11 16:40:04 on dist-test-slave-zj8q"
server_key: "f273a3146885974fe3fc9f904582d281"
server_key_iv: "b479d8d95f8ecb2e780553b2f379e5f8"
server_key_version: "encryptionkey@0"
I20260811 16:40:04.099308 16285 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:40:04.105116 16276 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.175.252" port: 39725 } attempt: 2
I20260811 16:40:04.105579 16278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:04.105419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.252:39725 (local address 127.0.0.1:57100)
0811 16:40:04.105485 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:04.105542 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.252:39725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260811 16:40:04.105984 16278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:04.105879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.252:39725 (local address 127.0.0.1:57104)
0811 16:40:04.105915 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:04.105957 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.252:39725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
W20260811 16:40:04.106398 16276 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.175.252:39725: Network error: Client connection negotiation failed: client connection to 127.24.175.252:39725: connect: Connection refused (error 111)
I20260811 16:40:04.112310 16285 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:40:04.115489 16285 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:40:04.115634 16285 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:40:04.119979 16285 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.252:39725
I20260811 16:40:04.120019 16400 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.252:39725 every 8 connection(s)
I20260811 16:40:04.120412 16285 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/minicluster-data/master-2/data/info.pb
I20260811 16:40:04.121492 16401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:40:04.124109 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 16285
I20260811 16:40:04.124195 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466249441839-25279-0/minicluster-data/master-2/wal/instance
I20260811 16:40:04.124369 25279 external_mini_cluster.cc:1428] Setting key d859893e42afbd65c9d6b5ba6fa8f8ab
I20260811 16:40:04.124272 16401 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.175.254" port: 45215 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 16:40:04 dist-test-slave-zj8q krb5kdc[16008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466404, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.252@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
Aug 11 16:40:04 dist-test-slave-zj8q krb5kdc[16008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466403, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.175.252@KRBTEST.COM
I20260811 16:40:04.136212 16407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:04.125740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57112 (local address 127.24.175.252:39725)
0811 16:40:04.125872 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:04.125877 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:04.125910 (+ 33us) server_negotiation.cc:407] Connection header received
0811 16:40:04.126389 (+ 479us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:04.126404 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:04.126434 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:04.127206 (+ 772us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:40:04.127273 (+ 67us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:04.128452 (+ 1179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:04.129160 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:04.129653 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:04.129746 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:04.132705 (+ 2959us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:40:04.132711 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:40:04.132712 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:40:04.132718 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:40:04.134433 (+ 1715us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:04.134731 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:04.134734 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:04.134735 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:04.134831 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:04.135021 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:04.135022 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:04.135022 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:04.135289 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:40:04.135438 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0811 16:40:04.135834 (+ 396us) server_negotiation.cc:299] Negotiation successful
0811 16:40:04.135992 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104,"thread_start_us":79,"threads_started":1}
I20260811 16:40:04.136857 16406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:04.125211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:45215 (local address 127.0.0.1:46814)
0811 16:40:04.125786 (+ 575us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:04.125824 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 16:40:04.126382 (+ 558us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:40:04.126560 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:40:04.126565 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:40:04.126864 (+ 299us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:40:04.127159 (+ 295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:04.127166 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:04.128041 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:04.128042 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:04.129157 (+ 1115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:04.129161 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:04.129627 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:04.129628 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:04.129746 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:04.130429 (+ 683us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:40:04.130440 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:40:04.132630 (+ 2190us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:40:04.135432 (+ 2802us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:40:04.135441 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:40:04.135443 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:40:04.135713 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:40:04.135977 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:40:04.135978 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:40:04.135978 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:40:04.136049 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:40:04.136513 (+ 464us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:40:04.136520 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:40:04.136572 (+ 52us) client_negotiation.cc:769] Sending connection context
0811 16:40:04.136652 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 16:40:04.136757 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":531,"thread_start_us":397,"threads_started":1}
I20260811 16:40:04.136871 16155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:04.125665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46814 (local address 127.24.175.254:45215)
0811 16:40:04.125712 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:04.125714 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:04.125933 (+ 219us) server_negotiation.cc:407] Connection header received
0811 16:40:04.126479 (+ 546us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:04.126480 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:04.126494 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:04.126543 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:40:04.127277 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:04.127927 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:04.129256 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:04.129542 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:04.129607 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:04.132738 (+ 3131us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:40:04.132740 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:40:04.132740 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:40:04.132749 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:40:04.135313 (+ 2564us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:04.135833 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:04.135835 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:04.135835 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:04.135902 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:04.136111 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:04.136112 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:04.136112 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:04.136265 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:40:04.136487 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0811 16:40:04.136698 (+ 211us) server_negotiation.cc:299] Negotiation successful
0811 16:40:04.136790 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 16:40:04.137565 16401 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.175.253" port: 40525 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 16:40:04 dist-test-slave-zj8q krb5kdc[16008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466403, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
Aug 11 16:40:04 dist-test-slave-zj8q krb5kdc[16008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466404, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.252@KRBTEST.COM for kudu/127.24.175.253@KRBTEST.COM
I20260811 16:40:04.144903 16155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:04.137119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46824 (local address 127.24.175.254:45215)
0811 16:40:04.137165 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:04.137166 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:04.137176 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:40:04.137234 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:04.137235 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:04.137245 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:04.137290 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:40:04.137902 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:04.138776 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:04.139539 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:04.139819 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:04.139892 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:04.142314 (+ 2422us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:40:04.142315 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:40:04.142316 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:40:04.142323 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:40:04.143897 (+ 1574us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:04.144205 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:04.144206 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:04.144206 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:04.144262 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:04.144423 (+ 161us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:04.144424 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:04.144425 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:04.144528 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:40:04.144696 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0811 16:40:04.144741 (+ 45us) server_negotiation.cc:299] Negotiation successful
0811 16:40:04.144817 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 16:40:04.145925 16281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:04.137911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50594 (local address 127.24.175.253:40525)
0811 16:40:04.137954 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:04.137956 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:04.137963 (+ 7us) server_negotiation.cc:407] Connection header received
0811 16:40:04.137985 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:04.137986 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:04.137995 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:04.138041 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:40:04.138383 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:04.139097 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:04.140051 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:04.140356 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:04.140417 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:04.142918 (+ 2501us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:40:04.142920 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:40:04.142920 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:40:04.142927 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:40:04.144567 (+ 1640us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:04.144977 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:04.144979 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:04.144979 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:04.145039 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:04.145252 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:04.145253 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:04.145253 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:04.145392 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:40:04.145455 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 16:40:04.145771 (+ 316us) server_negotiation.cc:299] Negotiation successful
0811 16:40:04.145840 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 16:40:04.145925 16406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:04.137848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.253:40525 (local address 127.0.0.1:50594)
0811 16:40:04.137893 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:04.137901 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 16:40:04.137935 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:40:04.138055 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:40:04.138056 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:40:04.138221 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:40:04.138283 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:04.138285 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:04.139198 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:04.139199 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:04.139956 (+ 757us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:04.139958 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:04.140469 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:04.140470 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:04.140544 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:04.140902 (+ 358us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:40:04.140907 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:40:04.142807 (+ 1900us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:40:04.144676 (+ 1869us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:40:04.144677 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:40:04.144678 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:40:04.144885 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:40:04.145114 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:40:04.145115 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:40:04.145115 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:40:04.145175 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:40:04.145483 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:40:04.145484 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:40:04.145538 (+ 54us) client_negotiation.cc:769] Sending connection context
0811 16:40:04.145741 (+ 203us) client_negotiation.cc:240] Negotiation successful
0811 16:40:04.145835 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260811 16:40:04.146443 16401 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.175.252" port: 39725 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 16:40:04 dist-test-slave-zj8q krb5kdc[16008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466403, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.175.253@KRBTEST.COM
I20260811 16:40:04.150209 16150 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.175.252" port: 39725 } attempt: 2
Aug 11 16:40:04 dist-test-slave-zj8q krb5kdc[16008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466404, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.252@KRBTEST.COM for kudu/127.24.175.252@KRBTEST.COM
I20260811 16:40:04.153348 16409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:04.145590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50604 (local address 127.24.175.253:40525)
0811 16:40:04.145750 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:04.145752 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:04.145761 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:40:04.145781 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:04.145782 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:04.145793 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:04.145864 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:40:04.146509 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:04.147236 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:04.147840 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:04.148149 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:04.148204 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:04.150560 (+ 2356us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:40:04.150562 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:40:04.150562 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:40:04.150569 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:40:04.152204 (+ 1635us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:04.152577 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:04.152578 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:04.152578 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:04.152663 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:04.152840 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:04.152841 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:04.152841 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:04.152949 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:40:04.153120 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0811 16:40:04.153157 (+ 37us) server_negotiation.cc:299] Negotiation successful
0811 16:40:04.153230 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":89,"threads_started":1}
I20260811 16:40:04.154469 16406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:04.146689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.252:39725 (local address 127.0.0.1:57124)
0811 16:40:04.146786 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:04.146795 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:40:04.146829 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:40:04.146966 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:40:04.146967 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:40:04.147102 (+ 135us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:40:04.147134 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:04.147135 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:04.147985 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:04.147985 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:04.148684 (+ 699us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:04.148687 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:04.149154 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:04.149154 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:04.149210 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:04.149585 (+ 375us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:40:04.149590 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:40:04.151040 (+ 1450us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:40:04.153436 (+ 2396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:40:04.153437 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:40:04.153438 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:40:04.153633 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:40:04.153842 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:40:04.153843 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:40:04.153843 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:40:04.153888 (+ 45us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:40:04.154112 (+ 224us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:40:04.154113 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:40:04.154186 (+ 73us) client_negotiation.cc:769] Sending connection context
0811 16:40:04.154258 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 16:40:04.154355 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":84}
Aug 11 16:40:04 dist-test-slave-zj8q krb5kdc[16008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466403, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.254@KRBTEST.COM for kudu/127.24.175.252@KRBTEST.COM
I20260811 16:40:04.154616 16407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:04.146754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57124 (local address 127.24.175.252:39725)
0811 16:40:04.146803 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:04.146804 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:04.146816 (+ 12us) server_negotiation.cc:407] Connection header received
0811 16:40:04.146891 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:04.146892 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:04.146900 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:04.146937 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:40:04.147206 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:04.147902 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:04.148769 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:04.149073 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:04.149146 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:04.151117 (+ 1971us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:40:04.151118 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:40:04.151118 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:40:04.151125 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:40:04.153200 (+ 2075us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:04.153726 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:04.153727 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:04.153728 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:04.153780 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:04.153923 (+ 143us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:04.153924 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:04.153924 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:04.154038 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:40:04.154099 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 16:40:04.154298 (+ 199us) server_negotiation.cc:299] Negotiation successful
0811 16:40:04.154416 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":37,"server-negotiator.queue_time_us":30}
I20260811 16:40:04.155051 25279 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:40:04.156723 16401 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bdad2279508a4133a93a59e755884fb1: Bootstrap starting.
I20260811 16:40:04.157544 16401 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bdad2279508a4133a93a59e755884fb1: Neither blocks nor log segments found. Creating new log.
I20260811 16:40:04.157850 16401 log.cc:824] T 00000000000000000000000000000000 P bdad2279508a4133a93a59e755884fb1: Log is configured to *not* fsync() on all Append() calls
I20260811 16:40:04.159977 16158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:04.150461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.252:39725 (local address 127.0.0.1:57140)
0811 16:40:04.150505 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:04.150514 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:40:04.150544 (+ 30us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:40:04.151006 (+ 462us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:40:04.151007 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:40:04.151165 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:40:04.151199 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:04.151201 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:04.151812 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:04.151813 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:04.152282 (+ 469us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:04.152283 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:04.152637 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:04.152638 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:04.152703 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:04.153536 (+ 833us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:40:04.153542 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:40:04.154864 (+ 1322us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:40:04.158892 (+ 4028us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:40:04.158893 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:40:04.158894 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:40:04.159112 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:40:04.159342 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:40:04.159343 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:40:04.159343 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:40:04.159402 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:40:04.159688 (+ 286us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:40:04.159689 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:40:04.159732 (+ 43us) client_negotiation.cc:769] Sending connection context
0811 16:40:04.159790 (+ 58us) client_negotiation.cc:240] Negotiation successful
0811 16:40:04.159879 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260811 16:40:04.160655 16401 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bdad2279508a4133a93a59e755884fb1: No bootstrap required, opened a new log
I20260811 16:40:04.160892 16412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:04.150705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57140 (local address 127.24.175.252:39725)
0811 16:40:04.150860 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:04.150862 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:04.150870 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:40:04.150888 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:04.150888 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:04.150897 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:04.151252 (+ 355us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:40:04.151286 (+ 34us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:04.151738 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:04.152350 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:04.152573 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:04.152636 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:04.154940 (+ 2304us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:40:04.154942 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:40:04.154942 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:40:04.154949 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:40:04.158814 (+ 3865us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:04.159195 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:04.159196 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:04.159197 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:04.159271 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:04.159459 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:04.159460 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:04.159460 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:04.159607 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:40:04.159663 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 16:40:04.160706 (+ 1043us) server_negotiation.cc:299] Negotiation successful
0811 16:40:04.160778 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":97,"threads_started":1}
I20260811 16:40:04.162909 16401 raft_consensus.cc:348] T 00000000000000000000000000000000 P bdad2279508a4133a93a59e755884fb1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e2a859d1a44107a3054a45ce993961" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 45215 } } peers { permanent_uuid: "0f54c6eb004242468f87c4fc0fdafda3" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 40525 } } peers { permanent_uuid: "bdad2279508a4133a93a59e755884fb1" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 39725 } }
I20260811 16:40:04.163072 16401 raft_consensus.cc:374] T 00000000000000000000000000000000 P bdad2279508a4133a93a59e755884fb1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:40:04.163108 16401 raft_consensus.cc:729] T 00000000000000000000000000000000 P bdad2279508a4133a93a59e755884fb1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdad2279508a4133a93a59e755884fb1, State: Initialized, Role: FOLLOWER
I20260811 16:40:04.163245 16401 consensus_queue.cc:260] T 00000000000000000000000000000000 P bdad2279508a4133a93a59e755884fb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e2a859d1a44107a3054a45ce993961" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 45215 } } peers { permanent_uuid: "0f54c6eb004242468f87c4fc0fdafda3" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 40525 } } peers { permanent_uuid: "bdad2279508a4133a93a59e755884fb1" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 39725 } }
I20260811 16:40:04.163573 16401 sys_catalog.cc:564] T 00000000000000000000000000000000 P bdad2279508a4133a93a59e755884fb1 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:40:04.163785 16150 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1e2a859d1a44107a3054a45ce993961: Bootstrap starting.
I20260811 16:40:04.165307 16150 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e1e2a859d1a44107a3054a45ce993961: Neither blocks nor log segments found. Creating new log.
I20260811 16:40:04.165668 16150 log.cc:824] T 00000000000000000000000000000000 P e1e2a859d1a44107a3054a45ce993961: Log is configured to *not* fsync() on all Append() calls
I20260811 16:40:04.165776 16407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:04.156552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57144 (local address 127.24.175.252:39725)
0811 16:40:04.156584 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:04.156585 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:04.156893 (+ 308us) server_negotiation.cc:407] Connection header received
0811 16:40:04.156975 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:04.156976 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:04.156985 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:04.157010 (+ 25us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:40:04.157735 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:04.158415 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:04.159389 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:04.159692 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:04.159733 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:04.161742 (+ 2009us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:40:04.161743 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:40:04.161743 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:40:04.161750 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:40:04.164410 (+ 2660us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:04.164812 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:04.164814 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:04.164814 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:04.164878 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:04.165093 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:04.165094 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:04.165094 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:04.165217 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:40:04.165274 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 16:40:04.165604 (+ 330us) server_negotiation.cc:299] Negotiation successful
0811 16:40:04.165696 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260811 16:40:04.167126 16155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:04.156356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46834 (local address 127.24.175.254:45215)
0811 16:40:04.156396 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:04.156398 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:04.156586 (+ 188us) server_negotiation.cc:407] Connection header received
0811 16:40:04.156667 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:04.156668 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:04.156679 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:04.156740 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:40:04.157396 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:04.158070 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:04.159701 (+ 1631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:04.159976 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:04.160014 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:04.162585 (+ 2571us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:40:04.162586 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:40:04.162586 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:40:04.162593 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:40:04.164032 (+ 1439us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:04.165711 (+ 1679us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:04.165713 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:04.165713 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:04.165781 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:04.166001 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:04.166001 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:04.166002 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:04.166600 (+ 598us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:40:04.166686 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 16:40:04.166957 (+ 271us) server_negotiation.cc:299] Negotiation successful
0811 16:40:04.167044 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 16:40:04.167980 16150 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1e2a859d1a44107a3054a45ce993961: No bootstrap required, opened a new log
I20260811 16:40:04.168299 16409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:04.156433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50612 (local address 127.24.175.253:40525)
0811 16:40:04.156469 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:04.156471 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:04.156700 (+ 229us) server_negotiation.cc:407] Connection header received
0811 16:40:04.156762 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:04.156763 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:04.156773 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:04.156816 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:40:04.157499 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:04.158356 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:04.159389 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:04.159708 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:04.159742 (+ 34us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:04.161603 (+ 1861us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:40:04.161604 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:40:04.161605 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:40:04.161612 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:40:04.163298 (+ 1686us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:04.167332 (+ 4034us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:04.167334 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:04.167334 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:04.167400 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:04.167597 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:04.167598 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:04.167598 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:04.167749 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:40:04.167828 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 16:40:04.168119 (+ 291us) server_negotiation.cc:299] Negotiation successful
0811 16:40:04.168215 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
W20260811 16:40:04.169028 16458 catalog_manager.cc:1558] T 00000000000000000000000000000000 P bdad2279508a4133a93a59e755884fb1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 16:40:04.169087 16458 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 16:40:04.169178 16435 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdad2279508a4133a93a59e755884fb1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e2a859d1a44107a3054a45ce993961" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 45215 } } peers { permanent_uuid: "0f54c6eb004242468f87c4fc0fdafda3" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 40525 } } peers { permanent_uuid: "bdad2279508a4133a93a59e755884fb1" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 39725 } } }
I20260811 16:40:04.169245 16435 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdad2279508a4133a93a59e755884fb1 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:40:04.166610 16285 master_runner.cc:186] Error getting master registration for 127.24.175.254:45215: OK, instance_id { permanent_uuid: "e1e2a859d1a44107a3054a45ce993961" instance_seqno: 1786466403809194 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 16:40:04.169552 16285 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 16:40:04.170455 16150 raft_consensus.cc:348] T 00000000000000000000000000000000 P e1e2a859d1a44107a3054a45ce993961 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e2a859d1a44107a3054a45ce993961" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 45215 } } peers { permanent_uuid: "0f54c6eb004242468f87c4fc0fdafda3" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 40525 } } peers { permanent_uuid: "bdad2279508a4133a93a59e755884fb1" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 39725 } }
I20260811 16:40:04.170611 16150 raft_consensus.cc:374] T 00000000000000000000000000000000 P e1e2a859d1a44107a3054a45ce993961 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:40:04.170650 16150 raft_consensus.cc:729] T 00000000000000000000000000000000 P e1e2a859d1a44107a3054a45ce993961 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1e2a859d1a44107a3054a45ce993961, State: Initialized, Role: FOLLOWER
I20260811 16:40:04.170791 16150 consensus_queue.cc:260] T 00000000000000000000000000000000 P e1e2a859d1a44107a3054a45ce993961 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e2a859d1a44107a3054a45ce993961" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 45215 } } peers { permanent_uuid: "0f54c6eb004242468f87c4fc0fdafda3" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 40525 } } peers { permanent_uuid: "bdad2279508a4133a93a59e755884fb1" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 39725 } }
I20260811 16:40:04.171093 16462 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1e2a859d1a44107a3054a45ce993961 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e2a859d1a44107a3054a45ce993961" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 45215 } } peers { permanent_uuid: "0f54c6eb004242468f87c4fc0fdafda3" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 40525 } } peers { permanent_uuid: "bdad2279508a4133a93a59e755884fb1" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 39725 } } }
I20260811 16:40:04.171161 16150 sys_catalog.cc:564] T 00000000000000000000000000000000 P e1e2a859d1a44107a3054a45ce993961 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:40:04.171192 16462 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1e2a859d1a44107a3054a45ce993961 [sys.catalog]: This master's current role is: FOLLOWER
W20260811 16:40:04.173022 16486 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e1e2a859d1a44107a3054a45ce993961: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 16:40:04.173084 16486 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 16:40:04.173779 16032 master_runner.cc:186] Error getting master registration for 127.24.175.253:40525: OK, instance_id { permanent_uuid: "0f54c6eb004242468f87c4fc0fdafda3" instance_seqno: 1786466403964409 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 16:40:04.176714 16032 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 16:40:04.197568 16276 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.175.252" port: 39725 } attempt: 3
Aug 11 16:40:04 dist-test-slave-zj8q krb5kdc[16008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466403, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.253@KRBTEST.COM for kudu/127.24.175.252@KRBTEST.COM
I20260811 16:40:04.205864 16278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:04.197876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.252:39725 (local address 127.0.0.1:57156)
0811 16:40:04.197963 (+ 87us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:04.197975 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:40:04.198013 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:40:04.198288 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:40:04.198290 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:40:04.198491 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:40:04.198543 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:04.198546 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:04.199473 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:04.199474 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:04.200283 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:04.200286 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:04.200748 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:04.200749 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:04.200810 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:04.201311 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:40:04.201317 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:40:04.202925 (+ 1608us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:40:04.204754 (+ 1829us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:40:04.204756 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:40:04.204756 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:40:04.204980 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:40:04.205198 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:40:04.205199 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:40:04.205199 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:40:04.205267 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:40:04.205514 (+ 247us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:40:04.205514 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:40:04.205574 (+ 60us) client_negotiation.cc:769] Sending connection context
0811 16:40:04.205659 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 16:40:04.205761 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":69}
I20260811 16:40:04.206262 16407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:04.198080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57156 (local address 127.24.175.252:39725)
0811 16:40:04.198120 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:04.198122 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:04.198128 (+ 6us) server_negotiation.cc:407] Connection header received
0811 16:40:04.198175 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:04.198176 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:04.198186 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:04.198233 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:40:04.198627 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:04.199389 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:04.200367 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:04.200674 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:04.200744 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:04.203010 (+ 2266us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:40:04.203011 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:40:04.203012 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:40:04.203020 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:40:04.204668 (+ 1648us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:04.205054 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:04.205055 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:04.205055 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:04.205133 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:04.205323 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:04.205324 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:04.205324 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:04.205455 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:40:04.205518 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 16:40:04.206051 (+ 533us) server_negotiation.cc:299] Negotiation successful
0811 16:40:04.206130 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 16:40:04.207916 16276 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f54c6eb004242468f87c4fc0fdafda3: Bootstrap starting.
I20260811 16:40:04.208690 16276 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0f54c6eb004242468f87c4fc0fdafda3: Neither blocks nor log segments found. Creating new log.
I20260811 16:40:04.209007 16276 log.cc:824] T 00000000000000000000000000000000 P 0f54c6eb004242468f87c4fc0fdafda3: Log is configured to *not* fsync() on all Append() calls
I20260811 16:40:04.209950 16276 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f54c6eb004242468f87c4fc0fdafda3: No bootstrap required, opened a new log
I20260811 16:40:04.212019 16276 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0f54c6eb004242468f87c4fc0fdafda3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e2a859d1a44107a3054a45ce993961" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 45215 } } peers { permanent_uuid: "0f54c6eb004242468f87c4fc0fdafda3" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 40525 } } peers { permanent_uuid: "bdad2279508a4133a93a59e755884fb1" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 39725 } }
I20260811 16:40:04.212175 16276 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0f54c6eb004242468f87c4fc0fdafda3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:40:04.212217 16276 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0f54c6eb004242468f87c4fc0fdafda3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f54c6eb004242468f87c4fc0fdafda3, State: Initialized, Role: FOLLOWER
I20260811 16:40:04.212344 16276 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0f54c6eb004242468f87c4fc0fdafda3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e2a859d1a44107a3054a45ce993961" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 45215 } } peers { permanent_uuid: "0f54c6eb004242468f87c4fc0fdafda3" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 40525 } } peers { permanent_uuid: "bdad2279508a4133a93a59e755884fb1" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 39725 } }
I20260811 16:40:04.212615 16490 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f54c6eb004242468f87c4fc0fdafda3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e2a859d1a44107a3054a45ce993961" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 45215 } } peers { permanent_uuid: "0f54c6eb004242468f87c4fc0fdafda3" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 40525 } } peers { permanent_uuid: "bdad2279508a4133a93a59e755884fb1" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 39725 } } }
I20260811 16:40:04.212764 16490 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f54c6eb004242468f87c4fc0fdafda3 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:40:04.212682 16276 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0f54c6eb004242468f87c4fc0fdafda3 [sys.catalog]: configured and running, proceeding with master startup.
W20260811 16:40:04.214843 16504 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0f54c6eb004242468f87c4fc0fdafda3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 16:40:04.214955 16504 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 16:40:04.217097 16162 master_runner.cc:263] No leader master found from master 0f54c6eb004242468f87c4fc0fdafda3
I20260811 16:40:04.217156 16162 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 16:40:04.302865 16462 raft_consensus.cc:482] T 00000000000000000000000000000000 P e1e2a859d1a44107a3054a45ce993961 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:40:04.303020 16462 raft_consensus.cc:504] T 00000000000000000000000000000000 P e1e2a859d1a44107a3054a45ce993961 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e2a859d1a44107a3054a45ce993961" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 45215 } } peers { permanent_uuid: "0f54c6eb004242468f87c4fc0fdafda3" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 40525 } } peers { permanent_uuid: "bdad2279508a4133a93a59e755884fb1" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 39725 } }
I20260811 16:40:04.303344 16462 leader_election.cc:288] T 00000000000000000000000000000000 P e1e2a859d1a44107a3054a45ce993961 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f54c6eb004242468f87c4fc0fdafda3 (127.24.175.253:40525), bdad2279508a4133a93a59e755884fb1 (127.24.175.252:39725)
I20260811 16:40:04.303676 16226 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e1e2a859d1a44107a3054a45ce993961" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f54c6eb004242468f87c4fc0fdafda3" is_pre_election: true
I20260811 16:40:04.303828 16226 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 0f54c6eb004242468f87c4fc0fdafda3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1e2a859d1a44107a3054a45ce993961 in term 0.
I20260811 16:40:04.304045 16059 leader_election.cc:302] T 00000000000000000000000000000000 P e1e2a859d1a44107a3054a45ce993961 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f54c6eb004242468f87c4fc0fdafda3, e1e2a859d1a44107a3054a45ce993961; no voters:
I20260811 16:40:04.304190 16462 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e1e2a859d1a44107a3054a45ce993961 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:40:04.304250 16462 raft_consensus.cc:482] T 00000000000000000000000000000000 P e1e2a859d1a44107a3054a45ce993961 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:40:04.304276 16462 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e1e2a859d1a44107a3054a45ce993961 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:40:04.304694 16365 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e1e2a859d1a44107a3054a45ce993961" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdad2279508a4133a93a59e755884fb1" is_pre_election: true
I20260811 16:40:04.304862 16365 raft_consensus.cc:2454] T 00000000000000000000000000000000 P bdad2279508a4133a93a59e755884fb1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1e2a859d1a44107a3054a45ce993961 in term 0.
I20260811 16:40:04.305238 16462 raft_consensus.cc:504] T 00000000000000000000000000000000 P e1e2a859d1a44107a3054a45ce993961 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e2a859d1a44107a3054a45ce993961" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 45215 } } peers { permanent_uuid: "0f54c6eb004242468f87c4fc0fdafda3" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 40525 } } peers { permanent_uuid: "bdad2279508a4133a93a59e755884fb1" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 39725 } }
I20260811 16:40:04.305380 16462 leader_election.cc:288] T 00000000000000000000000000000000 P e1e2a859d1a44107a3054a45ce993961 [CANDIDATE]: Term 1 election: Requested vote from peers 0f54c6eb004242468f87c4fc0fdafda3 (127.24.175.253:40525), bdad2279508a4133a93a59e755884fb1 (127.24.175.252:39725)
I20260811 16:40:04.305639 16226 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e1e2a859d1a44107a3054a45ce993961" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f54c6eb004242468f87c4fc0fdafda3"
I20260811 16:40:04.305739 16226 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0f54c6eb004242468f87c4fc0fdafda3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:40:04.306402 16226 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 0f54c6eb004242468f87c4fc0fdafda3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1e2a859d1a44107a3054a45ce993961 in term 1.
I20260811 16:40:04.306546 16059 leader_election.cc:302] T 00000000000000000000000000000000 P e1e2a859d1a44107a3054a45ce993961 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f54c6eb004242468f87c4fc0fdafda3, e1e2a859d1a44107a3054a45ce993961; no voters:
I20260811 16:40:04.306641 16462 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e1e2a859d1a44107a3054a45ce993961 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:40:04.306762 16462 raft_consensus.cc:686] T 00000000000000000000000000000000 P e1e2a859d1a44107a3054a45ce993961 [term 1 LEADER]: Becoming Leader. State: Replica: e1e2a859d1a44107a3054a45ce993961, State: Running, Role: LEADER
I20260811 16:40:04.306859 16462 consensus_queue.cc:237] T 00000000000000000000000000000000 P e1e2a859d1a44107a3054a45ce993961 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e2a859d1a44107a3054a45ce993961" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 45215 } } peers { permanent_uuid: "0f54c6eb004242468f87c4fc0fdafda3" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 40525 } } peers { permanent_uuid: "bdad2279508a4133a93a59e755884fb1" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 39725 } }
I20260811 16:40:04.307080 16365 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e1e2a859d1a44107a3054a45ce993961" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdad2279508a4133a93a59e755884fb1"
I20260811 16:40:04.307153 16365 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bdad2279508a4133a93a59e755884fb1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:40:04.307276 16462 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1e2a859d1a44107a3054a45ce993961 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e1e2a859d1a44107a3054a45ce993961. Latest consensus state: current_term: 1 leader_uuid: "e1e2a859d1a44107a3054a45ce993961" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e2a859d1a44107a3054a45ce993961" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 45215 } } peers { permanent_uuid: "0f54c6eb004242468f87c4fc0fdafda3" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 40525 } } peers { permanent_uuid: "bdad2279508a4133a93a59e755884fb1" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 39725 } } }
I20260811 16:40:04.307338 16462 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1e2a859d1a44107a3054a45ce993961 [sys.catalog]: This master's current role is: LEADER
W20260811 16:40:04.307503 16063 tablet.cc:2369] T 00000000000000000000000000000000 P e1e2a859d1a44107a3054a45ce993961: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:40:04.307801 16509 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:40:04.307993 16509 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:40:04.308053 16365 raft_consensus.cc:2454] T 00000000000000000000000000000000 P bdad2279508a4133a93a59e755884fb1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1e2a859d1a44107a3054a45ce993961 in term 1.
I20260811 16:40:04.309383 16365 raft_consensus.cc:1261] T 00000000000000000000000000000000 P bdad2279508a4133a93a59e755884fb1 [term 1 FOLLOWER]: Refusing update from remote peer e1e2a859d1a44107a3054a45ce993961: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:40:04.309736 16506 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e1e2a859d1a44107a3054a45ce993961 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdad2279508a4133a93a59e755884fb1" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 39725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:40:04.309798 16226 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 0f54c6eb004242468f87c4fc0fdafda3 [term 1 FOLLOWER]: Refusing update from remote peer e1e2a859d1a44107a3054a45ce993961: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:40:04.310045 16506 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e1e2a859d1a44107a3054a45ce993961 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f54c6eb004242468f87c4fc0fdafda3" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 40525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:40:04.311080 16435 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdad2279508a4133a93a59e755884fb1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e1e2a859d1a44107a3054a45ce993961. Latest consensus state: current_term: 1 leader_uuid: "e1e2a859d1a44107a3054a45ce993961" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e2a859d1a44107a3054a45ce993961" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 45215 } } peers { permanent_uuid: "0f54c6eb004242468f87c4fc0fdafda3" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 40525 } } peers { permanent_uuid: "bdad2279508a4133a93a59e755884fb1" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 39725 } } }
I20260811 16:40:04.311162 16435 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdad2279508a4133a93a59e755884fb1 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:40:04.311220 16490 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f54c6eb004242468f87c4fc0fdafda3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e1e2a859d1a44107a3054a45ce993961. Latest consensus state: current_term: 1 leader_uuid: "e1e2a859d1a44107a3054a45ce993961" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e2a859d1a44107a3054a45ce993961" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 45215 } } peers { permanent_uuid: "0f54c6eb004242468f87c4fc0fdafda3" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 40525 } } peers { permanent_uuid: "bdad2279508a4133a93a59e755884fb1" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 39725 } } }
I20260811 16:40:04.311290 16490 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f54c6eb004242468f87c4fc0fdafda3 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:40:04.313602 16462 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1e2a859d1a44107a3054a45ce993961 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e1e2a859d1a44107a3054a45ce993961" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e2a859d1a44107a3054a45ce993961" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 45215 } } peers { permanent_uuid: "0f54c6eb004242468f87c4fc0fdafda3" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 40525 } } peers { permanent_uuid: "bdad2279508a4133a93a59e755884fb1" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 39725 } } }
I20260811 16:40:04.313696 16462 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1e2a859d1a44107a3054a45ce993961 [sys.catalog]: This master's current role is: LEADER
I20260811 16:40:04.313864 16513 mvcc.cc:205] Tried to move back new op lower bound from 7317366392049491968 to 7317366392041578496. Current Snapshot: MvccSnapshot[applied={T|T < 7317366392049491968}]
I20260811 16:40:04.313990 16435 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdad2279508a4133a93a59e755884fb1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e1e2a859d1a44107a3054a45ce993961" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e2a859d1a44107a3054a45ce993961" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 45215 } } peers { permanent_uuid: "0f54c6eb004242468f87c4fc0fdafda3" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 40525 } } peers { permanent_uuid: "bdad2279508a4133a93a59e755884fb1" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 39725 } } }
I20260811 16:40:04.314052 16435 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdad2279508a4133a93a59e755884fb1 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:40:04.314787 16462 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1e2a859d1a44107a3054a45ce993961 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e1e2a859d1a44107a3054a45ce993961" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e2a859d1a44107a3054a45ce993961" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 45215 } } peers { permanent_uuid: "0f54c6eb004242468f87c4fc0fdafda3" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 40525 } } peers { permanent_uuid: "bdad2279508a4133a93a59e755884fb1" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 39725 } } }
I20260811 16:40:04.314862 16462 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1e2a859d1a44107a3054a45ce993961 [sys.catalog]: This master's current role is: LEADER
I20260811 16:40:04.314992 16509 catalog_manager.cc:1347] Generated new cluster ID: 9edcc69a5cdc43fe80408776625a1cd3
I20260811 16:40:04.315217 16490 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f54c6eb004242468f87c4fc0fdafda3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e1e2a859d1a44107a3054a45ce993961" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1e2a859d1a44107a3054a45ce993961" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 45215 } } peers { permanent_uuid: "0f54c6eb004242468f87c4fc0fdafda3" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 40525 } } peers { permanent_uuid: "bdad2279508a4133a93a59e755884fb1" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 39725 } } }
I20260811 16:40:04.315289 16490 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f54c6eb004242468f87c4fc0fdafda3 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:40:04.315335 16509 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:40:04.322499 16509 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:40:04.323015 16509 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:40:04.332017 16509 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e1e2a859d1a44107a3054a45ce993961: Generated new TSK 0
I20260811 16:40:04.332238 16509 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:40:05.169548 16458 catalog_manager.cc:1259] Loaded cluster ID: 9edcc69a5cdc43fe80408776625a1cd3
I20260811 16:40:05.169621 16458 catalog_manager.cc:1552] T 00000000000000000000000000000000 P bdad2279508a4133a93a59e755884fb1: loading cluster ID for follower catalog manager: success
I20260811 16:40:05.170614 16458 catalog_manager.cc:1574] T 00000000000000000000000000000000 P bdad2279508a4133a93a59e755884fb1: acquiring CA information for follower catalog manager: success
I20260811 16:40:05.170951 16458 catalog_manager.cc:1602] T 00000000000000000000000000000000 P bdad2279508a4133a93a59e755884fb1: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 16:40:05.215431 16504 catalog_manager.cc:1259] Loaded cluster ID: 9edcc69a5cdc43fe80408776625a1cd3
I20260811 16:40:05.215509 16504 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 0f54c6eb004242468f87c4fc0fdafda3: loading cluster ID for follower catalog manager: success
I20260811 16:40:05.216267 16504 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 0f54c6eb004242468f87c4fc0fdafda3: acquiring CA information for follower catalog manager: success
I20260811 16:40:05.216526 16504 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 0f54c6eb004242468f87c4fc0fdafda3: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 16:40:05.386890 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 16032
I20260811 16:40:05.399860 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 16162
I20260811 16:40:05.407910 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 16285
2026-08-11T16:40:05Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3027 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466249441839-25279-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:40:05 dist-test-slave-zj8q krb5kdc[16539](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:40:05 dist-test-slave-zj8q krb5kdc[16539](info): set up 2 sockets
Aug 11 16:40:05 dist-test-slave-zj8q krb5kdc[16539](info): commencing operation
krb5kdc: starting...
W20260811 16:40:06.578125 25279 mini_kdc.cc:121] Time spent starting KDC: real 1.146s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Aug 11 16:40:06 dist-test-slave-zj8q krb5kdc[16539](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466406, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:40:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:40:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab.
Entry for principal kudu/127.24.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab.
I20260811 16:40:06.694736 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466249441839-25279-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466249441839-25279-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466249441839-25279-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:41761
--webserver_interface=127.24.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:40913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.175.254:41761
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:40:06.775262 16561 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:40:06.775456 16561 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:40:06.775487 16561 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:40:06.776612 16561 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:40:06.776652 16561 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:40:06.776669 16561 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:40:06.776686 16561 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:40:06.776700 16561 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:40:06.778198 16561 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:40913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466249441839-25279-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466249441839-25279-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.175.254:41761
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:41761
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16561
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466249441839-25279-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:40:06.778434 16561 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:40:06.778640 16561 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:40:06.783336 16580 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:40:06.783331 16575 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:40:06.783402 16574 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:40:06.783452 16561 server_base.cc:1034] running on GCE node
I20260811 16:40:06.783851 16561 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:40:06.784109 16561 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:40:06.785245 16561 hybrid_clock.cc:648] HybridClock initialized: now 1786466406785234 us; error 27 us; skew 500 ppm
Aug 11 16:40:06 dist-test-slave-zj8q krb5kdc[16539](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466406, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:40:06.787616 16561 init.cc:377] Logged in from keytab as kudu/127.24.175.254@KRBTEST.COM (short username kudu)
I20260811 16:40:06.788028 16561 webserver.cc:460] Webserver started at http://127.24.175.254:44615/ using document root <none> and password file <none>
I20260811 16:40:06.788251 16561 fs_manager.cc:359] Metadata directory not provided
I20260811 16:40:06.788295 16561 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:40:06.788417 16561 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:40:06.789422 16561 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466249441839-25279-0/minicluster-data/master-0/data/instance:
uuid: "b1abb1b975d9405f935195f136b09834"
format_stamp: "Formatted at 2026-08-11 16:40:06 on dist-test-slave-zj8q"
server_key: "c4b0dff8bb2d503e0ca9ad95660874c4"
server_key_iv: "9924192223db6fe6e54d77deae749556"
server_key_version: "encryptionkey@0"
I20260811 16:40:06.789752 16561 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466249441839-25279-0/minicluster-data/master-0/wal/instance:
uuid: "b1abb1b975d9405f935195f136b09834"
format_stamp: "Formatted at 2026-08-11 16:40:06 on dist-test-slave-zj8q"
server_key: "c4b0dff8bb2d503e0ca9ad95660874c4"
server_key_iv: "9924192223db6fe6e54d77deae749556"
server_key_version: "encryptionkey@0"
I20260811 16:40:06.791028 16561 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 16:40:06.791673 16593 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:40:06.791831 16561 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 16:40:06.791914 16561 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466249441839-25279-0/minicluster-data/master-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466249441839-25279-0/minicluster-data/master-0/wal
uuid: "b1abb1b975d9405f935195f136b09834"
format_stamp: "Formatted at 2026-08-11 16:40:06 on dist-test-slave-zj8q"
server_key: "c4b0dff8bb2d503e0ca9ad95660874c4"
server_key_iv: "9924192223db6fe6e54d77deae749556"
server_key_version: "encryptionkey@0"
I20260811 16:40:06.791966 16561 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466249441839-25279-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466249441839-25279-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466249441839-25279-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:40:06.803659 16561 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:40:06.805688 16561 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:40:06.805796 16561 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:40:06.809496 16561 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.254:41761
I20260811 16:40:06.809535 16689 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.254:41761 every 8 connection(s)
I20260811 16:40:06.809826 16561 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
I20260811 16:40:06.810726 16691 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:40:06.813066 16691 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1abb1b975d9405f935195f136b09834: Bootstrap starting.
I20260811 16:40:06.813642 16691 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b1abb1b975d9405f935195f136b09834: Neither blocks nor log segments found. Creating new log.
I20260811 16:40:06.813927 16691 log.cc:824] T 00000000000000000000000000000000 P b1abb1b975d9405f935195f136b09834: Log is configured to *not* fsync() on all Append() calls
I20260811 16:40:06.814615 16691 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1abb1b975d9405f935195f136b09834: No bootstrap required, opened a new log
I20260811 16:40:06.816181 16691 raft_consensus.cc:348] T 00000000000000000000000000000000 P b1abb1b975d9405f935195f136b09834 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1abb1b975d9405f935195f136b09834" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 41761 } }
I20260811 16:40:06.816318 16691 raft_consensus.cc:374] T 00000000000000000000000000000000 P b1abb1b975d9405f935195f136b09834 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:40:06.816349 16691 raft_consensus.cc:729] T 00000000000000000000000000000000 P b1abb1b975d9405f935195f136b09834 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1abb1b975d9405f935195f136b09834, State: Initialized, Role: FOLLOWER
I20260811 16:40:06.816476 16691 consensus_queue.cc:260] T 00000000000000000000000000000000 P b1abb1b975d9405f935195f136b09834 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1abb1b975d9405f935195f136b09834" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 41761 } }
I20260811 16:40:06.816553 16691 raft_consensus.cc:388] T 00000000000000000000000000000000 P b1abb1b975d9405f935195f136b09834 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:40:06.816586 16691 raft_consensus.cc:482] T 00000000000000000000000000000000 P b1abb1b975d9405f935195f136b09834 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:40:06.816632 16691 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b1abb1b975d9405f935195f136b09834 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:40:06.817126 16691 raft_consensus.cc:504] T 00000000000000000000000000000000 P b1abb1b975d9405f935195f136b09834 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1abb1b975d9405f935195f136b09834" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 41761 } }
I20260811 16:40:06.817231 16691 leader_election.cc:302] T 00000000000000000000000000000000 P b1abb1b975d9405f935195f136b09834 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b1abb1b975d9405f935195f136b09834; no voters:
I20260811 16:40:06.817386 16691 leader_election.cc:288] T 00000000000000000000000000000000 P b1abb1b975d9405f935195f136b09834 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:40:06.817420 16696 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b1abb1b975d9405f935195f136b09834 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:40:06.817557 16696 raft_consensus.cc:686] T 00000000000000000000000000000000 P b1abb1b975d9405f935195f136b09834 [term 1 LEADER]: Becoming Leader. State: Replica: b1abb1b975d9405f935195f136b09834, State: Running, Role: LEADER
I20260811 16:40:06.817639 16691 sys_catalog.cc:564] T 00000000000000000000000000000000 P b1abb1b975d9405f935195f136b09834 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:40:06.817648 16696 consensus_queue.cc:237] T 00000000000000000000000000000000 P b1abb1b975d9405f935195f136b09834 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1abb1b975d9405f935195f136b09834" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 41761 } }
I20260811 16:40:06.818236 16697 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1abb1b975d9405f935195f136b09834 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b1abb1b975d9405f935195f136b09834" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1abb1b975d9405f935195f136b09834" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 41761 } } }
I20260811 16:40:06.818329 16697 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1abb1b975d9405f935195f136b09834 [sys.catalog]: This master's current role is: LEADER
I20260811 16:40:06.818480 16698 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1abb1b975d9405f935195f136b09834 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b1abb1b975d9405f935195f136b09834. Latest consensus state: current_term: 1 leader_uuid: "b1abb1b975d9405f935195f136b09834" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1abb1b975d9405f935195f136b09834" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 41761 } } }
I20260811 16:40:06.818550 16698 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1abb1b975d9405f935195f136b09834 [sys.catalog]: This master's current role is: LEADER
I20260811 16:40:06.818665 16710 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:40:06.819115 16710 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:40:06.819442 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 16561
I20260811 16:40:06.819530 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466249441839-25279-0/minicluster-data/master-0/wal/instance
I20260811 16:40:06.819701 25279 external_mini_cluster.cc:1428] Setting key ee9af5d291077a14268387bf4c225eee
I20260811 16:40:06.820830 16710 catalog_manager.cc:1347] Generated new cluster ID: 6ca427071bb948b39ca17d19061f634a
I20260811 16:40:06.820874 16710 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 16:40:06 dist-test-slave-zj8q krb5kdc[16539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466406, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:40:06.830740 16723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:06.820085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43828 (local address 127.24.175.254:41761)
0811 16:40:06.820265 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:06.820274 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:06.820454 (+ 180us) server_negotiation.cc:407] Connection header received
0811 16:40:06.820550 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:06.820555 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:06.820608 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:06.820730 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:40:06.821472 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:06.822889 (+ 1417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:06.823951 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:06.824526 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:06.824612 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:06.827297 (+ 2685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:40:06.827302 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:40:06.827303 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:40:06.827315 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:40:06.829180 (+ 1865us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:06.829531 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:06.829534 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:06.829535 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:06.829638 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:06.829804 (+ 166us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:06.829805 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:06.829805 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:06.830107 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:40:06.830287 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0811 16:40:06.830355 (+ 68us) server_negotiation.cc:299] Negotiation successful
0811 16:40:06.830488 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":105,"threads_started":1}
I20260811 16:40:06.831669 25279 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:40:06.843565 16710 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:40:06.844079 16710 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:40:06.847067 16710 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b1abb1b975d9405f935195f136b09834: Generated new TSK 0
I20260811 16:40:06.847261 16710 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:40:06.885504 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 16561
2026-08-11T16:40:06Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1477 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:40:06 dist-test-slave-zj8q krb5kdc[16729](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:40:06 dist-test-slave-zj8q krb5kdc[16729](info): set up 2 sockets
Aug 11 16:40:06 dist-test-slave-zj8q krb5kdc[16729](info): commencing operation
krb5kdc: starting...
W20260811 16:40:08.057502 25279 mini_kdc.cc:121] Time spent starting KDC: real 1.147s user 0.005s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Aug 11 16:40:08 dist-test-slave-zj8q krb5kdc[16729](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466408, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:40:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:40:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab.
Entry for principal kudu/127.24.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab.
I20260811 16:40:08.173612 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:43417
--webserver_interface=127.24.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:43091
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.175.254:43417
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:40:08.255533 16753 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:40:08.255723 16753 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:40:08.255744 16753 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:40:08.257033 16753 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:40:08.257087 16753 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:40:08.257102 16753 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:40:08.257113 16753 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:40:08.257124 16753 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:40:08.258777 16753 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:43091
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.175.254:43417
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:43417
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16753
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:40:08.258980 16753 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:40:08.259150 16753 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:40:08.263834 16766 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:40:08.263857 16759 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:40:08.263890 16753 server_base.cc:1034] running on GCE node
W20260811 16:40:08.263834 16762 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:40:08.264300 16753 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:40:08.264587 16753 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:40:08.265743 16753 hybrid_clock.cc:648] HybridClock initialized: now 1786466408265723 us; error 35 us; skew 500 ppm
Aug 11 16:40:08 dist-test-slave-zj8q krb5kdc[16729](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466408, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:40:08.268115 16753 init.cc:377] Logged in from keytab as kudu/127.24.175.254@KRBTEST.COM (short username kudu)
I20260811 16:40:08.268519 16753 webserver.cc:460] Webserver started at http://127.24.175.254:34861/ using document root <none> and password file <none>
I20260811 16:40:08.268730 16753 fs_manager.cc:359] Metadata directory not provided
I20260811 16:40:08.268771 16753 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:40:08.268862 16753 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:40:08.269834 16753 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/master-0/data/instance:
uuid: "e7a415dfffbc4cec9b7cc7d6384957b2"
format_stamp: "Formatted at 2026-08-11 16:40:08 on dist-test-slave-zj8q"
server_key: "4efc226e2e52c9e7fd6bea9265871d2c"
server_key_iv: "0adc06fbab24e5bff70247d4f338ca3c"
server_key_version: "encryptionkey@0"
I20260811 16:40:08.270198 16753 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/master-0/wal/instance:
uuid: "e7a415dfffbc4cec9b7cc7d6384957b2"
format_stamp: "Formatted at 2026-08-11 16:40:08 on dist-test-slave-zj8q"
server_key: "4efc226e2e52c9e7fd6bea9265871d2c"
server_key_iv: "0adc06fbab24e5bff70247d4f338ca3c"
server_key_version: "encryptionkey@0"
I20260811 16:40:08.271382 16753 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:40:08.272087 16773 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:40:08.272249 16753 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 16:40:08.272342 16753 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/master-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/master-0/wal
uuid: "e7a415dfffbc4cec9b7cc7d6384957b2"
format_stamp: "Formatted at 2026-08-11 16:40:08 on dist-test-slave-zj8q"
server_key: "4efc226e2e52c9e7fd6bea9265871d2c"
server_key_iv: "0adc06fbab24e5bff70247d4f338ca3c"
server_key_version: "encryptionkey@0"
I20260811 16:40:08.272413 16753 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:40:08.281174 16753 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:40:08.283179 16753 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:40:08.283308 16753 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:40:08.287140 16753 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.254:43417
I20260811 16:40:08.287173 16876 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.254:43417 every 8 connection(s)
I20260811 16:40:08.287477 16753 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
I20260811 16:40:08.288437 16877 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:40:08.288659 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 16753
I20260811 16:40:08.288738 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/master-0/wal/instance
I20260811 16:40:08.288893 25279 external_mini_cluster.cc:1428] Setting key 64d608440478e3cdd741c0b84fad3706
I20260811 16:40:08.291297 16877 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e7a415dfffbc4cec9b7cc7d6384957b2: Bootstrap starting.
I20260811 16:40:08.291879 16877 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e7a415dfffbc4cec9b7cc7d6384957b2: Neither blocks nor log segments found. Creating new log.
I20260811 16:40:08.292193 16877 log.cc:824] T 00000000000000000000000000000000 P e7a415dfffbc4cec9b7cc7d6384957b2: Log is configured to *not* fsync() on all Append() calls
I20260811 16:40:08.292925 16877 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e7a415dfffbc4cec9b7cc7d6384957b2: No bootstrap required, opened a new log
Aug 11 16:40:08 dist-test-slave-zj8q krb5kdc[16729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466408, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:40:08.295353 16877 raft_consensus.cc:348] T 00000000000000000000000000000000 P e7a415dfffbc4cec9b7cc7d6384957b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7a415dfffbc4cec9b7cc7d6384957b2" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 43417 } }
I20260811 16:40:08.295521 16877 raft_consensus.cc:374] T 00000000000000000000000000000000 P e7a415dfffbc4cec9b7cc7d6384957b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:40:08.295611 16877 raft_consensus.cc:729] T 00000000000000000000000000000000 P e7a415dfffbc4cec9b7cc7d6384957b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7a415dfffbc4cec9b7cc7d6384957b2, State: Initialized, Role: FOLLOWER
I20260811 16:40:08.295756 16877 consensus_queue.cc:260] T 00000000000000000000000000000000 P e7a415dfffbc4cec9b7cc7d6384957b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7a415dfffbc4cec9b7cc7d6384957b2" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 43417 } }
I20260811 16:40:08.295862 16877 raft_consensus.cc:388] T 00000000000000000000000000000000 P e7a415dfffbc4cec9b7cc7d6384957b2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:40:08.295909 16877 raft_consensus.cc:482] T 00000000000000000000000000000000 P e7a415dfffbc4cec9b7cc7d6384957b2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:40:08.295960 16877 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e7a415dfffbc4cec9b7cc7d6384957b2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:40:08.296661 16877 raft_consensus.cc:504] T 00000000000000000000000000000000 P e7a415dfffbc4cec9b7cc7d6384957b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7a415dfffbc4cec9b7cc7d6384957b2" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 43417 } }
I20260811 16:40:08.296775 16877 leader_election.cc:302] T 00000000000000000000000000000000 P e7a415dfffbc4cec9b7cc7d6384957b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e7a415dfffbc4cec9b7cc7d6384957b2; no voters:
I20260811 16:40:08.296944 16877 leader_election.cc:288] T 00000000000000000000000000000000 P e7a415dfffbc4cec9b7cc7d6384957b2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:40:08.297014 16887 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e7a415dfffbc4cec9b7cc7d6384957b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:40:08.297199 16887 raft_consensus.cc:686] T 00000000000000000000000000000000 P e7a415dfffbc4cec9b7cc7d6384957b2 [term 1 LEADER]: Becoming Leader. State: Replica: e7a415dfffbc4cec9b7cc7d6384957b2, State: Running, Role: LEADER
I20260811 16:40:08.297206 16877 sys_catalog.cc:564] T 00000000000000000000000000000000 P e7a415dfffbc4cec9b7cc7d6384957b2 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:40:08.297310 16887 consensus_queue.cc:237] T 00000000000000000000000000000000 P e7a415dfffbc4cec9b7cc7d6384957b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7a415dfffbc4cec9b7cc7d6384957b2" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 43417 } }
I20260811 16:40:08.297686 16890 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7a415dfffbc4cec9b7cc7d6384957b2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e7a415dfffbc4cec9b7cc7d6384957b2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7a415dfffbc4cec9b7cc7d6384957b2" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 43417 } } }
I20260811 16:40:08.297770 16890 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7a415dfffbc4cec9b7cc7d6384957b2 [sys.catalog]: This master's current role is: LEADER
I20260811 16:40:08.297930 16891 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7a415dfffbc4cec9b7cc7d6384957b2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e7a415dfffbc4cec9b7cc7d6384957b2. Latest consensus state: current_term: 1 leader_uuid: "e7a415dfffbc4cec9b7cc7d6384957b2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7a415dfffbc4cec9b7cc7d6384957b2" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 43417 } } }
I20260811 16:40:08.298002 16891 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7a415dfffbc4cec9b7cc7d6384957b2 [sys.catalog]: This master's current role is: LEADER
I20260811 16:40:08.298673 16899 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:40:08.299260 16899 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:40:08.299518 16884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:08.289391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55972 (local address 127.24.175.254:43417)
0811 16:40:08.289550 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:08.289557 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:08.289582 (+ 25us) server_negotiation.cc:407] Connection header received
0811 16:40:08.289998 (+ 416us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:08.290003 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:08.290048 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:08.290190 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:40:08.290941 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:08.291842 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:08.292801 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:08.293236 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:08.293315 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:08.295866 (+ 2551us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:40:08.295871 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:40:08.295871 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:40:08.295884 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:40:08.297790 (+ 1906us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:08.298205 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:08.298208 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:08.298209 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:08.298318 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:08.298526 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:08.298527 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:08.298528 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:08.298858 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:40:08.299031 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0811 16:40:08.299163 (+ 132us) server_negotiation.cc:299] Negotiation successful
0811 16:40:08.299314 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106,"thread_start_us":60,"threads_started":1}
I20260811 16:40:08.300928 16899 catalog_manager.cc:1347] Generated new cluster ID: 334d3b42530d48ddab536501d4881e1f
I20260811 16:40:08.300968 16899 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:40:08.309784 16899 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:40:08.310559 16899 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:40:08.318084 16899 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e7a415dfffbc4cec9b7cc7d6384957b2: Generated new TSK 0
I20260811 16:40:08.318293 16899 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.175.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab.
Entry for principal kudu/127.24.175.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab.
I20260811 16:40:08.345965 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.193:0
--local_ip_for_outbound_sockets=127.24.175.193
--webserver_interface=127.24.175.193
--webserver_port=0
--tserver_master_addrs=127.24.175.254:43417
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab
--principal=kudu/127.24.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:43091
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:40:08.426740 16920 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:40:08.426939 16920 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:40:08.426960 16920 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:40:08.428067 16920 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:40:08.428110 16920 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:40:08.428136 16920 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.193
I20260811 16:40:08.429549 16920 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:43091
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab
--principal=kudu/127.24.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.175.193
--webserver_port=0
--tserver_master_addrs=127.24.175.254:43417
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16920
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.193
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:40:08.429752 16920 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:40:08.429968 16920 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:40:08.434768 16934 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:40:08.434823 16930 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:40:08.434835 16931 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:40:08.434953 16920 server_base.cc:1034] running on GCE node
I20260811 16:40:08.435160 16920 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:40:08.435390 16920 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:40:08.436533 16920 hybrid_clock.cc:648] HybridClock initialized: now 1786466408436516 us; error 33 us; skew 500 ppm
Aug 11 16:40:08 dist-test-slave-zj8q krb5kdc[16729](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466408, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:40:08.438944 16920 init.cc:377] Logged in from keytab as kudu/127.24.175.193@KRBTEST.COM (short username kudu)
I20260811 16:40:08.439344 16920 webserver.cc:460] Webserver started at http://127.24.175.193:34417/ using document root <none> and password file <none>
I20260811 16:40:08.439535 16920 fs_manager.cc:359] Metadata directory not provided
I20260811 16:40:08.439582 16920 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:40:08.439702 16920 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:40:08.440697 16920 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-0/data/instance:
uuid: "2a0b5cba6b0841cc96d429b81d897f1c"
format_stamp: "Formatted at 2026-08-11 16:40:08 on dist-test-slave-zj8q"
server_key: "5d82e7a0fab7c861312c6593bf7add77"
server_key_iv: "34004a6a29407ba0eb356c1003722175"
server_key_version: "encryptionkey@0"
I20260811 16:40:08.441018 16920 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-0/wal/instance:
uuid: "2a0b5cba6b0841cc96d429b81d897f1c"
format_stamp: "Formatted at 2026-08-11 16:40:08 on dist-test-slave-zj8q"
server_key: "5d82e7a0fab7c861312c6593bf7add77"
server_key_iv: "34004a6a29407ba0eb356c1003722175"
server_key_version: "encryptionkey@0"
I20260811 16:40:08.442255 16920 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 16:40:08.442907 16943 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:40:08.443058 16920 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 16:40:08.443161 16920 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-0/wal
uuid: "2a0b5cba6b0841cc96d429b81d897f1c"
format_stamp: "Formatted at 2026-08-11 16:40:08 on dist-test-slave-zj8q"
server_key: "5d82e7a0fab7c861312c6593bf7add77"
server_key_iv: "34004a6a29407ba0eb356c1003722175"
server_key_version: "encryptionkey@0"
I20260811 16:40:08.443223 16920 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:40:08.467250 16920 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:40:08.468874 16920 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:40:08.469004 16920 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:40:08.469214 16920 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:40:08.469492 16920 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:40:08.469525 16920 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:40:08.469554 16920 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:40:08.469573 16920 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:40:08.475301 16920 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.193:35661
I20260811 16:40:08.475360 17135 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.193:35661 every 8 connection(s)
I20260811 16:40:08.475651 16920 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
Aug 11 16:40:08 dist-test-slave-zj8q krb5kdc[16729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466408, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.193@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:40:08.481185 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 16920
I20260811 16:40:08.481290 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-0/wal/instance
I20260811 16:40:08.481482 25279 external_mini_cluster.cc:1428] Setting key 77a8cd8ad09de24b1b064fb99550f75d
I20260811 16:40:08.484335 16884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:08.476293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:47171 (local address 127.24.175.254:43417)
0811 16:40:08.476336 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:08.476338 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:08.476526 (+ 188us) server_negotiation.cc:407] Connection header received
0811 16:40:08.476974 (+ 448us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:08.476975 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:08.476986 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:08.477032 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:40:08.477908 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:08.478450 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:08.479425 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:08.479624 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:08.479665 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:08.481711 (+ 2046us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:40:08.481713 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:40:08.481714 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:40:08.481723 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:40:08.483010 (+ 1287us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:08.483439 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:08.483440 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:08.483440 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:08.483487 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:08.483719 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:08.483720 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:08.483720 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:08.483823 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:40:08.483878 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 16:40:08.484145 (+ 267us) server_negotiation.cc:299] Negotiation successful
0811 16:40:08.484245 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 16:40:08.484464 17138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:08.476277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:43417 (local address 127.24.175.193:47171)
0811 16:40:08.476410 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:08.476445 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 16:40:08.476899 (+ 454us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:40:08.477084 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:40:08.477087 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:40:08.477649 (+ 562us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:40:08.477839 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:08.477844 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:08.478532 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:08.478534 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:08.479357 (+ 823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:08.479359 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:08.479681 (+ 322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:08.479681 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:08.479774 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:08.480201 (+ 427us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:40:08.480208 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:40:08.481617 (+ 1409us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:40:08.483081 (+ 1464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:40:08.483089 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:40:08.483091 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:40:08.483369 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:40:08.483536 (+ 167us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:40:08.483537 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:40:08.483537 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:40:08.483663 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:40:08.483888 (+ 225us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:40:08.483896 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:40:08.484026 (+ 130us) client_negotiation.cc:769] Sending connection context
0811 16:40:08.484113 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 16:40:08.484264 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":69,"threads_started":1}
I20260811 16:40:08.484896 17136 heartbeater.cc:347] Connected to a master server at 127.24.175.254:43417
I20260811 16:40:08.484980 17136 heartbeater.cc:464] Registering TS with master...
I20260811 16:40:08.485142 17136 heartbeater.cc:511] Master 127.24.175.254:43417 requested a full tablet report, sending...
I20260811 16:40:08.485654 16812 ts_manager.cc:194] Registered new tserver with Master: 2a0b5cba6b0841cc96d429b81d897f1c (127.24.175.193:35661)
I20260811 16:40:08.486332 16812 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.175.193@KRBTEST.COM'} at 127.24.175.193:47171
WARNING: no policy specified for kudu/127.24.175.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab.
Entry for principal kudu/127.24.175.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab.
I20260811 16:40:08.505844 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.194:0
--local_ip_for_outbound_sockets=127.24.175.194
--webserver_interface=127.24.175.194
--webserver_port=0
--tserver_master_addrs=127.24.175.254:43417
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab
--principal=kudu/127.24.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:43091
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:40:08.585208 17141 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:40:08.585402 17141 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:40:08.585424 17141 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:40:08.586593 17141 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:40:08.586635 17141 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:40:08.586663 17141 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.194
I20260811 16:40:08.588102 17141 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:43091
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab
--principal=kudu/127.24.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.175.194
--webserver_port=0
--tserver_master_addrs=127.24.175.254:43417
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17141
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.194
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:40:08.588327 17141 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:40:08.588536 17141 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:40:08.593406 17151 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:40:08.593428 17141 server_base.cc:1034] running on GCE node
W20260811 16:40:08.593392 17158 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:40:08.593398 17153 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:40:08.593763 17141 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:40:08.593964 17141 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:40:08.595105 17141 hybrid_clock.cc:648] HybridClock initialized: now 1786466408595084 us; error 37 us; skew 500 ppm
Aug 11 16:40:08 dist-test-slave-zj8q krb5kdc[16729](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466408, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:40:08.597460 17141 init.cc:377] Logged in from keytab as kudu/127.24.175.194@KRBTEST.COM (short username kudu)
I20260811 16:40:08.597880 17141 webserver.cc:460] Webserver started at http://127.24.175.194:42253/ using document root <none> and password file <none>
I20260811 16:40:08.598179 17141 fs_manager.cc:359] Metadata directory not provided
I20260811 16:40:08.598234 17141 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:40:08.598358 17141 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:40:08.599336 17141 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-1/data/instance:
uuid: "2c02d356d12548a6ba3cab2218d7e6c3"
format_stamp: "Formatted at 2026-08-11 16:40:08 on dist-test-slave-zj8q"
server_key: "f45a18290593ec79fe9f934f76a0b371"
server_key_iv: "9f70fef99a13ec41e99b885a6f6b885b"
server_key_version: "encryptionkey@0"
I20260811 16:40:08.599655 17141 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-1/wal/instance:
uuid: "2c02d356d12548a6ba3cab2218d7e6c3"
format_stamp: "Formatted at 2026-08-11 16:40:08 on dist-test-slave-zj8q"
server_key: "f45a18290593ec79fe9f934f76a0b371"
server_key_iv: "9f70fef99a13ec41e99b885a6f6b885b"
server_key_version: "encryptionkey@0"
I20260811 16:40:08.600841 17141 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:40:08.601481 17171 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:40:08.601614 17141 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:40:08.601702 17141 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-1/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-1/wal
uuid: "2c02d356d12548a6ba3cab2218d7e6c3"
format_stamp: "Formatted at 2026-08-11 16:40:08 on dist-test-slave-zj8q"
server_key: "f45a18290593ec79fe9f934f76a0b371"
server_key_iv: "9f70fef99a13ec41e99b885a6f6b885b"
server_key_version: "encryptionkey@0"
I20260811 16:40:08.601770 17141 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:40:08.610110 17141 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:40:08.612133 17141 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:40:08.612262 17141 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:40:08.612458 17141 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:40:08.612746 17141 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:40:08.612779 17141 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:40:08.612799 17141 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:40:08.612823 17141 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:40:08.618269 17141 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.194:35265
I20260811 16:40:08.618324 17357 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.194:35265 every 8 connection(s)
I20260811 16:40:08.618588 17141 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
I20260811 16:40:08.620144 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 17141
I20260811 16:40:08.620232 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-1/wal/instance
I20260811 16:40:08.620395 25279 external_mini_cluster.cc:1428] Setting key de7032032fb9c653d4b5b9655c8a995b
Aug 11 16:40:08 dist-test-slave-zj8q krb5kdc[16729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466408, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.194@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:40:08.627357 16884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:08.619182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:33617 (local address 127.24.175.254:43417)
0811 16:40:08.619256 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:08.619258 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:08.619399 (+ 141us) server_negotiation.cc:407] Connection header received
0811 16:40:08.619834 (+ 435us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:08.619835 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:08.619845 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:08.619892 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:40:08.620896 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:08.621435 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:08.622436 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:08.622641 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:08.622697 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:08.624809 (+ 2112us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:40:08.624811 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:40:08.624811 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:40:08.624818 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:40:08.626106 (+ 1288us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:08.626509 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:08.626510 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:08.626511 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:08.626568 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:08.626776 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:08.626777 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:08.626777 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:08.626888 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:40:08.626942 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 16:40:08.627187 (+ 245us) server_negotiation.cc:299] Negotiation successful
0811 16:40:08.627268 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 16:40:08.627513 17361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:08.619146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:43417 (local address 127.24.175.194:33617)
0811 16:40:08.619292 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:08.619325 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0811 16:40:08.619761 (+ 436us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:40:08.619944 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:40:08.619947 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:40:08.620577 (+ 630us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:40:08.620811 (+ 234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:08.620816 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:08.621525 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:08.621526 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:08.622361 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:08.622364 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:08.622710 (+ 346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:08.622712 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:08.622831 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:08.623263 (+ 432us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:40:08.623270 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:40:08.624727 (+ 1457us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:40:08.626220 (+ 1493us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:40:08.626238 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:40:08.626241 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:40:08.626443 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:40:08.626620 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:40:08.626621 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:40:08.626621 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:40:08.626721 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:40:08.626941 (+ 220us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:40:08.626947 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:40:08.627074 (+ 127us) client_negotiation.cc:769] Sending connection context
0811 16:40:08.627157 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 16:40:08.627310 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":82,"threads_started":1}
I20260811 16:40:08.627905 17358 heartbeater.cc:347] Connected to a master server at 127.24.175.254:43417
I20260811 16:40:08.627990 17358 heartbeater.cc:464] Registering TS with master...
I20260811 16:40:08.628146 17358 heartbeater.cc:511] Master 127.24.175.254:43417 requested a full tablet report, sending...
I20260811 16:40:08.628507 16812 ts_manager.cc:194] Registered new tserver with Master: 2c02d356d12548a6ba3cab2218d7e6c3 (127.24.175.194:35265)
I20260811 16:40:08.629019 16812 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.175.194@KRBTEST.COM'} at 127.24.175.194:33617
WARNING: no policy specified for kudu/127.24.175.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab.
Entry for principal kudu/127.24.175.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab.
I20260811 16:40:08.645251 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.195:0
--local_ip_for_outbound_sockets=127.24.175.195
--webserver_interface=127.24.175.195
--webserver_port=0
--tserver_master_addrs=127.24.175.254:43417
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab
--principal=kudu/127.24.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:43091
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:40:08.725651 17367 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:40:08.725834 17367 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:40:08.725855 17367 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:40:08.727038 17367 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:40:08.727082 17367 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:40:08.727110 17367 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.195
I20260811 16:40:08.728535 17367 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:43091
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab
--principal=kudu/127.24.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.175.195
--webserver_port=0
--tserver_master_addrs=127.24.175.254:43417
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17367
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.195
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:40:08.728749 17367 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:40:08.728947 17367 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:40:08.733671 17382 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:40:08.733744 17377 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:40:08.733767 17367 server_base.cc:1034] running on GCE node
W20260811 16:40:08.733700 17376 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:40:08.734046 17367 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:40:08.734288 17367 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:40:08.735412 17367 hybrid_clock.cc:648] HybridClock initialized: now 1786466408735406 us; error 26 us; skew 500 ppm
Aug 11 16:40:08 dist-test-slave-zj8q krb5kdc[16729](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466408, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:40:08.737753 17367 init.cc:377] Logged in from keytab as kudu/127.24.175.195@KRBTEST.COM (short username kudu)
I20260811 16:40:08.738132 17367 webserver.cc:460] Webserver started at http://127.24.175.195:39817/ using document root <none> and password file <none>
I20260811 16:40:08.738381 17367 fs_manager.cc:359] Metadata directory not provided
I20260811 16:40:08.738425 17367 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:40:08.738512 17367 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:40:08.739441 17367 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-2/data/instance:
uuid: "4b0c7fb902f44dfaa9fca8b0040dad8f"
format_stamp: "Formatted at 2026-08-11 16:40:08 on dist-test-slave-zj8q"
server_key: "a1fce6b75b7c189005b4667f3a0423a7"
server_key_iv: "d9617499ba98fe305c9388eb56e089f8"
server_key_version: "encryptionkey@0"
I20260811 16:40:08.739709 17367 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-2/wal/instance:
uuid: "4b0c7fb902f44dfaa9fca8b0040dad8f"
format_stamp: "Formatted at 2026-08-11 16:40:08 on dist-test-slave-zj8q"
server_key: "a1fce6b75b7c189005b4667f3a0423a7"
server_key_iv: "d9617499ba98fe305c9388eb56e089f8"
server_key_version: "encryptionkey@0"
I20260811 16:40:08.740821 17367 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:40:08.741416 17395 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:40:08.741560 17367 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:40:08.741643 17367 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-2/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-2/wal
uuid: "4b0c7fb902f44dfaa9fca8b0040dad8f"
format_stamp: "Formatted at 2026-08-11 16:40:08 on dist-test-slave-zj8q"
server_key: "a1fce6b75b7c189005b4667f3a0423a7"
server_key_iv: "d9617499ba98fe305c9388eb56e089f8"
server_key_version: "encryptionkey@0"
I20260811 16:40:08.741700 17367 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:40:08.768134 17367 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:40:08.769901 17367 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:40:08.770035 17367 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:40:08.770279 17367 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:40:08.770606 17367 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:40:08.770640 17367 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:40:08.770670 17367 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:40:08.770687 17367 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:40:08.776468 17367 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.195:42421
I20260811 16:40:08.776541 17592 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.195:42421 every 8 connection(s)
I20260811 16:40:08.776819 17367 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
I20260811 16:40:08.779573 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 17367
I20260811 16:40:08.779659 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-2/wal/instance
I20260811 16:40:08.779815 25279 external_mini_cluster.cc:1428] Setting key 8bd6cc9d715632ba2f9e4c55102e098d
Aug 11 16:40:08 dist-test-slave-zj8q krb5kdc[16729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466408, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.195@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:40:08.785389 16884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:08.777528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.195:54777 (local address 127.24.175.254:43417)
0811 16:40:08.777580 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:08.777582 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:08.777781 (+ 199us) server_negotiation.cc:407] Connection header received
0811 16:40:08.778328 (+ 547us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:08.778330 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:08.778343 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:08.778394 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:40:08.779291 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:08.779836 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:08.781069 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:08.781269 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:08.781317 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:08.783252 (+ 1935us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:40:08.783254 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:40:08.783254 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:40:08.783261 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:40:08.784371 (+ 1110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:08.784721 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:08.784722 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:08.784722 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:08.784772 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:08.784941 (+ 169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:08.784941 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:08.784942 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:08.785033 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:40:08.785076 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0811 16:40:08.785266 (+ 190us) server_negotiation.cc:299] Negotiation successful
0811 16:40:08.785327 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 16:40:08.785564 17595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:08.777508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:43417 (local address 127.24.175.195:54777)
0811 16:40:08.777668 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:08.777703 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 16:40:08.778234 (+ 531us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:40:08.778462 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:40:08.778465 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:40:08.779005 (+ 540us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:40:08.779191 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:08.779196 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:08.779932 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:08.779933 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:08.780992 (+ 1059us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:08.780996 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:08.781327 (+ 331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:08.781328 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:08.781424 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:08.781807 (+ 383us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:40:08.781815 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:40:08.783174 (+ 1359us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:40:08.784459 (+ 1285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:40:08.784464 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:40:08.784466 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:40:08.784667 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:40:08.784815 (+ 148us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:40:08.784815 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:40:08.784815 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:40:08.784900 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:40:08.785072 (+ 172us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:40:08.785075 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:40:08.785177 (+ 102us) client_negotiation.cc:769] Sending connection context
0811 16:40:08.785250 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 16:40:08.785360 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":84,"threads_started":1}
I20260811 16:40:08.785976 17593 heartbeater.cc:347] Connected to a master server at 127.24.175.254:43417
I20260811 16:40:08.786064 17593 heartbeater.cc:464] Registering TS with master...
I20260811 16:40:08.786281 17593 heartbeater.cc:511] Master 127.24.175.254:43417 requested a full tablet report, sending...
I20260811 16:40:08.786623 16812 ts_manager.cc:194] Registered new tserver with Master: 4b0c7fb902f44dfaa9fca8b0040dad8f (127.24.175.195:42421)
I20260811 16:40:08.786954 16812 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.175.195@KRBTEST.COM'} at 127.24.175.195:54777
I20260811 16:40:08.791327 25279 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 16:40:08.807138 16884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:08.792549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55982 (local address 127.24.175.254:43417)
0811 16:40:08.792594 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:08.792596 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:08.792746 (+ 150us) server_negotiation.cc:407] Connection header received
0811 16:40:08.792790 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:08.792790 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:08.792798 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:08.792838 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:40:08.793318 (+ 480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:08.793756 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:08.794436 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:08.794605 (+ 169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:08.794648 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:08.805043 (+ 10395us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:40:08.805045 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:40:08.805045 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:40:08.805052 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:40:08.806307 (+ 1255us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:08.806587 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:08.806588 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:08.806588 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:08.806632 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:08.806756 (+ 124us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:08.806756 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:08.806757 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:08.806881 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:40:08.806949 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 16:40:08.807021 (+ 72us) server_negotiation.cc:299] Negotiation successful
0811 16:40:08.807074 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 16:40:08.808471 16812 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55982:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:40:08.809962 16812 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:40:08.815892 17609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:08.811987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.194:35265 (local address 127.0.0.1:58306)
0811 16:40:08.812200 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:08.812244 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 16:40:08.812310 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:40:08.812587 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:40:08.812590 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:40:08.812592 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:40:08.812643 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:08.812645 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:08.813686 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:08.813687 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:08.814899 (+ 1212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:08.814902 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:08.815603 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:08.815604 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:08.815681 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:08.815693 (+ 12us) client_negotiation.cc:769] Sending connection context
0811 16:40:08.815766 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 16:40:08.815821 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":74,"threads_started":1}
I20260811 16:40:08.815920 17612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:08.812084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58306 (local address 127.24.175.194:35265)
0811 16:40:08.812273 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:08.812278 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:08.812292 (+ 14us) server_negotiation.cc:407] Connection header received
0811 16:40:08.812405 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:08.812407 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:08.812423 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:08.812501 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:40:08.812792 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:08.813595 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:08.814989 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:08.815529 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:08.815595 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:08.815650 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 16:40:08.815791 (+ 141us) server_negotiation.cc:299] Negotiation successful
0811 16:40:08.815832 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":86,"threads_started":1}
I20260811 16:40:08.816196 17613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:08.812192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.195:42421 (local address 127.0.0.1:50276)
0811 16:40:08.812536 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:08.812544 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 16:40:08.812576 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:40:08.812884 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:40:08.812886 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:40:08.812888 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:40:08.812965 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:08.812966 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:08.814230 (+ 1264us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:08.814231 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:08.815070 (+ 839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:08.815073 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:08.815977 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:08.815978 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:08.816049 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:08.816053 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:40:08.816081 (+ 28us) client_negotiation.cc:240] Negotiation successful
0811 16:40:08.816123 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":336,"thread_start_us":49,"threads_started":1}
I20260811 16:40:08.816370 17614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:08.812287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58224 (local address 127.24.175.193:35661)
0811 16:40:08.812515 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:08.812520 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:08.812530 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:40:08.812571 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:08.812573 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:08.812588 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:08.812679 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:40:08.812764 (+ 85us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:08.813886 (+ 1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:08.815141 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:08.815892 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:08.815953 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:08.816007 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 16:40:08.816246 (+ 239us) server_negotiation.cc:299] Negotiation successful
0811 16:40:08.816292 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":197,"thread_start_us":100,"threads_started":1}
I20260811 16:40:08.816378 17611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:08.811987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.193:35661 (local address 127.0.0.1:58224)
0811 16:40:08.812421 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:08.812429 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 16:40:08.812466 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:40:08.812676 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:40:08.812677 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:40:08.812679 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:40:08.812720 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:08.812722 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:08.813992 (+ 1270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:08.813993 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:08.815061 (+ 1068us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:08.815063 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:08.816036 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:08.816037 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:08.816093 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:08.816095 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 16:40:08.816135 (+ 40us) client_negotiation.cc:240] Negotiation successful
0811 16:40:08.816180 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":423,"mutex_wait_us":3,"thread_start_us":76,"threads_started":1}
I20260811 16:40:08.816752 17615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:08.812348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50276 (local address 127.24.175.195:42421)
0811 16:40:08.812688 (+ 340us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:08.812693 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:08.812702 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:40:08.812735 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:08.812737 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:08.812753 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:08.813040 (+ 287us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:40:08.813122 (+ 82us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:08.814107 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:08.815156 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:08.815873 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:08.816396 (+ 523us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:08.816502 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 16:40:08.816530 (+ 28us) server_negotiation.cc:299] Negotiation successful
0811 16:40:08.816675 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":305,"thread_start_us":87,"threads_started":1}
I20260811 16:40:08.816949 17244 tablet_service.cc:1467] Processing CreateTablet for tablet 9d9fc60d8ece403c80a61ff4d30dace8 (DEFAULT_TABLE table=test-table [id=adec94c2091a450fbe4d6ab4b00d47d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:40:08.817184 17034 tablet_service.cc:1467] Processing CreateTablet for tablet 9d9fc60d8ece403c80a61ff4d30dace8 (DEFAULT_TABLE table=test-table [id=adec94c2091a450fbe4d6ab4b00d47d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:40:08.817350 17244 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d9fc60d8ece403c80a61ff4d30dace8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:40:08.817559 17034 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d9fc60d8ece403c80a61ff4d30dace8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:40:08.820188 17616 tablet_bootstrap.cc:492] T 9d9fc60d8ece403c80a61ff4d30dace8 P 2c02d356d12548a6ba3cab2218d7e6c3: Bootstrap starting.
I20260811 16:40:08.820392 17618 tablet_bootstrap.cc:492] T 9d9fc60d8ece403c80a61ff4d30dace8 P 2a0b5cba6b0841cc96d429b81d897f1c: Bootstrap starting.
I20260811 16:40:08.820892 17616 tablet_bootstrap.cc:654] T 9d9fc60d8ece403c80a61ff4d30dace8 P 2c02d356d12548a6ba3cab2218d7e6c3: Neither blocks nor log segments found. Creating new log.
I20260811 16:40:08.820843 17480 tablet_service.cc:1467] Processing CreateTablet for tablet 9d9fc60d8ece403c80a61ff4d30dace8 (DEFAULT_TABLE table=test-table [id=adec94c2091a450fbe4d6ab4b00d47d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:40:08.820982 17618 tablet_bootstrap.cc:654] T 9d9fc60d8ece403c80a61ff4d30dace8 P 2a0b5cba6b0841cc96d429b81d897f1c: Neither blocks nor log segments found. Creating new log.
I20260811 16:40:08.821135 17480 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d9fc60d8ece403c80a61ff4d30dace8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:40:08.821497 17616 log.cc:824] T 9d9fc60d8ece403c80a61ff4d30dace8 P 2c02d356d12548a6ba3cab2218d7e6c3: Log is configured to *not* fsync() on all Append() calls
I20260811 16:40:08.821527 17618 log.cc:824] T 9d9fc60d8ece403c80a61ff4d30dace8 P 2a0b5cba6b0841cc96d429b81d897f1c: Log is configured to *not* fsync() on all Append() calls
I20260811 16:40:08.822293 17618 tablet_bootstrap.cc:492] T 9d9fc60d8ece403c80a61ff4d30dace8 P 2a0b5cba6b0841cc96d429b81d897f1c: No bootstrap required, opened a new log
I20260811 16:40:08.822367 17618 ts_tablet_manager.cc:1397] T 9d9fc60d8ece403c80a61ff4d30dace8 P 2a0b5cba6b0841cc96d429b81d897f1c: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:40:08.822558 17616 tablet_bootstrap.cc:492] T 9d9fc60d8ece403c80a61ff4d30dace8 P 2c02d356d12548a6ba3cab2218d7e6c3: No bootstrap required, opened a new log
I20260811 16:40:08.822624 17616 ts_tablet_manager.cc:1397] T 9d9fc60d8ece403c80a61ff4d30dace8 P 2c02d356d12548a6ba3cab2218d7e6c3: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 16:40:08.823838 17627 tablet_bootstrap.cc:492] T 9d9fc60d8ece403c80a61ff4d30dace8 P 4b0c7fb902f44dfaa9fca8b0040dad8f: Bootstrap starting.
I20260811 16:40:08.824398 17627 tablet_bootstrap.cc:654] T 9d9fc60d8ece403c80a61ff4d30dace8 P 4b0c7fb902f44dfaa9fca8b0040dad8f: Neither blocks nor log segments found. Creating new log.
I20260811 16:40:08.824501 17616 raft_consensus.cc:348] T 9d9fc60d8ece403c80a61ff4d30dace8 P 2c02d356d12548a6ba3cab2218d7e6c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a0b5cba6b0841cc96d429b81d897f1c" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 35661 } } peers { permanent_uuid: "4b0c7fb902f44dfaa9fca8b0040dad8f" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42421 } } peers { permanent_uuid: "2c02d356d12548a6ba3cab2218d7e6c3" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 35265 } }
I20260811 16:40:08.824589 17618 raft_consensus.cc:348] T 9d9fc60d8ece403c80a61ff4d30dace8 P 2a0b5cba6b0841cc96d429b81d897f1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a0b5cba6b0841cc96d429b81d897f1c" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 35661 } } peers { permanent_uuid: "4b0c7fb902f44dfaa9fca8b0040dad8f" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42421 } } peers { permanent_uuid: "2c02d356d12548a6ba3cab2218d7e6c3" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 35265 } }
I20260811 16:40:08.824699 17616 raft_consensus.cc:374] T 9d9fc60d8ece403c80a61ff4d30dace8 P 2c02d356d12548a6ba3cab2218d7e6c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:40:08.824723 17618 raft_consensus.cc:374] T 9d9fc60d8ece403c80a61ff4d30dace8 P 2a0b5cba6b0841cc96d429b81d897f1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:40:08.824747 17616 raft_consensus.cc:729] T 9d9fc60d8ece403c80a61ff4d30dace8 P 2c02d356d12548a6ba3cab2218d7e6c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c02d356d12548a6ba3cab2218d7e6c3, State: Initialized, Role: FOLLOWER
I20260811 16:40:08.824755 17618 raft_consensus.cc:729] T 9d9fc60d8ece403c80a61ff4d30dace8 P 2a0b5cba6b0841cc96d429b81d897f1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a0b5cba6b0841cc96d429b81d897f1c, State: Initialized, Role: FOLLOWER
I20260811 16:40:08.824877 17627 log.cc:824] T 9d9fc60d8ece403c80a61ff4d30dace8 P 4b0c7fb902f44dfaa9fca8b0040dad8f: Log is configured to *not* fsync() on all Append() calls
I20260811 16:40:08.824896 17618 consensus_queue.cc:260] T 9d9fc60d8ece403c80a61ff4d30dace8 P 2a0b5cba6b0841cc96d429b81d897f1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a0b5cba6b0841cc96d429b81d897f1c" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 35661 } } peers { permanent_uuid: "4b0c7fb902f44dfaa9fca8b0040dad8f" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42421 } } peers { permanent_uuid: "2c02d356d12548a6ba3cab2218d7e6c3" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 35265 } }
I20260811 16:40:08.824896 17616 consensus_queue.cc:260] T 9d9fc60d8ece403c80a61ff4d30dace8 P 2c02d356d12548a6ba3cab2218d7e6c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a0b5cba6b0841cc96d429b81d897f1c" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 35661 } } peers { permanent_uuid: "4b0c7fb902f44dfaa9fca8b0040dad8f" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42421 } } peers { permanent_uuid: "2c02d356d12548a6ba3cab2218d7e6c3" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 35265 } }
I20260811 16:40:08.825199 17618 ts_tablet_manager.cc:1428] T 9d9fc60d8ece403c80a61ff4d30dace8 P 2a0b5cba6b0841cc96d429b81d897f1c: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 16:40:08.825196 17616 ts_tablet_manager.cc:1428] T 9d9fc60d8ece403c80a61ff4d30dace8 P 2c02d356d12548a6ba3cab2218d7e6c3: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 16:40:08.825320 17358 heartbeater.cc:503] Master 127.24.175.254:43417 was elected leader, sending a full tablet report...
I20260811 16:40:08.825320 17136 heartbeater.cc:503] Master 127.24.175.254:43417 was elected leader, sending a full tablet report...
I20260811 16:40:08.826134 17627 tablet_bootstrap.cc:492] T 9d9fc60d8ece403c80a61ff4d30dace8 P 4b0c7fb902f44dfaa9fca8b0040dad8f: No bootstrap required, opened a new log
I20260811 16:40:08.826224 17627 ts_tablet_manager.cc:1397] T 9d9fc60d8ece403c80a61ff4d30dace8 P 4b0c7fb902f44dfaa9fca8b0040dad8f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 16:40:08.827605 17627 raft_consensus.cc:348] T 9d9fc60d8ece403c80a61ff4d30dace8 P 4b0c7fb902f44dfaa9fca8b0040dad8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a0b5cba6b0841cc96d429b81d897f1c" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 35661 } } peers { permanent_uuid: "4b0c7fb902f44dfaa9fca8b0040dad8f" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42421 } } peers { permanent_uuid: "2c02d356d12548a6ba3cab2218d7e6c3" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 35265 } }
I20260811 16:40:08.827740 17627 raft_consensus.cc:374] T 9d9fc60d8ece403c80a61ff4d30dace8 P 4b0c7fb902f44dfaa9fca8b0040dad8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:40:08.827783 17627 raft_consensus.cc:729] T 9d9fc60d8ece403c80a61ff4d30dace8 P 4b0c7fb902f44dfaa9fca8b0040dad8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b0c7fb902f44dfaa9fca8b0040dad8f, State: Initialized, Role: FOLLOWER
I20260811 16:40:08.827926 17627 consensus_queue.cc:260] T 9d9fc60d8ece403c80a61ff4d30dace8 P 4b0c7fb902f44dfaa9fca8b0040dad8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a0b5cba6b0841cc96d429b81d897f1c" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 35661 } } peers { permanent_uuid: "4b0c7fb902f44dfaa9fca8b0040dad8f" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42421 } } peers { permanent_uuid: "2c02d356d12548a6ba3cab2218d7e6c3" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 35265 } }
I20260811 16:40:08.828171 17627 ts_tablet_manager.cc:1428] T 9d9fc60d8ece403c80a61ff4d30dace8 P 4b0c7fb902f44dfaa9fca8b0040dad8f: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 16:40:08.828213 17593 heartbeater.cc:503] Master 127.24.175.254:43417 was elected leader, sending a full tablet report...
W20260811 16:40:08.869103 17360 tablet.cc:2369] T 9d9fc60d8ece403c80a61ff4d30dace8 P 2c02d356d12548a6ba3cab2218d7e6c3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:40:08.946305 17629 raft_consensus.cc:482] T 9d9fc60d8ece403c80a61ff4d30dace8 P 2a0b5cba6b0841cc96d429b81d897f1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:40:08.946429 17629 raft_consensus.cc:504] T 9d9fc60d8ece403c80a61ff4d30dace8 P 2a0b5cba6b0841cc96d429b81d897f1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a0b5cba6b0841cc96d429b81d897f1c" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 35661 } } peers { permanent_uuid: "4b0c7fb902f44dfaa9fca8b0040dad8f" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42421 } } peers { permanent_uuid: "2c02d356d12548a6ba3cab2218d7e6c3" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 35265 } }
I20260811 16:40:08.946812 17629 leader_election.cc:288] T 9d9fc60d8ece403c80a61ff4d30dace8 P 2a0b5cba6b0841cc96d429b81d897f1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b0c7fb902f44dfaa9fca8b0040dad8f (127.24.175.195:42421), 2c02d356d12548a6ba3cab2218d7e6c3 (127.24.175.194:35265)
I20260811 16:40:08.950634 17615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:08.947050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:34277 (local address 127.24.175.195:42421)
0811 16:40:08.947100 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:08.947102 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:08.947113 (+ 11us) server_negotiation.cc:407] Connection header received
0811 16:40:08.947183 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:08.947184 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:08.947195 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:08.947246 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:40:08.947430 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:08.948183 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:08.949668 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:08.950283 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:08.950356 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:08.950365 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 16:40:08.950527 (+ 162us) server_negotiation.cc:299] Negotiation successful
0811 16:40:08.950563 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 16:40:08.950634 17612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:08.947057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:57747 (local address 127.24.175.194:35265)
0811 16:40:08.947098 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:08.947100 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:08.947288 (+ 188us) server_negotiation.cc:407] Connection header received
0811 16:40:08.947320 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:08.947321 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:08.947330 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:08.947371 (+ 41us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:40:08.947487 (+ 116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:08.948182 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:08.949668 (+ 1486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:08.950283 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:08.950356 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:08.950365 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 16:40:08.950527 (+ 162us) server_negotiation.cc:299] Negotiation successful
0811 16:40:08.950563 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 16:40:08.950682 17138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:08.946986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.195:42421 (local address 127.24.175.193:34277)
0811 16:40:08.947030 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:08.947045 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 16:40:08.947104 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:40:08.947278 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:40:08.947280 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:40:08.947281 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:40:08.947365 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:08.947367 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:08.948257 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:08.948258 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:08.949588 (+ 1330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:08.949591 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:08.950356 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:08.950357 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:08.950461 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:08.950462 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 16:40:08.950516 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 16:40:08.950566 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19,"mutex_wait_us":71}
I20260811 16:40:08.950690 17633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:08.946987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.194:35265 (local address 127.24.175.193:57747)
0811 16:40:08.947215 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:08.947224 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:40:08.947278 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:40:08.947372 (+ 94us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:40:08.947373 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:40:08.947374 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:40:08.947433 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:08.947434 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:08.948251 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:08.948251 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:08.949587 (+ 1336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:08.949591 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:08.950356 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:08.950357 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:08.950456 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:08.950461 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 16:40:08.950516 (+ 55us) client_negotiation.cc:240] Negotiation successful
0811 16:40:08.950566 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":218,"mutex_wait_us":166,"thread_start_us":90,"threads_started":1}
I20260811 16:40:08.951020 17518 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d9fc60d8ece403c80a61ff4d30dace8" candidate_uuid: "2a0b5cba6b0841cc96d429b81d897f1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b0c7fb902f44dfaa9fca8b0040dad8f" is_pre_election: true
I20260811 16:40:08.951160 17518 raft_consensus.cc:2454] T 9d9fc60d8ece403c80a61ff4d30dace8 P 4b0c7fb902f44dfaa9fca8b0040dad8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a0b5cba6b0841cc96d429b81d897f1c in term 0.
I20260811 16:40:08.951357 17276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d9fc60d8ece403c80a61ff4d30dace8" candidate_uuid: "2a0b5cba6b0841cc96d429b81d897f1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c02d356d12548a6ba3cab2218d7e6c3" is_pre_election: true
I20260811 16:40:08.951390 16951 leader_election.cc:302] T 9d9fc60d8ece403c80a61ff4d30dace8 P 2a0b5cba6b0841cc96d429b81d897f1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a0b5cba6b0841cc96d429b81d897f1c, 4b0c7fb902f44dfaa9fca8b0040dad8f; no voters:
I20260811 16:40:08.951483 17276 raft_consensus.cc:2454] T 9d9fc60d8ece403c80a61ff4d30dace8 P 2c02d356d12548a6ba3cab2218d7e6c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a0b5cba6b0841cc96d429b81d897f1c in term 0.
I20260811 16:40:08.951519 17629 raft_consensus.cc:2781] T 9d9fc60d8ece403c80a61ff4d30dace8 P 2a0b5cba6b0841cc96d429b81d897f1c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:40:08.951592 17629 raft_consensus.cc:482] T 9d9fc60d8ece403c80a61ff4d30dace8 P 2a0b5cba6b0841cc96d429b81d897f1c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:40:08.951624 17629 raft_consensus.cc:3037] T 9d9fc60d8ece403c80a61ff4d30dace8 P 2a0b5cba6b0841cc96d429b81d897f1c [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:40:08.952368 17629 raft_consensus.cc:504] T 9d9fc60d8ece403c80a61ff4d30dace8 P 2a0b5cba6b0841cc96d429b81d897f1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a0b5cba6b0841cc96d429b81d897f1c" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 35661 } } peers { permanent_uuid: "4b0c7fb902f44dfaa9fca8b0040dad8f" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42421 } } peers { permanent_uuid: "2c02d356d12548a6ba3cab2218d7e6c3" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 35265 } }
I20260811 16:40:08.952490 17629 leader_election.cc:288] T 9d9fc60d8ece403c80a61ff4d30dace8 P 2a0b5cba6b0841cc96d429b81d897f1c [CANDIDATE]: Term 1 election: Requested vote from peers 4b0c7fb902f44dfaa9fca8b0040dad8f (127.24.175.195:42421), 2c02d356d12548a6ba3cab2218d7e6c3 (127.24.175.194:35265)
I20260811 16:40:08.952649 17518 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d9fc60d8ece403c80a61ff4d30dace8" candidate_uuid: "2a0b5cba6b0841cc96d429b81d897f1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b0c7fb902f44dfaa9fca8b0040dad8f"
I20260811 16:40:08.952674 17276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d9fc60d8ece403c80a61ff4d30dace8" candidate_uuid: "2a0b5cba6b0841cc96d429b81d897f1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c02d356d12548a6ba3cab2218d7e6c3"
I20260811 16:40:08.952733 17276 raft_consensus.cc:3037] T 9d9fc60d8ece403c80a61ff4d30dace8 P 2c02d356d12548a6ba3cab2218d7e6c3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:40:08.952732 17518 raft_consensus.cc:3037] T 9d9fc60d8ece403c80a61ff4d30dace8 P 4b0c7fb902f44dfaa9fca8b0040dad8f [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:40:08.953595 17518 raft_consensus.cc:2454] T 9d9fc60d8ece403c80a61ff4d30dace8 P 4b0c7fb902f44dfaa9fca8b0040dad8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a0b5cba6b0841cc96d429b81d897f1c in term 1.
I20260811 16:40:08.953595 17276 raft_consensus.cc:2454] T 9d9fc60d8ece403c80a61ff4d30dace8 P 2c02d356d12548a6ba3cab2218d7e6c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a0b5cba6b0841cc96d429b81d897f1c in term 1.
I20260811 16:40:08.953760 16946 leader_election.cc:302] T 9d9fc60d8ece403c80a61ff4d30dace8 P 2a0b5cba6b0841cc96d429b81d897f1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a0b5cba6b0841cc96d429b81d897f1c, 2c02d356d12548a6ba3cab2218d7e6c3; no voters:
I20260811 16:40:08.953863 17629 raft_consensus.cc:2781] T 9d9fc60d8ece403c80a61ff4d30dace8 P 2a0b5cba6b0841cc96d429b81d897f1c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:40:08.954030 17629 raft_consensus.cc:686] T 9d9fc60d8ece403c80a61ff4d30dace8 P 2a0b5cba6b0841cc96d429b81d897f1c [term 1 LEADER]: Becoming Leader. State: Replica: 2a0b5cba6b0841cc96d429b81d897f1c, State: Running, Role: LEADER
I20260811 16:40:08.954123 17629 consensus_queue.cc:237] T 9d9fc60d8ece403c80a61ff4d30dace8 P 2a0b5cba6b0841cc96d429b81d897f1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a0b5cba6b0841cc96d429b81d897f1c" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 35661 } } peers { permanent_uuid: "4b0c7fb902f44dfaa9fca8b0040dad8f" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42421 } } peers { permanent_uuid: "2c02d356d12548a6ba3cab2218d7e6c3" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 35265 } }
I20260811 16:40:08.954948 16811 catalog_manager.cc:5495] T 9d9fc60d8ece403c80a61ff4d30dace8 P 2a0b5cba6b0841cc96d429b81d897f1c reported cstate change: term changed from 0 to 1, leader changed from <none> to 2a0b5cba6b0841cc96d429b81d897f1c (127.24.175.193). New cstate: current_term: 1 leader_uuid: "2a0b5cba6b0841cc96d429b81d897f1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a0b5cba6b0841cc96d429b81d897f1c" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 35661 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b0c7fb902f44dfaa9fca8b0040dad8f" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c02d356d12548a6ba3cab2218d7e6c3" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 35265 } health_report { overall_health: UNKNOWN } } }
W20260811 16:40:08.976284 17137 tablet.cc:2369] T 9d9fc60d8ece403c80a61ff4d30dace8 P 2a0b5cba6b0841cc96d429b81d897f1c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:40:08.994841 17614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:08.992739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58240 (local address 127.24.175.193:35661)
0811 16:40:08.992781 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:08.992783 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:08.992790 (+ 7us) server_negotiation.cc:407] Connection header received
0811 16:40:08.992853 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:08.992854 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:08.992871 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:08.992926 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:40:08.993023 (+ 97us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:08.993486 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:08.994242 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:08.994427 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:08.994474 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:08.994576 (+ 102us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:40:08.994667 (+ 91us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:40:08.994720 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 16:40:08.994737 (+ 17us) server_negotiation.cc:299] Negotiation successful
0811 16:40:08.994753 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 16:40:08.996487 17518 raft_consensus.cc:1261] T 9d9fc60d8ece403c80a61ff4d30dace8 P 4b0c7fb902f44dfaa9fca8b0040dad8f [term 1 FOLLOWER]: Refusing update from remote peer 2a0b5cba6b0841cc96d429b81d897f1c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:40:08.996487 17276 raft_consensus.cc:1261] T 9d9fc60d8ece403c80a61ff4d30dace8 P 2c02d356d12548a6ba3cab2218d7e6c3 [term 1 FOLLOWER]: Refusing update from remote peer 2a0b5cba6b0841cc96d429b81d897f1c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:40:08.996851 17629 consensus_queue.cc:1035] T 9d9fc60d8ece403c80a61ff4d30dace8 P 2a0b5cba6b0841cc96d429b81d897f1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c02d356d12548a6ba3cab2218d7e6c3" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 35265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:40:08.996997 17634 consensus_queue.cc:1035] T 9d9fc60d8ece403c80a61ff4d30dace8 P 2a0b5cba6b0841cc96d429b81d897f1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b0c7fb902f44dfaa9fca8b0040dad8f" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:40:08.999264 17641 mvcc.cc:205] Tried to move back new op lower bound from 7317366411247214592 to 7317366411076694016. Current Snapshot: MvccSnapshot[applied={T|T < 7317366411247214592}]
I20260811 16:40:08.999665 17644 mvcc.cc:205] Tried to move back new op lower bound from 7317366411247214592 to 7317366411076694016. Current Snapshot: MvccSnapshot[applied={T|T < 7317366411247214592 or (T in {7317366411247214592})}]
I20260811 16:40:08.999842 17642 mvcc.cc:205] Tried to move back new op lower bound from 7317366411247214592 to 7317366411076694016. Current Snapshot: MvccSnapshot[applied={T|T < 7317366411247214592}]
I20260811 16:40:09.002333 16811 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55982:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:40:09.002418 16811 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55982:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:40:09.003108 16811 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e7a415dfffbc4cec9b7cc7d6384957b2: Sending DeleteTablet for 3 replicas of tablet 9d9fc60d8ece403c80a61ff4d30dace8
I20260811 16:40:09.003451 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 16920
I20260811 16:40:09.003523 17034 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d9fc60d8ece403c80a61ff4d30dace8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:40:08 UTC) from {username='kudu', principal='kudu/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:58224
I20260811 16:40:09.003540 17480 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d9fc60d8ece403c80a61ff4d30dace8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:40:08 UTC) from {username='kudu', principal='kudu/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:50276
I20260811 16:40:09.003778 17653 tablet_replica.cc:330] T 9d9fc60d8ece403c80a61ff4d30dace8 P 4b0c7fb902f44dfaa9fca8b0040dad8f: stopping tablet replica
I20260811 16:40:09.003861 17653 raft_consensus.cc:2229] T 9d9fc60d8ece403c80a61ff4d30dace8 P 4b0c7fb902f44dfaa9fca8b0040dad8f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:40:09.004021 17653 raft_consensus.cc:2258] T 9d9fc60d8ece403c80a61ff4d30dace8 P 4b0c7fb902f44dfaa9fca8b0040dad8f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:40:09.004001 17244 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d9fc60d8ece403c80a61ff4d30dace8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:40:08 UTC) from {username='kudu', principal='kudu/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:58306
I20260811 16:40:09.004242 17654 tablet_replica.cc:330] T 9d9fc60d8ece403c80a61ff4d30dace8 P 2c02d356d12548a6ba3cab2218d7e6c3: stopping tablet replica
I20260811 16:40:09.004318 17654 raft_consensus.cc:2229] T 9d9fc60d8ece403c80a61ff4d30dace8 P 2c02d356d12548a6ba3cab2218d7e6c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:40:09.004381 17654 raft_consensus.cc:2258] T 9d9fc60d8ece403c80a61ff4d30dace8 P 2c02d356d12548a6ba3cab2218d7e6c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:40:09.008625 17654 ts_tablet_manager.cc:1905] T 9d9fc60d8ece403c80a61ff4d30dace8 P 2c02d356d12548a6ba3cab2218d7e6c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:40:09.009876 17653 ts_tablet_manager.cc:1905] T 9d9fc60d8ece403c80a61ff4d30dace8 P 4b0c7fb902f44dfaa9fca8b0040dad8f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:40:09.009984 17654 ts_tablet_manager.cc:1918] T 9d9fc60d8ece403c80a61ff4d30dace8 P 2c02d356d12548a6ba3cab2218d7e6c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:40:09.010038 17654 log.cc:1196] T 9d9fc60d8ece403c80a61ff4d30dace8 P 2c02d356d12548a6ba3cab2218d7e6c3: Deleting WAL directory at /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-1/wal/wals/9d9fc60d8ece403c80a61ff4d30dace8
I20260811 16:40:09.010295 17654 ts_tablet_manager.cc:1939] T 9d9fc60d8ece403c80a61ff4d30dace8 P 2c02d356d12548a6ba3cab2218d7e6c3: Deleting consensus metadata
I20260811 16:40:09.010634 16783 catalog_manager.cc:4841] TS 2c02d356d12548a6ba3cab2218d7e6c3 (127.24.175.194:35265): tablet 9d9fc60d8ece403c80a61ff4d30dace8 (table test-table [id=adec94c2091a450fbe4d6ab4b00d47d9]) successfully deleted
I20260811 16:40:09.011787 17653 ts_tablet_manager.cc:1918] T 9d9fc60d8ece403c80a61ff4d30dace8 P 4b0c7fb902f44dfaa9fca8b0040dad8f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:40:09.011868 17653 log.cc:1196] T 9d9fc60d8ece403c80a61ff4d30dace8 P 4b0c7fb902f44dfaa9fca8b0040dad8f: Deleting WAL directory at /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-2/wal/wals/9d9fc60d8ece403c80a61ff4d30dace8
I20260811 16:40:09.012199 17653 ts_tablet_manager.cc:1939] T 9d9fc60d8ece403c80a61ff4d30dace8 P 4b0c7fb902f44dfaa9fca8b0040dad8f: Deleting consensus metadata
I20260811 16:40:09.012703 16785 catalog_manager.cc:4841] TS 4b0c7fb902f44dfaa9fca8b0040dad8f (127.24.175.195:42421): tablet 9d9fc60d8ece403c80a61ff4d30dace8 (table test-table [id=adec94c2091a450fbe4d6ab4b00d47d9]) successfully deleted
W20260811 16:40:09.025398 16785 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.24.175.193:35661 (error 108)
I20260811 16:40:09.025609 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 17141
I20260811 16:40:09.027415 17611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:09.025761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.193:35661 (local address 127.0.0.1:58244)
0811 16:40:09.027328 (+ 1567us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:09.027382 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.193:35661: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1541}
W20260811 16:40:09.029935 16785 catalog_manager.cc:4584] TS 2a0b5cba6b0841cc96d429b81d897f1c (127.24.175.193:35661): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9d9fc60d8ece403c80a61ff4d30dace8: Network error: Client connection negotiation failed: client connection to 127.24.175.193:35661: connect: Connection refused (error 111)
I20260811 16:40:09.033408 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 17367
I20260811 16:40:09.044661 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 16753
I20260811 16:40:09.058530 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:43417
--webserver_interface=127.24.175.254
--webserver_port=34861
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:43091
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.175.254:43417
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:40:09.140381 17657 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:40:09.140595 17657 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:40:09.140626 17657 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:40:09.141791 17657 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:40:09.141844 17657 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:40:09.141857 17657 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:40:09.141880 17657 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:40:09.141904 17657 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:40:09.143488 17657 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:43091
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.24.175.254:43417
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:43417
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.175.254
--webserver_port=34861
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17657
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:40:09.143744 17657 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:40:09.143960 17657 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:40:09.153208 17667 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:40:09.153307 17657 server_base.cc:1034] running on GCE node
W20260811 16:40:09.153216 17665 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:40:09.153229 17669 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:40:09.153746 17657 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:40:09.154049 17657 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:40:09.155184 17657 hybrid_clock.cc:648] HybridClock initialized: now 1786466409155165 us; error 34 us; skew 500 ppm
Aug 11 16:40:09 dist-test-slave-zj8q krb5kdc[16729](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466409, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:40:09.157707 17657 init.cc:377] Logged in from keytab as kudu/127.24.175.254@KRBTEST.COM (short username kudu)
I20260811 16:40:09.158180 17657 webserver.cc:460] Webserver started at http://127.24.175.254:34861/ using document root <none> and password file <none>
I20260811 16:40:09.158411 17657 fs_manager.cc:359] Metadata directory not provided
I20260811 16:40:09.158468 17657 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:40:09.159889 17657 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:40:09.160514 17680 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:40:09.160725 17657 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:40:09.160826 17657 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/master-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/master-0/wal
uuid: "e7a415dfffbc4cec9b7cc7d6384957b2"
format_stamp: "Formatted at 2026-08-11 16:40:08 on dist-test-slave-zj8q"
server_key: "4efc226e2e52c9e7fd6bea9265871d2c"
server_key_iv: "0adc06fbab24e5bff70247d4f338ca3c"
server_key_version: "encryptionkey@0"
I20260811 16:40:09.161258 17657 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:40:09.184643 17657 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:40:09.186815 17657 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:40:09.186966 17657 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:40:09.190995 17657 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.254:43417
I20260811 16:40:09.191042 17763 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.254:43417 every 8 connection(s)
I20260811 16:40:09.191448 17657 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
I20260811 16:40:09.193379 17765 sys_catalog.cc:263] Verifying existing consensus state
I20260811 16:40:09.193766 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 17657
I20260811 16:40:09.194054 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.193:35661
--local_ip_for_outbound_sockets=127.24.175.193
--tserver_master_addrs=127.24.175.254:43417
--webserver_port=34417
--webserver_interface=127.24.175.193
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab
--principal=kudu/127.24.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:43091
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 16:40:09.194260 17765 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e7a415dfffbc4cec9b7cc7d6384957b2: Bootstrap starting.
I20260811 16:40:09.203608 17765 log.cc:824] T 00000000000000000000000000000000 P e7a415dfffbc4cec9b7cc7d6384957b2: Log is configured to *not* fsync() on all Append() calls
I20260811 16:40:09.205648 17765 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e7a415dfffbc4cec9b7cc7d6384957b2: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:40:09.206037 17765 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e7a415dfffbc4cec9b7cc7d6384957b2: Bootstrap complete.
I20260811 16:40:09.208388 17765 raft_consensus.cc:348] T 00000000000000000000000000000000 P e7a415dfffbc4cec9b7cc7d6384957b2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7a415dfffbc4cec9b7cc7d6384957b2" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 43417 } }
I20260811 16:40:09.208649 17765 raft_consensus.cc:729] T 00000000000000000000000000000000 P e7a415dfffbc4cec9b7cc7d6384957b2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7a415dfffbc4cec9b7cc7d6384957b2, State: Initialized, Role: FOLLOWER
I20260811 16:40:09.208797 17765 consensus_queue.cc:260] T 00000000000000000000000000000000 P e7a415dfffbc4cec9b7cc7d6384957b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7a415dfffbc4cec9b7cc7d6384957b2" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 43417 } }
I20260811 16:40:09.208864 17765 raft_consensus.cc:388] T 00000000000000000000000000000000 P e7a415dfffbc4cec9b7cc7d6384957b2 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:40:09.208910 17765 raft_consensus.cc:482] T 00000000000000000000000000000000 P e7a415dfffbc4cec9b7cc7d6384957b2 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:40:09.208953 17765 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e7a415dfffbc4cec9b7cc7d6384957b2 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:40:09.210031 17765 raft_consensus.cc:504] T 00000000000000000000000000000000 P e7a415dfffbc4cec9b7cc7d6384957b2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7a415dfffbc4cec9b7cc7d6384957b2" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 43417 } }
I20260811 16:40:09.210129 17765 leader_election.cc:302] T 00000000000000000000000000000000 P e7a415dfffbc4cec9b7cc7d6384957b2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e7a415dfffbc4cec9b7cc7d6384957b2; no voters:
I20260811 16:40:09.210323 17765 leader_election.cc:288] T 00000000000000000000000000000000 P e7a415dfffbc4cec9b7cc7d6384957b2 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 16:40:09.210376 17775 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e7a415dfffbc4cec9b7cc7d6384957b2 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:40:09.210485 17775 raft_consensus.cc:686] T 00000000000000000000000000000000 P e7a415dfffbc4cec9b7cc7d6384957b2 [term 2 LEADER]: Becoming Leader. State: Replica: e7a415dfffbc4cec9b7cc7d6384957b2, State: Running, Role: LEADER
I20260811 16:40:09.210614 17765 sys_catalog.cc:564] T 00000000000000000000000000000000 P e7a415dfffbc4cec9b7cc7d6384957b2 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:40:09.210594 17775 consensus_queue.cc:237] T 00000000000000000000000000000000 P e7a415dfffbc4cec9b7cc7d6384957b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7a415dfffbc4cec9b7cc7d6384957b2" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 43417 } }
I20260811 16:40:09.210897 17776 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7a415dfffbc4cec9b7cc7d6384957b2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "e7a415dfffbc4cec9b7cc7d6384957b2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7a415dfffbc4cec9b7cc7d6384957b2" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 43417 } } }
I20260811 16:40:09.211102 17776 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7a415dfffbc4cec9b7cc7d6384957b2 [sys.catalog]: This master's current role is: LEADER
I20260811 16:40:09.211046 17777 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7a415dfffbc4cec9b7cc7d6384957b2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e7a415dfffbc4cec9b7cc7d6384957b2. Latest consensus state: current_term: 2 leader_uuid: "e7a415dfffbc4cec9b7cc7d6384957b2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7a415dfffbc4cec9b7cc7d6384957b2" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 43417 } } }
I20260811 16:40:09.211359 17777 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7a415dfffbc4cec9b7cc7d6384957b2 [sys.catalog]: This master's current role is: LEADER
I20260811 16:40:09.211499 17788 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:40:09.212325 17788 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:40:09.212426 17788 catalog_manager.cc:1259] Loaded cluster ID: 334d3b42530d48ddab536501d4881e1f
I20260811 16:40:09.212462 17788 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:40:09.212827 17788 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260811 16:40:09.215549 17788 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260811 16:40:09.219345 17788 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:40:09.219878 17788 catalog_manager.cc:5879] T 00000000000000000000000000000000 P e7a415dfffbc4cec9b7cc7d6384957b2: Loaded TSK: 0
I20260811 16:40:09.220078 17788 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 16:40:09.293941 17772 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:40:09.294185 17772 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:40:09.294224 17772 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:40:09.295403 17772 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:40:09.295447 17772 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:40:09.295481 17772 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.193
I20260811 16:40:09.296985 17772 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:43091
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab
--principal=kudu/127.24.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.193:35661
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.175.193
--webserver_port=34417
--tserver_master_addrs=127.24.175.254:43417
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17772
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.193
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:40:09.297221 17772 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:40:09.297436 17772 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:40:09.303630 17808 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:40:09.303589 17803 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:40:09.303799 17772 server_base.cc:1034] running on GCE node
W20260811 16:40:09.303907 17805 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:40:09.304164 17772 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:40:09.304493 17772 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:40:09.305687 17772 hybrid_clock.cc:648] HybridClock initialized: now 1786466409305663 us; error 33 us; skew 500 ppm
Aug 11 16:40:09 dist-test-slave-zj8q krb5kdc[16729](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466409, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:40:09.308780 17772 init.cc:377] Logged in from keytab as kudu/127.24.175.193@KRBTEST.COM (short username kudu)
I20260811 16:40:09.309345 17772 webserver.cc:460] Webserver started at http://127.24.175.193:34417/ using document root <none> and password file <none>
I20260811 16:40:09.309640 17772 fs_manager.cc:359] Metadata directory not provided
I20260811 16:40:09.309731 17772 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:40:09.311576 17772 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:40:09.312345 17824 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:40:09.312518 17772 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:40:09.312624 17772 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-0/wal
uuid: "2a0b5cba6b0841cc96d429b81d897f1c"
format_stamp: "Formatted at 2026-08-11 16:40:08 on dist-test-slave-zj8q"
server_key: "5d82e7a0fab7c861312c6593bf7add77"
server_key_iv: "34004a6a29407ba0eb356c1003722175"
server_key_version: "encryptionkey@0"
I20260811 16:40:09.313083 17772 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:40:09.325688 17772 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:40:09.327894 17772 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:40:09.328053 17772 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:40:09.328286 17772 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:40:09.328745 17835 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 16:40:09.330482 17772 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 16:40:09.330545 17772 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260811 16:40:09.330579 17772 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 16:40:09.331472 17772 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 16:40:09.331516 17772 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260811 16:40:09.331573 17835 tablet_bootstrap.cc:492] T 9d9fc60d8ece403c80a61ff4d30dace8 P 2a0b5cba6b0841cc96d429b81d897f1c: Bootstrap starting.
I20260811 16:40:09.338897 17772 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.193:35661
I20260811 16:40:09.339159 18021 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.193:35661 every 8 connection(s)
I20260811 16:40:09.339363 17772 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
I20260811 16:40:09.340204 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 17772
I20260811 16:40:09.340508 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.194:35265
--local_ip_for_outbound_sockets=127.24.175.194
--tserver_master_addrs=127.24.175.254:43417
--webserver_port=42253
--webserver_interface=127.24.175.194
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab
--principal=kudu/127.24.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:43091
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 16:40:09.342801 17835 log.cc:824] T 9d9fc60d8ece403c80a61ff4d30dace8 P 2a0b5cba6b0841cc96d429b81d897f1c: Log is configured to *not* fsync() on all Append() calls
I20260811 16:40:09.345491 17835 tablet_bootstrap.cc:492] T 9d9fc60d8ece403c80a61ff4d30dace8 P 2a0b5cba6b0841cc96d429b81d897f1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:40:09.345818 17835 tablet_bootstrap.cc:492] T 9d9fc60d8ece403c80a61ff4d30dace8 P 2a0b5cba6b0841cc96d429b81d897f1c: Bootstrap complete.
I20260811 16:40:09.346967 17835 ts_tablet_manager.cc:1397] T 9d9fc60d8ece403c80a61ff4d30dace8 P 2a0b5cba6b0841cc96d429b81d897f1c: Time spent bootstrapping tablet: real 0.015s user 0.005s sys 0.009s
I20260811 16:40:09.348356 17835 raft_consensus.cc:348] T 9d9fc60d8ece403c80a61ff4d30dace8 P 2a0b5cba6b0841cc96d429b81d897f1c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a0b5cba6b0841cc96d429b81d897f1c" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 35661 } } peers { permanent_uuid: "4b0c7fb902f44dfaa9fca8b0040dad8f" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42421 } } peers { permanent_uuid: "2c02d356d12548a6ba3cab2218d7e6c3" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 35265 } }
I20260811 16:40:09.348693 17835 raft_consensus.cc:729] T 9d9fc60d8ece403c80a61ff4d30dace8 P 2a0b5cba6b0841cc96d429b81d897f1c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a0b5cba6b0841cc96d429b81d897f1c, State: Initialized, Role: FOLLOWER
I20260811 16:40:09.348841 17835 consensus_queue.cc:260] T 9d9fc60d8ece403c80a61ff4d30dace8 P 2a0b5cba6b0841cc96d429b81d897f1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a0b5cba6b0841cc96d429b81d897f1c" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 35661 } } peers { permanent_uuid: "4b0c7fb902f44dfaa9fca8b0040dad8f" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42421 } } peers { permanent_uuid: "2c02d356d12548a6ba3cab2218d7e6c3" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 35265 } }
I20260811 16:40:09.349139 17835 ts_tablet_manager.cc:1428] T 9d9fc60d8ece403c80a61ff4d30dace8 P 2a0b5cba6b0841cc96d429b81d897f1c: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
Aug 11 16:40:09 dist-test-slave-zj8q krb5kdc[16729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466409, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.193@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:40:09.355135 18024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:09.340117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:43417 (local address 127.24.175.193:53339)
0811 16:40:09.342302 (+ 2185us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:09.342354 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 16:40:09.342982 (+ 628us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:40:09.343584 (+ 602us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:40:09.343588 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:40:09.343944 (+ 356us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:40:09.344218 (+ 274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:09.344226 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:09.345957 (+ 1731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:09.345958 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:09.347364 (+ 1406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:09.347367 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:09.348281 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:09.348282 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:09.348425 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:09.349045 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:40:09.349056 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:40:09.350990 (+ 1934us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:40:09.353279 (+ 2289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:40:09.353287 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:40:09.353289 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:40:09.353583 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:40:09.353891 (+ 308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:40:09.353892 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:40:09.353892 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:40:09.354015 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:40:09.354519 (+ 504us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:40:09.354524 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:40:09.354672 (+ 148us) client_negotiation.cc:769] Sending connection context
0811 16:40:09.354761 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 16:40:09.354920 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2135,"thread_start_us":93,"threads_started":1}
I20260811 16:40:09.355760 18025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:09.340236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:53339 (local address 127.24.175.254:43417)
0811 16:40:09.343126 (+ 2890us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:09.343135 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:09.343178 (+ 43us) server_negotiation.cc:407] Connection header received
0811 16:40:09.343333 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:09.343340 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:09.343393 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:09.343570 (+ 177us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:40:09.344378 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:09.345804 (+ 1426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:09.347463 (+ 1659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:09.348074 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:09.348180 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:09.351126 (+ 2946us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:40:09.351131 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:40:09.351131 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:40:09.351145 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:40:09.353180 (+ 2035us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:09.353685 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:09.353689 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:09.353689 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:09.353823 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:09.354099 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:09.354100 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:09.354100 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:09.354432 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:40:09.354520 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 16:40:09.355430 (+ 910us) server_negotiation.cc:299] Negotiation successful
0811 16:40:09.355576 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2838,"thread_start_us":84,"threads_started":1}
I20260811 16:40:09.356427 18022 heartbeater.cc:347] Connected to a master server at 127.24.175.254:43417
I20260811 16:40:09.356524 18022 heartbeater.cc:464] Registering TS with master...
I20260811 16:40:09.356693 18022 heartbeater.cc:511] Master 127.24.175.254:43417 requested a full tablet report, sending...
I20260811 16:40:09.357430 17701 ts_manager.cc:194] Registered new tserver with Master: 2a0b5cba6b0841cc96d429b81d897f1c (127.24.175.193:35661)
I20260811 16:40:09.358662 17701 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.175.193@KRBTEST.COM'} at 127.24.175.193:53339
I20260811 16:40:09.359592 18022 heartbeater.cc:503] Master 127.24.175.254:43417 was elected leader, sending a full tablet report...
I20260811 16:40:09.366611 18032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:09.358331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58258 (local address 127.24.175.193:35661)
0811 16:40:09.362502 (+ 4171us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:09.362507 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:09.362515 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:40:09.362546 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:09.362548 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:09.362563 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:09.362659 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:40:09.362848 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:09.363979 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:09.365532 (+ 1553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:09.366242 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:09.366317 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:09.366372 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 16:40:09.366504 (+ 132us) server_negotiation.cc:299] Negotiation successful
0811 16:40:09.366543 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4142,"thread_start_us":72,"threads_started":1}
I20260811 16:40:09.366614 18031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:09.358046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.193:35661 (local address 127.0.0.1:58258)
0811 16:40:09.362277 (+ 4231us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:09.362317 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 16:40:09.362384 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:40:09.362699 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:40:09.362703 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:40:09.362706 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:40:09.362770 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:09.362772 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:09.364102 (+ 1330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:09.364103 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:09.365430 (+ 1327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:09.365432 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:09.366317 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:09.366318 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:09.366404 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:09.366417 (+ 13us) client_negotiation.cc:769] Sending connection context
0811 16:40:09.366486 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 16:40:09.366536 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4196,"thread_start_us":131,"threads_started":1}
I20260811 16:40:09.367333 17896 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d9fc60d8ece403c80a61ff4d30dace8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:40:08 UTC) from {username='kudu', principal='kudu/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:58258
I20260811 16:40:09.367913 18033 tablet_replica.cc:330] stopping tablet replica
I20260811 16:40:09.368023 18033 raft_consensus.cc:2229] T 9d9fc60d8ece403c80a61ff4d30dace8 P 2a0b5cba6b0841cc96d429b81d897f1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:40:09.368116 18033 raft_consensus.cc:2258] T 9d9fc60d8ece403c80a61ff4d30dace8 P 2a0b5cba6b0841cc96d429b81d897f1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:40:09.368446 18033 ts_tablet_manager.cc:1905] T 9d9fc60d8ece403c80a61ff4d30dace8 P 2a0b5cba6b0841cc96d429b81d897f1c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:40:09.370672 18033 ts_tablet_manager.cc:1918] T 9d9fc60d8ece403c80a61ff4d30dace8 P 2a0b5cba6b0841cc96d429b81d897f1c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:40:09.370749 18033 log.cc:1196] T 9d9fc60d8ece403c80a61ff4d30dace8 P 2a0b5cba6b0841cc96d429b81d897f1c: Deleting WAL directory at /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-0/wal/wals/9d9fc60d8ece403c80a61ff4d30dace8
I20260811 16:40:09.370959 18033 ts_tablet_manager.cc:1939] T 9d9fc60d8ece403c80a61ff4d30dace8 P 2a0b5cba6b0841cc96d429b81d897f1c: Deleting consensus metadata
I20260811 16:40:09.371515 17685 catalog_manager.cc:4841] TS 2a0b5cba6b0841cc96d429b81d897f1c (127.24.175.193:35661): tablet 9d9fc60d8ece403c80a61ff4d30dace8 (table test-table [id=adec94c2091a450fbe4d6ab4b00d47d9]) successfully deleted
W20260811 16:40:09.430716 18027 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:40:09.430917 18027 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:40:09.430948 18027 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:40:09.432060 18027 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:40:09.432101 18027 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:40:09.432135 18027 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.194
I20260811 16:40:09.433627 18027 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:43091
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab
--principal=kudu/127.24.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.194:35265
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.175.194
--webserver_port=42253
--tserver_master_addrs=127.24.175.254:43417
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18027
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.194
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:40:09.433866 18027 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:40:09.434080 18027 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:40:09.438948 18042 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:40:09.438961 18043 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:40:09.438958 18050 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:40:09.439043 18027 server_base.cc:1034] running on GCE node
I20260811 16:40:09.439363 18027 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:40:09.439592 18027 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:40:09.440744 18027 hybrid_clock.cc:648] HybridClock initialized: now 1786466409440736 us; error 31 us; skew 500 ppm
Aug 11 16:40:09 dist-test-slave-zj8q krb5kdc[16729](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466409, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:40:09.443142 18027 init.cc:377] Logged in from keytab as kudu/127.24.175.194@KRBTEST.COM (short username kudu)
I20260811 16:40:09.443518 18027 webserver.cc:460] Webserver started at http://127.24.175.194:42253/ using document root <none> and password file <none>
I20260811 16:40:09.443717 18027 fs_manager.cc:359] Metadata directory not provided
I20260811 16:40:09.443768 18027 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:40:09.445010 18027 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:40:09.445569 18060 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:40:09.445732 18027 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 16:40:09.445817 18027 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-1/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-1/wal
uuid: "2c02d356d12548a6ba3cab2218d7e6c3"
format_stamp: "Formatted at 2026-08-11 16:40:08 on dist-test-slave-zj8q"
server_key: "f45a18290593ec79fe9f934f76a0b371"
server_key_iv: "9f70fef99a13ec41e99b885a6f6b885b"
server_key_version: "encryptionkey@0"
I20260811 16:40:09.446112 18027 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:40:09.456465 18027 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:40:09.458499 18027 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:40:09.458623 18027 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:40:09.458813 18027 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:40:09.459088 18027 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:40:09.459122 18027 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:40:09.459148 18027 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:40:09.459167 18027 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:40:09.464905 18027 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.194:35265
I20260811 16:40:09.464956 18257 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.194:35265 every 8 connection(s)
I20260811 16:40:09.465261 18027 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
I20260811 16:40:09.468544 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 18027
I20260811 16:40:09.468791 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.195:42421
--local_ip_for_outbound_sockets=127.24.175.195
--tserver_master_addrs=127.24.175.254:43417
--webserver_port=39817
--webserver_interface=127.24.175.195
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab
--principal=kudu/127.24.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:43091
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 16:40:09 dist-test-slave-zj8q krb5kdc[16729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466409, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.194@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:40:09.474457 18025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:09.465913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:48677 (local address 127.24.175.254:43417)
0811 16:40:09.465985 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:09.465987 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:09.466180 (+ 193us) server_negotiation.cc:407] Connection header received
0811 16:40:09.466673 (+ 493us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:09.466674 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:09.466689 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:09.466729 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:40:09.467586 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:09.468108 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:09.469165 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:09.469447 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:09.469530 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:09.471703 (+ 2173us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:40:09.471705 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:40:09.471705 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:40:09.471712 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:40:09.473046 (+ 1334us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:09.473518 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:09.473519 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:09.473519 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:09.473580 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:09.473835 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:09.473835 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:09.473835 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:09.473932 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:40:09.473975 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0811 16:40:09.474315 (+ 340us) server_negotiation.cc:299] Negotiation successful
0811 16:40:09.474390 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 16:40:09.474686 18260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:09.465904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:43417 (local address 127.24.175.194:48677)
0811 16:40:09.466054 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:09.466088 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 16:40:09.466577 (+ 489us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:40:09.466794 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:40:09.466797 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:40:09.467320 (+ 523us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:40:09.467500 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:09.467504 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:09.468182 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:09.468183 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:09.469085 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:09.469088 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:09.469521 (+ 433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:09.469522 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:09.469615 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:09.470061 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:40:09.470070 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:40:09.471615 (+ 1545us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:40:09.473137 (+ 1522us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:40:09.473144 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:40:09.473147 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:40:09.473439 (+ 292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:40:09.473643 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:40:09.473643 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:40:09.473644 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:40:09.473777 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:40:09.473985 (+ 208us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:40:09.473990 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:40:09.474144 (+ 154us) client_negotiation.cc:769] Sending connection context
0811 16:40:09.474304 (+ 160us) client_negotiation.cc:240] Negotiation successful
0811 16:40:09.474469 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":81,"threads_started":1}
I20260811 16:40:09.475235 18258 heartbeater.cc:347] Connected to a master server at 127.24.175.254:43417
I20260811 16:40:09.475335 18258 heartbeater.cc:464] Registering TS with master...
I20260811 16:40:09.475524 18258 heartbeater.cc:511] Master 127.24.175.254:43417 requested a full tablet report, sending...
I20260811 16:40:09.475888 17701 ts_manager.cc:194] Registered new tserver with Master: 2c02d356d12548a6ba3cab2218d7e6c3 (127.24.175.194:35265)
I20260811 16:40:09.476254 17701 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.175.194@KRBTEST.COM'} at 127.24.175.194:48677
W20260811 16:40:09.551891 18262 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:40:09.552079 18262 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:40:09.552101 18262 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:40:09.553226 18262 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:40:09.553267 18262 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:40:09.553294 18262 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.195
I20260811 16:40:09.554768 18262 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:43091
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab
--principal=kudu/127.24.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.195:42421
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.175.195
--webserver_port=39817
--tserver_master_addrs=127.24.175.254:43417
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18262
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.195
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:40:09.555001 18262 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:40:09.555238 18262 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:40:09.560210 18274 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:40:09.560221 18273 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:40:09.560216 18276 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:40:09.560364 18262 server_base.cc:1034] running on GCE node
I20260811 16:40:09.560647 18262 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:40:09.560884 18262 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:40:09.562032 18262 hybrid_clock.cc:648] HybridClock initialized: now 1786466409562018 us; error 23 us; skew 500 ppm
Aug 11 16:40:09 dist-test-slave-zj8q krb5kdc[16729](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466409, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:40:09.564616 18262 init.cc:377] Logged in from keytab as kudu/127.24.175.195@KRBTEST.COM (short username kudu)
I20260811 16:40:09.565042 18262 webserver.cc:460] Webserver started at http://127.24.175.195:39817/ using document root <none> and password file <none>
I20260811 16:40:09.565269 18262 fs_manager.cc:359] Metadata directory not provided
I20260811 16:40:09.565327 18262 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:40:09.566656 18262 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:40:09.567302 18288 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:40:09.567474 18262 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:40:09.567555 18262 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-2/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-2/wal
uuid: "4b0c7fb902f44dfaa9fca8b0040dad8f"
format_stamp: "Formatted at 2026-08-11 16:40:08 on dist-test-slave-zj8q"
server_key: "a1fce6b75b7c189005b4667f3a0423a7"
server_key_iv: "d9617499ba98fe305c9388eb56e089f8"
server_key_version: "encryptionkey@0"
I20260811 16:40:09.567909 18262 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:40:09.583065 18262 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:40:09.584856 18262 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:40:09.584990 18262 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:40:09.585232 18262 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:40:09.585563 18262 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:40:09.585599 18262 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:40:09.585623 18262 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:40:09.585646 18262 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:40:09.591217 18262 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.195:42421
I20260811 16:40:09.591295 18501 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.195:42421 every 8 connection(s)
I20260811 16:40:09.591670 18262 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
I20260811 16:40:09.594755 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 18262
Aug 11 16:40:09 dist-test-slave-zj8q krb5kdc[16729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466409, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.195@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:40:09.601326 18025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:09.592382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.195:33813 (local address 127.24.175.254:43417)
0811 16:40:09.592427 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:09.592429 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:09.592645 (+ 216us) server_negotiation.cc:407] Connection header received
0811 16:40:09.593170 (+ 525us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:09.593171 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:09.593184 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:09.593255 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:40:09.594290 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:09.594811 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:09.596040 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:09.596245 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:09.596339 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:09.598441 (+ 2102us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:40:09.598442 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:40:09.598442 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:40:09.598450 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:40:09.599946 (+ 1496us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:09.600396 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:09.600397 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:09.600398 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:09.600453 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:09.600686 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:09.600687 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:09.600687 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:09.600809 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:40:09.600875 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 16:40:09.601154 (+ 279us) server_negotiation.cc:299] Negotiation successful
0811 16:40:09.601236 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 16:40:09.601465 18508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:09.595169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55992 (local address 127.24.175.254:43417)
0811 16:40:09.595293 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:09.595295 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:09.595308 (+ 13us) server_negotiation.cc:407] Connection header received
0811 16:40:09.595376 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:09.595376 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:09.595389 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:09.595447 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:40:09.595972 (+ 525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:09.596556 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:09.597285 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:09.597563 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:09.597625 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:09.598881 (+ 1256us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:40:09.598882 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:40:09.598882 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:40:09.598890 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:40:09.600371 (+ 1481us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:09.600686 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:09.600687 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:09.600687 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:09.600770 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:09.600945 (+ 175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:09.600946 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:09.600946 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:09.601064 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:40:09.601223 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0811 16:40:09.601303 (+ 80us) server_negotiation.cc:299] Negotiation successful
0811 16:40:09.601379 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101,"thread_start_us":55,"threads_started":1}
I20260811 16:40:09.601635 18504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:09.592366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:43417 (local address 127.24.175.195:33813)
0811 16:40:09.592529 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:09.592565 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 16:40:09.593071 (+ 506us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:40:09.593331 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:40:09.593336 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:40:09.593950 (+ 614us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:40:09.594191 (+ 241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:09.594199 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:09.594896 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:09.594897 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:09.595945 (+ 1048us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:09.595949 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:09.596322 (+ 373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:09.596323 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:09.596466 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:09.596950 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:40:09.596958 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:40:09.598352 (+ 1394us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:40:09.600022 (+ 1670us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:40:09.600029 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:40:09.600032 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:40:09.600328 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:40:09.600509 (+ 181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:40:09.600510 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:40:09.600510 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:40:09.600611 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:40:09.600873 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:40:09.600878 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:40:09.601024 (+ 146us) client_negotiation.cc:769] Sending connection context
0811 16:40:09.601128 (+ 104us) client_negotiation.cc:240] Negotiation successful
0811 16:40:09.601309 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":83,"threads_started":1}
I20260811 16:40:09.602047 18502 heartbeater.cc:347] Connected to a master server at 127.24.175.254:43417
I20260811 16:40:09.602167 18502 heartbeater.cc:464] Registering TS with master...
I20260811 16:40:09.602360 18502 heartbeater.cc:511] Master 127.24.175.254:43417 requested a full tablet report, sending...
I20260811 16:40:09.602748 17699 ts_manager.cc:194] Registered new tserver with Master: 4b0c7fb902f44dfaa9fca8b0040dad8f (127.24.175.195:42421)
I20260811 16:40:09.603072 17699 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.175.195@KRBTEST.COM'} at 127.24.175.195:33813
I20260811 16:40:09.613351 25279 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 16:40:09.616326 18508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:09.613711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56006 (local address 127.24.175.254:43417)
0811 16:40:09.613751 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:09.613754 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:09.613874 (+ 120us) server_negotiation.cc:407] Connection header received
0811 16:40:09.613949 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:09.613950 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:09.613989 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:09.614049 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:40:09.614199 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:09.614779 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:09.615602 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:09.615805 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:09.615860 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:09.616013 (+ 153us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:40:09.616121 (+ 108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:40:09.616193 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 16:40:09.616229 (+ 36us) server_negotiation.cc:299] Negotiation successful
0811 16:40:09.616254 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 16:40:09.616597 17699 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:56006:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:40:09.618287 17699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:40:09.620445 17896 tablet_service.cc:1467] Processing CreateTablet for tablet 33eca10a8d8f4d5194b88fcd8ffa8b51 (DEFAULT_TABLE table=test-table [id=2371da359ef24b8d8cab11b05c15855d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:40:09.620663 17896 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 33eca10a8d8f4d5194b88fcd8ffa8b51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:40:09.622053 17835 tablet_bootstrap.cc:492] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2a0b5cba6b0841cc96d429b81d897f1c: Bootstrap starting.
I20260811 16:40:09.622418 17835 tablet_bootstrap.cc:654] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2a0b5cba6b0841cc96d429b81d897f1c: Neither blocks nor log segments found. Creating new log.
I20260811 16:40:09.622997 17835 tablet_bootstrap.cc:492] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2a0b5cba6b0841cc96d429b81d897f1c: No bootstrap required, opened a new log
I20260811 16:40:09.623047 17835 ts_tablet_manager.cc:1397] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2a0b5cba6b0841cc96d429b81d897f1c: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 16:40:09.623168 17835 raft_consensus.cc:348] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2a0b5cba6b0841cc96d429b81d897f1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b0c7fb902f44dfaa9fca8b0040dad8f" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42421 } } peers { permanent_uuid: "2c02d356d12548a6ba3cab2218d7e6c3" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 35265 } } peers { permanent_uuid: "2a0b5cba6b0841cc96d429b81d897f1c" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 35661 } }
I20260811 16:40:09.623236 17835 raft_consensus.cc:374] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2a0b5cba6b0841cc96d429b81d897f1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:40:09.623286 17835 raft_consensus.cc:729] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2a0b5cba6b0841cc96d429b81d897f1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a0b5cba6b0841cc96d429b81d897f1c, State: Initialized, Role: FOLLOWER
I20260811 16:40:09.623337 17835 consensus_queue.cc:260] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2a0b5cba6b0841cc96d429b81d897f1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b0c7fb902f44dfaa9fca8b0040dad8f" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42421 } } peers { permanent_uuid: "2c02d356d12548a6ba3cab2218d7e6c3" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 35265 } } peers { permanent_uuid: "2a0b5cba6b0841cc96d429b81d897f1c" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 35661 } }
I20260811 16:40:09.623430 17835 ts_tablet_manager.cc:1428] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2a0b5cba6b0841cc96d429b81d897f1c: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 16:40:09.624419 18514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:09.620180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.194:35265 (local address 127.0.0.1:58322)
0811 16:40:09.620642 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:09.620663 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 16:40:09.620715 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:40:09.620914 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:40:09.620915 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:40:09.620917 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:40:09.620958 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:09.620959 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:09.622202 (+ 1243us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:09.622203 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:09.623213 (+ 1010us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:09.623216 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:09.624160 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:09.624161 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:09.624225 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:09.624229 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:40:09.624284 (+ 55us) client_negotiation.cc:240] Negotiation successful
0811 16:40:09.624327 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":446,"mutex_wait_us":48,"thread_start_us":117,"threads_started":1}
I20260811 16:40:09.624442 18511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:09.620211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50290 (local address 127.24.175.195:42421)
0811 16:40:09.620455 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:09.620460 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:09.620470 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:40:09.620506 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:09.620508 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:09.620524 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:09.620812 (+ 288us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:40:09.620952 (+ 140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:09.622068 (+ 1116us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:09.623271 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:09.624000 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:09.624069 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:09.624125 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 16:40:09.624317 (+ 192us) server_negotiation.cc:299] Negotiation successful
0811 16:40:09.624360 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":206,"thread_start_us":88,"threads_started":1}
I20260811 16:40:09.624419 18031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:09.620113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.195:42421 (local address 127.0.0.1:50290)
0811 16:40:09.620161 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:09.620172 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:40:09.620209 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:40:09.620812 (+ 603us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:40:09.620813 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:40:09.620815 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:40:09.620859 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:09.620861 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:09.622261 (+ 1400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:09.622262 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:09.623185 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:09.623188 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:09.624160 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:09.624161 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:09.624225 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:09.624239 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 16:40:09.624284 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 16:40:09.624327 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29,"mutex_wait_us":2}
I20260811 16:40:09.624439 18515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:09.620382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58322 (local address 127.24.175.194:35265)
0811 16:40:09.620555 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:09.620559 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:09.620705 (+ 146us) server_negotiation.cc:407] Connection header received
0811 16:40:09.620785 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:09.620787 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:09.620802 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:09.620881 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:40:09.621018 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:09.622068 (+ 1050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:09.623301 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:09.624000 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:09.624069 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:09.624125 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 16:40:09.624306 (+ 181us) server_negotiation.cc:299] Negotiation successful
0811 16:40:09.624352 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":85,"threads_started":1}
I20260811 16:40:09.625224 18374 tablet_service.cc:1467] Processing CreateTablet for tablet 33eca10a8d8f4d5194b88fcd8ffa8b51 (DEFAULT_TABLE table=test-table [id=2371da359ef24b8d8cab11b05c15855d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:40:09.625355 18137 tablet_service.cc:1467] Processing CreateTablet for tablet 33eca10a8d8f4d5194b88fcd8ffa8b51 (DEFAULT_TABLE table=test-table [id=2371da359ef24b8d8cab11b05c15855d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:40:09.625556 18374 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 33eca10a8d8f4d5194b88fcd8ffa8b51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:40:09.625699 18137 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 33eca10a8d8f4d5194b88fcd8ffa8b51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:40:09.628160 18518 tablet_bootstrap.cc:492] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 4b0c7fb902f44dfaa9fca8b0040dad8f: Bootstrap starting.
I20260811 16:40:09.628279 18521 tablet_bootstrap.cc:492] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2c02d356d12548a6ba3cab2218d7e6c3: Bootstrap starting.
I20260811 16:40:09.628789 18518 tablet_bootstrap.cc:654] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 4b0c7fb902f44dfaa9fca8b0040dad8f: Neither blocks nor log segments found. Creating new log.
I20260811 16:40:09.628872 18521 tablet_bootstrap.cc:654] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2c02d356d12548a6ba3cab2218d7e6c3: Neither blocks nor log segments found. Creating new log.
I20260811 16:40:09.629271 18518 log.cc:824] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 4b0c7fb902f44dfaa9fca8b0040dad8f: Log is configured to *not* fsync() on all Append() calls
I20260811 16:40:09.629380 18521 log.cc:824] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2c02d356d12548a6ba3cab2218d7e6c3: Log is configured to *not* fsync() on all Append() calls
I20260811 16:40:09.629997 18518 tablet_bootstrap.cc:492] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 4b0c7fb902f44dfaa9fca8b0040dad8f: No bootstrap required, opened a new log
I20260811 16:40:09.630026 18521 tablet_bootstrap.cc:492] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2c02d356d12548a6ba3cab2218d7e6c3: No bootstrap required, opened a new log
I20260811 16:40:09.630059 18518 ts_tablet_manager.cc:1397] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 4b0c7fb902f44dfaa9fca8b0040dad8f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 16:40:09.630070 18521 ts_tablet_manager.cc:1397] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2c02d356d12548a6ba3cab2218d7e6c3: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 16:40:09.631453 18521 raft_consensus.cc:348] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2c02d356d12548a6ba3cab2218d7e6c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b0c7fb902f44dfaa9fca8b0040dad8f" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42421 } } peers { permanent_uuid: "2c02d356d12548a6ba3cab2218d7e6c3" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 35265 } } peers { permanent_uuid: "2a0b5cba6b0841cc96d429b81d897f1c" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 35661 } }
I20260811 16:40:09.631593 18521 raft_consensus.cc:374] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2c02d356d12548a6ba3cab2218d7e6c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:40:09.631616 18521 raft_consensus.cc:729] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2c02d356d12548a6ba3cab2218d7e6c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c02d356d12548a6ba3cab2218d7e6c3, State: Initialized, Role: FOLLOWER
I20260811 16:40:09.631534 18518 raft_consensus.cc:348] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 4b0c7fb902f44dfaa9fca8b0040dad8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b0c7fb902f44dfaa9fca8b0040dad8f" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42421 } } peers { permanent_uuid: "2c02d356d12548a6ba3cab2218d7e6c3" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 35265 } } peers { permanent_uuid: "2a0b5cba6b0841cc96d429b81d897f1c" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 35661 } }
I20260811 16:40:09.631677 18518 raft_consensus.cc:374] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 4b0c7fb902f44dfaa9fca8b0040dad8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:40:09.631721 18518 raft_consensus.cc:729] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 4b0c7fb902f44dfaa9fca8b0040dad8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b0c7fb902f44dfaa9fca8b0040dad8f, State: Initialized, Role: FOLLOWER
I20260811 16:40:09.631724 18521 consensus_queue.cc:260] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2c02d356d12548a6ba3cab2218d7e6c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b0c7fb902f44dfaa9fca8b0040dad8f" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42421 } } peers { permanent_uuid: "2c02d356d12548a6ba3cab2218d7e6c3" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 35265 } } peers { permanent_uuid: "2a0b5cba6b0841cc96d429b81d897f1c" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 35661 } }
I20260811 16:40:09.631824 18518 consensus_queue.cc:260] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 4b0c7fb902f44dfaa9fca8b0040dad8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b0c7fb902f44dfaa9fca8b0040dad8f" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42421 } } peers { permanent_uuid: "2c02d356d12548a6ba3cab2218d7e6c3" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 35265 } } peers { permanent_uuid: "2a0b5cba6b0841cc96d429b81d897f1c" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 35661 } }
I20260811 16:40:09.632009 18521 ts_tablet_manager.cc:1428] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2c02d356d12548a6ba3cab2218d7e6c3: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 16:40:09.632071 18518 ts_tablet_manager.cc:1428] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 4b0c7fb902f44dfaa9fca8b0040dad8f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:40:09.632048 18258 heartbeater.cc:503] Master 127.24.175.254:43417 was elected leader, sending a full tablet report...
I20260811 16:40:09.632088 18502 heartbeater.cc:503] Master 127.24.175.254:43417 was elected leader, sending a full tablet report...
W20260811 16:40:09.715763 18259 tablet.cc:2369] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2c02d356d12548a6ba3cab2218d7e6c3: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 16:40:09.842265 18503 tablet.cc:2369] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 4b0c7fb902f44dfaa9fca8b0040dad8f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 16:40:09.844091 18023 tablet.cc:2369] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2a0b5cba6b0841cc96d429b81d897f1c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:40:09.910743 18528 raft_consensus.cc:482] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2c02d356d12548a6ba3cab2218d7e6c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:40:09.910909 18528 raft_consensus.cc:504] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2c02d356d12548a6ba3cab2218d7e6c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b0c7fb902f44dfaa9fca8b0040dad8f" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42421 } } peers { permanent_uuid: "2c02d356d12548a6ba3cab2218d7e6c3" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 35265 } } peers { permanent_uuid: "2a0b5cba6b0841cc96d429b81d897f1c" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 35661 } }
I20260811 16:40:09.911329 18528 leader_election.cc:288] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2c02d356d12548a6ba3cab2218d7e6c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b0c7fb902f44dfaa9fca8b0040dad8f (127.24.175.195:42421), 2a0b5cba6b0841cc96d429b81d897f1c (127.24.175.193:35661)
I20260811 16:40:09.914119 18260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:09.911490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.195:42421 (local address 127.24.175.194:42851)
0811 16:40:09.911539 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:09.911550 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:40:09.911593 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:40:09.911789 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:40:09.911791 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:40:09.911793 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:40:09.911869 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:09.911871 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:09.912574 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:09.912575 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:09.913337 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:09.913339 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:09.913878 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:09.913879 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:09.913955 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:09.913958 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:40:09.914003 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 16:40:09.914044 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25,"mutex_wait_us":28}
I20260811 16:40:09.914119 18511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:09.911558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:42851 (local address 127.24.175.195:42421)
0811 16:40:09.911611 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:09.911613 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:09.911625 (+ 12us) server_negotiation.cc:407] Connection header received
0811 16:40:09.911662 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:09.911663 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:09.911673 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:09.911733 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:40:09.911958 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:09.912504 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:09.913419 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:09.913810 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:09.913870 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:09.913880 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 16:40:09.914014 (+ 134us) server_negotiation.cc:299] Negotiation successful
0811 16:40:09.914050 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 16:40:09.914243 18531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:09.911593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.193:35661 (local address 127.24.175.194:50907)
0811 16:40:09.911763 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:09.911773 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:40:09.911818 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:40:09.911959 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:40:09.911960 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:40:09.911962 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:40:09.912029 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:09.912031 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:09.912687 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:09.912688 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:09.913440 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:09.913442 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:09.913971 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:09.913972 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:09.914049 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:09.914052 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:40:09.914096 (+ 44us) client_negotiation.cc:240] Negotiation successful
0811 16:40:09.914134 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":104,"threads_started":1}
I20260811 16:40:09.914391 18533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:09.911692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:50907 (local address 127.24.175.193:35661)
0811 16:40:09.911796 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:09.911798 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:09.911809 (+ 11us) server_negotiation.cc:407] Connection header received
0811 16:40:09.911877 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:09.911878 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:09.911888 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:09.911946 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:40:09.912108 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:09.912607 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:09.913523 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:09.913897 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:09.913958 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:09.913965 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0811 16:40:09.914109 (+ 144us) server_negotiation.cc:299] Negotiation successful
0811 16:40:09.914166 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83,"thread_start_us":48,"threads_started":1}
I20260811 16:40:09.914652 17937 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33eca10a8d8f4d5194b88fcd8ffa8b51" candidate_uuid: "2c02d356d12548a6ba3cab2218d7e6c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a0b5cba6b0841cc96d429b81d897f1c" is_pre_election: true
I20260811 16:40:09.914746 18418 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33eca10a8d8f4d5194b88fcd8ffa8b51" candidate_uuid: "2c02d356d12548a6ba3cab2218d7e6c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b0c7fb902f44dfaa9fca8b0040dad8f" is_pre_election: true
I20260811 16:40:09.914808 17937 raft_consensus.cc:2454] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2a0b5cba6b0841cc96d429b81d897f1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c02d356d12548a6ba3cab2218d7e6c3 in term 0.
I20260811 16:40:09.914897 18418 raft_consensus.cc:2454] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 4b0c7fb902f44dfaa9fca8b0040dad8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c02d356d12548a6ba3cab2218d7e6c3 in term 0.
I20260811 16:40:09.915012 18067 leader_election.cc:302] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2c02d356d12548a6ba3cab2218d7e6c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a0b5cba6b0841cc96d429b81d897f1c, 2c02d356d12548a6ba3cab2218d7e6c3; no voters:
I20260811 16:40:09.915131 18528 raft_consensus.cc:2781] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2c02d356d12548a6ba3cab2218d7e6c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:40:09.915187 18528 raft_consensus.cc:482] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2c02d356d12548a6ba3cab2218d7e6c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:40:09.915218 18528 raft_consensus.cc:3037] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2c02d356d12548a6ba3cab2218d7e6c3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:40:09.915900 18528 raft_consensus.cc:504] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2c02d356d12548a6ba3cab2218d7e6c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b0c7fb902f44dfaa9fca8b0040dad8f" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42421 } } peers { permanent_uuid: "2c02d356d12548a6ba3cab2218d7e6c3" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 35265 } } peers { permanent_uuid: "2a0b5cba6b0841cc96d429b81d897f1c" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 35661 } }
I20260811 16:40:09.915999 18528 leader_election.cc:288] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2c02d356d12548a6ba3cab2218d7e6c3 [CANDIDATE]: Term 1 election: Requested vote from peers 4b0c7fb902f44dfaa9fca8b0040dad8f (127.24.175.195:42421), 2a0b5cba6b0841cc96d429b81d897f1c (127.24.175.193:35661)
I20260811 16:40:09.916180 18418 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33eca10a8d8f4d5194b88fcd8ffa8b51" candidate_uuid: "2c02d356d12548a6ba3cab2218d7e6c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b0c7fb902f44dfaa9fca8b0040dad8f"
I20260811 16:40:09.916180 17937 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33eca10a8d8f4d5194b88fcd8ffa8b51" candidate_uuid: "2c02d356d12548a6ba3cab2218d7e6c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a0b5cba6b0841cc96d429b81d897f1c"
I20260811 16:40:09.916268 18418 raft_consensus.cc:3037] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 4b0c7fb902f44dfaa9fca8b0040dad8f [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:40:09.916278 17937 raft_consensus.cc:3037] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2a0b5cba6b0841cc96d429b81d897f1c [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:40:09.917112 17937 raft_consensus.cc:2454] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2a0b5cba6b0841cc96d429b81d897f1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c02d356d12548a6ba3cab2218d7e6c3 in term 1.
I20260811 16:40:09.917112 18418 raft_consensus.cc:2454] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 4b0c7fb902f44dfaa9fca8b0040dad8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c02d356d12548a6ba3cab2218d7e6c3 in term 1.
I20260811 16:40:09.917260 18067 leader_election.cc:302] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2c02d356d12548a6ba3cab2218d7e6c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a0b5cba6b0841cc96d429b81d897f1c, 2c02d356d12548a6ba3cab2218d7e6c3; no voters:
I20260811 16:40:09.917341 18528 raft_consensus.cc:2781] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2c02d356d12548a6ba3cab2218d7e6c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:40:09.917464 18528 raft_consensus.cc:686] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2c02d356d12548a6ba3cab2218d7e6c3 [term 1 LEADER]: Becoming Leader. State: Replica: 2c02d356d12548a6ba3cab2218d7e6c3, State: Running, Role: LEADER
I20260811 16:40:09.917539 18528 consensus_queue.cc:237] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2c02d356d12548a6ba3cab2218d7e6c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b0c7fb902f44dfaa9fca8b0040dad8f" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42421 } } peers { permanent_uuid: "2c02d356d12548a6ba3cab2218d7e6c3" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 35265 } } peers { permanent_uuid: "2a0b5cba6b0841cc96d429b81d897f1c" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 35661 } }
I20260811 16:40:09.918367 17701 catalog_manager.cc:5495] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2c02d356d12548a6ba3cab2218d7e6c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c02d356d12548a6ba3cab2218d7e6c3 (127.24.175.194). New cstate: current_term: 1 leader_uuid: "2c02d356d12548a6ba3cab2218d7e6c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b0c7fb902f44dfaa9fca8b0040dad8f" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c02d356d12548a6ba3cab2218d7e6c3" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 35265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a0b5cba6b0841cc96d429b81d897f1c" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 35661 } health_report { overall_health: UNKNOWN } } }
I20260811 16:40:09.978049 18515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:09.975849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58330 (local address 127.24.175.194:35265)
0811 16:40:09.975895 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:09.975897 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:09.975907 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:40:09.975984 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:09.975985 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:09.976003 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:09.976061 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:40:09.976171 (+ 110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:09.976632 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:09.977324 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:09.977518 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:09.977571 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:09.977732 (+ 161us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:40:09.977839 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:40:09.977907 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 16:40:09.977945 (+ 38us) server_negotiation.cc:299] Negotiation successful
0811 16:40:09.977966 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 16:40:09.979753 17937 raft_consensus.cc:1261] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2a0b5cba6b0841cc96d429b81d897f1c [term 1 FOLLOWER]: Refusing update from remote peer 2c02d356d12548a6ba3cab2218d7e6c3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:40:09.979753 18418 raft_consensus.cc:1261] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 4b0c7fb902f44dfaa9fca8b0040dad8f [term 1 FOLLOWER]: Refusing update from remote peer 2c02d356d12548a6ba3cab2218d7e6c3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:40:09.980119 18528 consensus_queue.cc:1035] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2c02d356d12548a6ba3cab2218d7e6c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a0b5cba6b0841cc96d429b81d897f1c" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 35661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:40:09.980262 18537 consensus_queue.cc:1035] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2c02d356d12548a6ba3cab2218d7e6c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b0c7fb902f44dfaa9fca8b0040dad8f" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:40:09.982604 18544 mvcc.cc:205] Tried to move back new op lower bound from 7317366415274389504 to 7317366415022718976. Current Snapshot: MvccSnapshot[applied={T|T < 7317366415274389504}]
I20260811 16:40:09.982714 18545 mvcc.cc:205] Tried to move back new op lower bound from 7317366415274389504 to 7317366415022718976. Current Snapshot: MvccSnapshot[applied={T|T < 7317366415274389504}]
I20260811 16:40:09.984637 17699 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:56006:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:40:09.984743 17699 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:56006:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:40:09.985430 17699 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e7a415dfffbc4cec9b7cc7d6384957b2: Sending DeleteTablet for 3 replicas of tablet 33eca10a8d8f4d5194b88fcd8ffa8b51
I20260811 16:40:09.985761 17896 tablet_service.cc:1514] Processing DeleteTablet for tablet 33eca10a8d8f4d5194b88fcd8ffa8b51 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:40:09 UTC) from {username='kudu', principal='kudu/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:58258
I20260811 16:40:09.985749 18374 tablet_service.cc:1514] Processing DeleteTablet for tablet 33eca10a8d8f4d5194b88fcd8ffa8b51 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:40:09 UTC) from {username='kudu', principal='kudu/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:50290
I20260811 16:40:09.985782 18137 tablet_service.cc:1514] Processing DeleteTablet for tablet 33eca10a8d8f4d5194b88fcd8ffa8b51 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:40:09 UTC) from {username='kudu', principal='kudu/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:58322
I20260811 16:40:09.985981 18563 tablet_replica.cc:330] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2a0b5cba6b0841cc96d429b81d897f1c: stopping tablet replica
I20260811 16:40:09.986054 18563 raft_consensus.cc:2229] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2a0b5cba6b0841cc96d429b81d897f1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:40:09.986104 18563 raft_consensus.cc:2258] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2a0b5cba6b0841cc96d429b81d897f1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:40:09.986106 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 17772
I20260811 16:40:09.986243 18564 tablet_replica.cc:330] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 4b0c7fb902f44dfaa9fca8b0040dad8f: stopping tablet replica
I20260811 16:40:09.986331 18564 raft_consensus.cc:2229] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 4b0c7fb902f44dfaa9fca8b0040dad8f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:40:09.986414 18564 raft_consensus.cc:2258] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 4b0c7fb902f44dfaa9fca8b0040dad8f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:40:09.986558 18566 tablet_replica.cc:330] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2c02d356d12548a6ba3cab2218d7e6c3: stopping tablet replica
I20260811 16:40:09.986634 18566 raft_consensus.cc:2229] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2c02d356d12548a6ba3cab2218d7e6c3 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:40:09.986727 18566 raft_consensus.cc:2258] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2c02d356d12548a6ba3cab2218d7e6c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:40:09.993839 18566 ts_tablet_manager.cc:1905] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2c02d356d12548a6ba3cab2218d7e6c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:40:09.995890 18564 ts_tablet_manager.cc:1905] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 4b0c7fb902f44dfaa9fca8b0040dad8f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:40:09.995999 18566 ts_tablet_manager.cc:1918] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2c02d356d12548a6ba3cab2218d7e6c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:40:09.996117 18566 log.cc:1196] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2c02d356d12548a6ba3cab2218d7e6c3: Deleting WAL directory at /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-1/wal/wals/33eca10a8d8f4d5194b88fcd8ffa8b51
I20260811 16:40:09.996484 18566 ts_tablet_manager.cc:1939] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2c02d356d12548a6ba3cab2218d7e6c3: Deleting consensus metadata
I20260811 16:40:09.997021 17683 catalog_manager.cc:4841] TS 2c02d356d12548a6ba3cab2218d7e6c3 (127.24.175.194:35265): tablet 33eca10a8d8f4d5194b88fcd8ffa8b51 (table test-table [id=2371da359ef24b8d8cab11b05c15855d]) successfully deleted
I20260811 16:40:10.000027 18564 ts_tablet_manager.cc:1918] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 4b0c7fb902f44dfaa9fca8b0040dad8f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:40:10.000186 18564 log.cc:1196] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 4b0c7fb902f44dfaa9fca8b0040dad8f: Deleting WAL directory at /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-2/wal/wals/33eca10a8d8f4d5194b88fcd8ffa8b51
I20260811 16:40:10.000510 18564 ts_tablet_manager.cc:1939] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 4b0c7fb902f44dfaa9fca8b0040dad8f: Deleting consensus metadata
I20260811 16:40:10.000989 17685 catalog_manager.cc:4841] TS 4b0c7fb902f44dfaa9fca8b0040dad8f (127.24.175.195:42421): tablet 33eca10a8d8f4d5194b88fcd8ffa8b51 (table test-table [id=2371da359ef24b8d8cab11b05c15855d]) successfully deleted
W20260811 16:40:10.005633 17685 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.24.175.193:35661 (error 108)
I20260811 16:40:10.005761 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 18027
I20260811 16:40:10.010888 18031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:10.010754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.193:35661 (local address 127.0.0.1:58272)
0811 16:40:10.010807 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:10.010856 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.193:35661: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260811 16:40:10.011024 17685 catalog_manager.cc:4584] TS 2a0b5cba6b0841cc96d429b81d897f1c (127.24.175.193:35661): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 33eca10a8d8f4d5194b88fcd8ffa8b51: Network error: Client connection negotiation failed: client connection to 127.24.175.193:35661: connect: Connection refused (error 111)
I20260811 16:40:10.014748 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 18262
I20260811 16:40:10.024297 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 17657
I20260811 16:40:10.033783 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:43417
--webserver_interface=127.24.175.254
--webserver_port=34861
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:43091
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.175.254:43417
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:40:10.116026 18568 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:40:10.116219 18568 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:40:10.116240 18568 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:40:10.117321 18568 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:40:10.117354 18568 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:40:10.117367 18568 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:40:10.117378 18568 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:40:10.117389 18568 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:40:10.118848 18568 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:43091
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.175.254:43417
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:43417
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.175.254
--webserver_port=34861
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18568
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:40:10.119021 18568 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:40:10.119187 18568 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 16:40:10.123863 18568 server_base.cc:1034] running on GCE node
W20260811 16:40:10.123808 18582 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:40:10.123819 18577 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:40:10.123831 18575 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:40:10.124254 18568 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:40:10.124543 18568 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:40:10.125720 18568 hybrid_clock.cc:648] HybridClock initialized: now 1786466410125699 us; error 28 us; skew 500 ppm
Aug 11 16:40:10 dist-test-slave-zj8q krb5kdc[16729](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466410, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:40:10.128185 18568 init.cc:377] Logged in from keytab as kudu/127.24.175.254@KRBTEST.COM (short username kudu)
I20260811 16:40:10.128551 18568 webserver.cc:460] Webserver started at http://127.24.175.254:34861/ using document root <none> and password file <none>
I20260811 16:40:10.128749 18568 fs_manager.cc:359] Metadata directory not provided
I20260811 16:40:10.128789 18568 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:40:10.129995 18568 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:40:10.130650 18593 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:40:10.130797 18568 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 16:40:10.130869 18568 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/master-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/master-0/wal
uuid: "e7a415dfffbc4cec9b7cc7d6384957b2"
format_stamp: "Formatted at 2026-08-11 16:40:08 on dist-test-slave-zj8q"
server_key: "4efc226e2e52c9e7fd6bea9265871d2c"
server_key_iv: "0adc06fbab24e5bff70247d4f338ca3c"
server_key_version: "encryptionkey@0"
I20260811 16:40:10.131192 18568 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:40:10.141297 18568 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:40:10.143389 18568 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:40:10.143513 18568 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:40:10.147238 18568 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.254:43417
I20260811 16:40:10.147265 18691 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.254:43417 every 8 connection(s)
I20260811 16:40:10.147599 18568 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
I20260811 16:40:10.148466 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 18568
I20260811 16:40:10.148741 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.193:35661
--local_ip_for_outbound_sockets=127.24.175.193
--tserver_master_addrs=127.24.175.254:43417
--webserver_port=34417
--webserver_interface=127.24.175.193
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab
--principal=kudu/127.24.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:43091
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 16:40:10.149386 18694 sys_catalog.cc:263] Verifying existing consensus state
I20260811 16:40:10.150249 18694 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e7a415dfffbc4cec9b7cc7d6384957b2: Bootstrap starting.
I20260811 16:40:10.159309 18694 log.cc:824] T 00000000000000000000000000000000 P e7a415dfffbc4cec9b7cc7d6384957b2: Log is configured to *not* fsync() on all Append() calls
I20260811 16:40:10.161608 18694 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e7a415dfffbc4cec9b7cc7d6384957b2: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:40:10.161873 18694 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e7a415dfffbc4cec9b7cc7d6384957b2: Bootstrap complete.
I20260811 16:40:10.164058 18694 raft_consensus.cc:348] T 00000000000000000000000000000000 P e7a415dfffbc4cec9b7cc7d6384957b2 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7a415dfffbc4cec9b7cc7d6384957b2" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 43417 } }
I20260811 16:40:10.164291 18694 raft_consensus.cc:729] T 00000000000000000000000000000000 P e7a415dfffbc4cec9b7cc7d6384957b2 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7a415dfffbc4cec9b7cc7d6384957b2, State: Initialized, Role: FOLLOWER
I20260811 16:40:10.164453 18694 consensus_queue.cc:260] T 00000000000000000000000000000000 P e7a415dfffbc4cec9b7cc7d6384957b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7a415dfffbc4cec9b7cc7d6384957b2" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 43417 } }
I20260811 16:40:10.164528 18694 raft_consensus.cc:388] T 00000000000000000000000000000000 P e7a415dfffbc4cec9b7cc7d6384957b2 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:40:10.164577 18694 raft_consensus.cc:482] T 00000000000000000000000000000000 P e7a415dfffbc4cec9b7cc7d6384957b2 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:40:10.164624 18694 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e7a415dfffbc4cec9b7cc7d6384957b2 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:40:10.165589 18694 raft_consensus.cc:504] T 00000000000000000000000000000000 P e7a415dfffbc4cec9b7cc7d6384957b2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7a415dfffbc4cec9b7cc7d6384957b2" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 43417 } }
I20260811 16:40:10.165685 18694 leader_election.cc:302] T 00000000000000000000000000000000 P e7a415dfffbc4cec9b7cc7d6384957b2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e7a415dfffbc4cec9b7cc7d6384957b2; no voters:
I20260811 16:40:10.165854 18694 leader_election.cc:288] T 00000000000000000000000000000000 P e7a415dfffbc4cec9b7cc7d6384957b2 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260811 16:40:10.165904 18700 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e7a415dfffbc4cec9b7cc7d6384957b2 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:40:10.166009 18700 raft_consensus.cc:686] T 00000000000000000000000000000000 P e7a415dfffbc4cec9b7cc7d6384957b2 [term 3 LEADER]: Becoming Leader. State: Replica: e7a415dfffbc4cec9b7cc7d6384957b2, State: Running, Role: LEADER
I20260811 16:40:10.166118 18694 sys_catalog.cc:564] T 00000000000000000000000000000000 P e7a415dfffbc4cec9b7cc7d6384957b2 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:40:10.166101 18700 consensus_queue.cc:237] T 00000000000000000000000000000000 P e7a415dfffbc4cec9b7cc7d6384957b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7a415dfffbc4cec9b7cc7d6384957b2" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 43417 } }
I20260811 16:40:10.166417 18701 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7a415dfffbc4cec9b7cc7d6384957b2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "e7a415dfffbc4cec9b7cc7d6384957b2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7a415dfffbc4cec9b7cc7d6384957b2" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 43417 } } }
I20260811 16:40:10.166508 18701 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7a415dfffbc4cec9b7cc7d6384957b2 [sys.catalog]: This master's current role is: LEADER
I20260811 16:40:10.166668 18702 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7a415dfffbc4cec9b7cc7d6384957b2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e7a415dfffbc4cec9b7cc7d6384957b2. Latest consensus state: current_term: 3 leader_uuid: "e7a415dfffbc4cec9b7cc7d6384957b2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7a415dfffbc4cec9b7cc7d6384957b2" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 43417 } } }
I20260811 16:40:10.166723 18702 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7a415dfffbc4cec9b7cc7d6384957b2 [sys.catalog]: This master's current role is: LEADER
I20260811 16:40:10.166807 18709 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:40:10.167562 18709 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:40:10.167948 18709 catalog_manager.cc:1259] Loaded cluster ID: 334d3b42530d48ddab536501d4881e1f
I20260811 16:40:10.168061 18709 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260811 16:40:10.168401 18709 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f6d731949ad google::LogMessage::Fail() at ??:0
@ 0x7f6d7319788a google::LogMessage::SendToLog() at ??:0
@ 0x7f6d731944de google::LogMessage::Flush() at ??:0
@ 0x7f6d73195a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f6d7b0b50f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f6d7b0be8b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f6d750620d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f6d75057954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f6d75ebb6db start_thread at ??:0
@ 0x7f6d71c9261f clone at ??:0
W20260811 16:40:10.248701 18696 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:40:10.248898 18696 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:40:10.248920 18696 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:40:10.250030 18696 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:40:10.250072 18696 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:40:10.250097 18696 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.193
I20260811 16:40:10.251554 18696 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:43091
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab
--principal=kudu/127.24.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.193:35661
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.175.193
--webserver_port=34417
--tserver_master_addrs=127.24.175.254:43417
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18696
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.193
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:40:10.251758 18696 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:40:10.251967 18696 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:40:10.256863 18758 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:40:10.256884 18754 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:40:10.256862 18756 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:40:10.257263 18696 server_base.cc:1034] running on GCE node
I20260811 16:40:10.257457 18696 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:40:10.257725 18696 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:40:10.258886 18696 hybrid_clock.cc:648] HybridClock initialized: now 1786466410258870 us; error 30 us; skew 500 ppm
Aug 11 16:40:10 dist-test-slave-zj8q krb5kdc[16729](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466410, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:40:10.261377 18696 init.cc:377] Logged in from keytab as kudu/127.24.175.193@KRBTEST.COM (short username kudu)
I20260811 16:40:10.261821 18696 webserver.cc:460] Webserver started at http://127.24.175.193:34417/ using document root <none> and password file <none>
I20260811 16:40:10.262015 18696 fs_manager.cc:359] Metadata directory not provided
I20260811 16:40:10.262061 18696 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:40:10.263314 18696 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:40:10.263914 18773 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:40:10.264110 18696 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 16:40:10.264217 18696 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-0/wal
uuid: "2a0b5cba6b0841cc96d429b81d897f1c"
format_stamp: "Formatted at 2026-08-11 16:40:08 on dist-test-slave-zj8q"
server_key: "5d82e7a0fab7c861312c6593bf7add77"
server_key_iv: "34004a6a29407ba0eb356c1003722175"
server_key_version: "encryptionkey@0"
I20260811 16:40:10.264662 18696 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:40:10.290410 18696 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:40:10.292595 18696 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:40:10.292713 18696 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:40:10.292938 18696 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:40:10.293383 18785 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 16:40:10.295527 18696 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 16:40:10.295585 18696 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260811 16:40:10.295621 18696 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 16:40:10.296293 18696 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 16:40:10.296325 18696 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260811 16:40:10.296416 18785 tablet_bootstrap.cc:492] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2a0b5cba6b0841cc96d429b81d897f1c: Bootstrap starting.
I20260811 16:40:10.303038 18696 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.193:35661
I20260811 16:40:10.303189 18955 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.193:35661 every 8 connection(s)
I20260811 16:40:10.303452 18696 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
I20260811 16:40:10.306037 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 18696
I20260811 16:40:10.306313 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.194:35265
--local_ip_for_outbound_sockets=127.24.175.194
--tserver_master_addrs=127.24.175.254:43417
--webserver_port=42253
--webserver_interface=127.24.175.194
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab
--principal=kudu/127.24.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:43091
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 16:40:10.307327 18785 log.cc:824] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2a0b5cba6b0841cc96d429b81d897f1c: Log is configured to *not* fsync() on all Append() calls
I20260811 16:40:10.310115 18785 tablet_bootstrap.cc:492] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2a0b5cba6b0841cc96d429b81d897f1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:40:10.310446 18785 tablet_bootstrap.cc:492] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2a0b5cba6b0841cc96d429b81d897f1c: Bootstrap complete.
I20260811 16:40:10.311569 18785 ts_tablet_manager.cc:1397] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2a0b5cba6b0841cc96d429b81d897f1c: Time spent bootstrapping tablet: real 0.015s user 0.008s sys 0.007s
I20260811 16:40:10.312903 18785 raft_consensus.cc:348] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2a0b5cba6b0841cc96d429b81d897f1c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b0c7fb902f44dfaa9fca8b0040dad8f" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42421 } } peers { permanent_uuid: "2c02d356d12548a6ba3cab2218d7e6c3" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 35265 } } peers { permanent_uuid: "2a0b5cba6b0841cc96d429b81d897f1c" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 35661 } }
I20260811 16:40:10.313225 18785 raft_consensus.cc:729] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2a0b5cba6b0841cc96d429b81d897f1c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a0b5cba6b0841cc96d429b81d897f1c, State: Initialized, Role: FOLLOWER
I20260811 16:40:10.313370 18785 consensus_queue.cc:260] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2a0b5cba6b0841cc96d429b81d897f1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b0c7fb902f44dfaa9fca8b0040dad8f" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42421 } } peers { permanent_uuid: "2c02d356d12548a6ba3cab2218d7e6c3" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 35265 } } peers { permanent_uuid: "2a0b5cba6b0841cc96d429b81d897f1c" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 35661 } }
I20260811 16:40:10.313640 18785 ts_tablet_manager.cc:1428] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2a0b5cba6b0841cc96d429b81d897f1c: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
W20260811 16:40:10.358588 18960 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:40:10.304133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:43417 (local address 127.24.175.193:33975)
0811 16:40:10.304301 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:10.304344 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 16:40:10.304779 (+ 435us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:40:10.358379 (+ 53600us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:43417: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":81,"threads_started":1}
W20260811 16:40:10.358870 18956 heartbeater.cc:644] Failed to heartbeat to 127.24.175.254:43417 (0 consecutive failures): Network error: Failed to ping master at 127.24.175.254:43417: Client connection negotiation failed: client connection to 127.24.175.254:43417: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 16:40:10.359229 18960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:10.359108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:43417 (local address 127.24.175.193:52109)
0811 16:40:10.359156 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:10.359204 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:43417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
I20260811 16:40:10.359546 18960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:10.359469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:43417 (local address 127.24.175.193:40013)
0811 16:40:10.359506 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:10.359529 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:43417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260811 16:40:10.359712 18956 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 16:40:10.395382 18962 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:40:10.395574 18962 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:40:10.395597 18962 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:40:10.396710 18962 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:40:10.396752 18962 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:40:10.396780 18962 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.194
I20260811 16:40:10.398262 18962 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:43091
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab
--principal=kudu/127.24.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.194:35265
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.175.194
--webserver_port=42253
--tserver_master_addrs=127.24.175.254:43417
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18962
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.194
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:40:10.398468 18962 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:40:10.398680 18962 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:40:10.403491 18977 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:40:10.403553 18976 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:40:10.403568 18980 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:40:10.403684 18962 server_base.cc:1034] running on GCE node
I20260811 16:40:10.403905 18962 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:40:10.404107 18962 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:40:10.405238 18962 hybrid_clock.cc:648] HybridClock initialized: now 1786466410405225 us; error 33 us; skew 500 ppm
Aug 11 16:40:10 dist-test-slave-zj8q krb5kdc[16729](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466410, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:40:10.407655 18962 init.cc:377] Logged in from keytab as kudu/127.24.175.194@KRBTEST.COM (short username kudu)
I20260811 16:40:10.408015 18962 webserver.cc:460] Webserver started at http://127.24.175.194:42253/ using document root <none> and password file <none>
I20260811 16:40:10.408216 18962 fs_manager.cc:359] Metadata directory not provided
I20260811 16:40:10.408255 18962 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:40:10.409449 18962 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:40:10.409983 18993 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:40:10.410127 18962 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 16:40:10.410254 18962 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-1/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-1/wal
uuid: "2c02d356d12548a6ba3cab2218d7e6c3"
format_stamp: "Formatted at 2026-08-11 16:40:08 on dist-test-slave-zj8q"
server_key: "f45a18290593ec79fe9f934f76a0b371"
server_key_iv: "9f70fef99a13ec41e99b885a6f6b885b"
server_key_version: "encryptionkey@0"
I20260811 16:40:10.410584 18962 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:40:10.426812 18962 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:40:10.428791 18962 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:40:10.428918 18962 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:40:10.429117 18962 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:40:10.429400 18962 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:40:10.429432 18962 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:40:10.429459 18962 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:40:10.429482 18962 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:40:10.435160 18962 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.194:35265
I20260811 16:40:10.435210 19175 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.194:35265 every 8 connection(s)
I20260811 16:40:10.435521 18962 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
I20260811 16:40:10.436440 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 18962
I20260811 16:40:10.436465 19181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:10.436112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:43417 (local address 127.24.175.194:40603)
0811 16:40:10.436257 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:10.436333 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:43417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":75,"threads_started":1}
I20260811 16:40:10.436697 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.195:42421
--local_ip_for_outbound_sockets=127.24.175.195
--tserver_master_addrs=127.24.175.254:43417
--webserver_port=39817
--webserver_interface=127.24.175.195
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab
--principal=kudu/127.24.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:43091
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:40:10.436851 19177 heartbeater.cc:644] Failed to heartbeat to 127.24.175.254:43417 (0 consecutive failures): Network error: Failed to ping master at 127.24.175.254:43417: Client connection negotiation failed: client connection to 127.24.175.254:43417: connect: Connection refused (error 111)
I20260811 16:40:10.437109 19181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:10.437027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:43417 (local address 127.24.175.194:50081)
0811 16:40:10.437066 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:10.437092 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:43417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260811 16:40:10.437390 19181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:10.437309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:43417 (local address 127.24.175.194:34177)
0811 16:40:10.437346 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:10.437369 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:43417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260811 16:40:10.437503 19177 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 16:40:10.517920 19182 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:40:10.518115 19182 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:40:10.518146 19182 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:40:10.519275 19182 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:40:10.519313 19182 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:40:10.519348 19182 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.195
I20260811 16:40:10.520772 19182 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:43091
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab
--principal=kudu/127.24.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.195:42421
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.175.195
--webserver_port=39817
--tserver_master_addrs=127.24.175.254:43417
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19182
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.195
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:40:10.520987 19182 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:40:10.521179 19182 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 16:40:10.526079 19182 server_base.cc:1034] running on GCE node
W20260811 16:40:10.526038 19191 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:40:10.526052 19194 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:40:10.526050 19198 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:40:10.526480 19182 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:40:10.526727 19182 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:40:10.527863 19182 hybrid_clock.cc:648] HybridClock initialized: now 1786466410527849 us; error 26 us; skew 500 ppm
Aug 11 16:40:10 dist-test-slave-zj8q krb5kdc[16729](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466410, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:40:10.530272 19182 init.cc:377] Logged in from keytab as kudu/127.24.175.195@KRBTEST.COM (short username kudu)
I20260811 16:40:10.530658 19182 webserver.cc:460] Webserver started at http://127.24.175.195:39817/ using document root <none> and password file <none>
I20260811 16:40:10.530826 19182 fs_manager.cc:359] Metadata directory not provided
I20260811 16:40:10.530865 19182 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:40:10.532056 19182 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:40:10.532559 19206 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:40:10.532708 19182 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 16:40:10.532790 19182 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-2/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-2/wal
uuid: "4b0c7fb902f44dfaa9fca8b0040dad8f"
format_stamp: "Formatted at 2026-08-11 16:40:08 on dist-test-slave-zj8q"
server_key: "a1fce6b75b7c189005b4667f3a0423a7"
server_key_iv: "d9617499ba98fe305c9388eb56e089f8"
server_key_version: "encryptionkey@0"
I20260811 16:40:10.533102 19182 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:40:10.564296 19182 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:40:10.566473 19182 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:40:10.566610 19182 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:40:10.566834 19182 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:40:10.567149 19182 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:40:10.567186 19182 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:40:10.567210 19182 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:40:10.567234 19182 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:40:10.572707 19182 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.195:42421
I20260811 16:40:10.572778 19398 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.195:42421 every 8 connection(s)
I20260811 16:40:10.573101 19182 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
I20260811 16:40:10.574082 19407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:10.573732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:43417 (local address 127.24.175.195:57361)
0811 16:40:10.573870 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:10.573944 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:43417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":71,"threads_started":1}
W20260811 16:40:10.574492 19399 heartbeater.cc:644] Failed to heartbeat to 127.24.175.254:43417 (0 consecutive failures): Network error: Failed to ping master at 127.24.175.254:43417: Client connection negotiation failed: client connection to 127.24.175.254:43417: connect: Connection refused (error 111)
I20260811 16:40:10.574752 19407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:10.574668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:43417 (local address 127.24.175.195:58555)
0811 16:40:10.574705 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:10.574736 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:43417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260811 16:40:10.574957 19407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:10.574901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:43417 (local address 127.24.175.195:60053)
0811 16:40:10.574927 (+ 26us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:10.574945 (+ 18us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:43417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
W20260811 16:40:10.575038 19399 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 16:40:10.582077 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 19182
I20260811 16:40:11.360232 19409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:11.359986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:43417 (local address 127.24.175.193:49235)
0811 16:40:11.360110 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:11.360141 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:43417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":63,"threads_started":1}
I20260811 16:40:11.437965 19410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:11.437777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:43417 (local address 127.24.175.194:41751)
0811 16:40:11.437887 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:11.437917 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:43417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":56,"threads_started":1}
I20260811 16:40:11.575520 19412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:11.575329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:43417 (local address 127.24.175.195:37443)
0811 16:40:11.575440 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:11.575471 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:43417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":62,"threads_started":1}
I20260811 16:40:12.094543 19413 raft_consensus.cc:482] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2a0b5cba6b0841cc96d429b81d897f1c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:40:12.094666 19413 raft_consensus.cc:504] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2a0b5cba6b0841cc96d429b81d897f1c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b0c7fb902f44dfaa9fca8b0040dad8f" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42421 } } peers { permanent_uuid: "2c02d356d12548a6ba3cab2218d7e6c3" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 35265 } } peers { permanent_uuid: "2a0b5cba6b0841cc96d429b81d897f1c" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 35661 } }
I20260811 16:40:12.094960 19413 leader_election.cc:288] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2a0b5cba6b0841cc96d429b81d897f1c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b0c7fb902f44dfaa9fca8b0040dad8f (127.24.175.195:42421), 2c02d356d12548a6ba3cab2218d7e6c3 (127.24.175.194:35265)
Aug 11 16:40:12 dist-test-slave-zj8q krb5kdc[16729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466410, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.193@KRBTEST.COM for kudu/127.24.175.194@KRBTEST.COM
Aug 11 16:40:12 dist-test-slave-zj8q krb5kdc[16729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466410, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.193@KRBTEST.COM for kudu/127.24.175.195@KRBTEST.COM
I20260811 16:40:12.104775 19419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:12.095244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:33633 (local address 127.24.175.194:35265)
0811 16:40:12.095486 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:12.095495 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:12.095513 (+ 18us) server_negotiation.cc:407] Connection header received
0811 16:40:12.095953 (+ 440us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:12.095955 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:12.095994 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:12.096131 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:40:12.096840 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:12.097696 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:12.098723 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:12.099115 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:12.099210 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:12.101428 (+ 2218us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:40:12.101432 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:40:12.101432 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:40:12.101443 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:40:12.103109 (+ 1666us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:12.103539 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:12.103543 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:12.103543 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:12.103672 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:12.103978 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:12.103979 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:12.103979 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:12.104198 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:40:12.104272 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 16:40:12.104535 (+ 263us) server_negotiation.cc:299] Negotiation successful
0811 16:40:12.104664 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":204,"thread_start_us":45,"threads_started":1}
I20260811 16:40:12.104786 19418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:12.095222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:52813 (local address 127.24.175.195:42421)
0811 16:40:12.095392 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:12.095403 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:12.095425 (+ 22us) server_negotiation.cc:407] Connection header received
0811 16:40:12.095875 (+ 450us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:12.095877 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:12.095919 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:12.096031 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:40:12.096842 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:12.097696 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:12.098719 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:12.099115 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:12.099209 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:12.101765 (+ 2556us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:40:12.101769 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:40:12.101769 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:40:12.101778 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:40:12.103223 (+ 1445us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:12.103600 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:12.103603 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:12.103603 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:12.103699 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:12.103961 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:12.103961 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:12.103962 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:12.104193 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:40:12.104258 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 16:40:12.104542 (+ 284us) server_negotiation.cc:299] Negotiation successful
0811 16:40:12.104664 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":57,"threads_started":1}
I20260811 16:40:12.104775 19417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:12.095133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.194:35265 (local address 127.24.175.193:33633)
0811 16:40:12.095357 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:12.095366 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:40:12.095406 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:40:12.096141 (+ 735us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:40:12.096142 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:40:12.096540 (+ 398us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:40:12.096723 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:12.096729 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:12.097791 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:12.097792 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:12.098639 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:12.098642 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:12.099197 (+ 555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:12.099198 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:12.099308 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:12.099857 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:40:12.099862 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:40:12.101329 (+ 1467us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:40:12.103206 (+ 1877us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:40:12.103213 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:40:12.103215 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:40:12.103466 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:40:12.103762 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:40:12.103763 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:40:12.103763 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:40:12.103897 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:40:12.104281 (+ 384us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:40:12.104282 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:40:12.104384 (+ 102us) client_negotiation.cc:769] Sending connection context
0811 16:40:12.104473 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 16:40:12.104661 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":213,"mutex_wait_us":49,"thread_start_us":52,"threads_started":1}
I20260811 16:40:12.104853 19416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:12.095133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.195:42421 (local address 127.24.175.193:52813)
0811 16:40:12.095262 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:12.095271 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:40:12.095332 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:40:12.096116 (+ 784us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:40:12.096120 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:40:12.096539 (+ 419us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:40:12.096723 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:12.096729 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:12.097801 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:12.097802 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:12.098638 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:12.098641 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:12.099201 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:12.099202 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:12.099310 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:12.099816 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:40:12.099825 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:40:12.101670 (+ 1845us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:40:12.103302 (+ 1632us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:40:12.103303 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:40:12.103304 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:40:12.103514 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:40:12.103812 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:40:12.103813 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:40:12.103813 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:40:12.103897 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:40:12.104257 (+ 360us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:40:12.104264 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:40:12.104386 (+ 122us) client_negotiation.cc:769] Sending connection context
0811 16:40:12.104473 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 16:40:12.104735 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"mutex_wait_us":170,"thread_start_us":67,"threads_started":1}
W20260811 16:40:12.105823 18776 leader_election.cc:341] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2a0b5cba6b0841cc96d429b81d897f1c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2c02d356d12548a6ba3cab2218d7e6c3 (127.24.175.194:35265): Not found: Tablet not found: 33eca10a8d8f4d5194b88fcd8ffa8b51
W20260811 16:40:12.105996 18781 leader_election.cc:341] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2a0b5cba6b0841cc96d429b81d897f1c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4b0c7fb902f44dfaa9fca8b0040dad8f (127.24.175.195:42421): Not found: Tablet not found: 33eca10a8d8f4d5194b88fcd8ffa8b51
I20260811 16:40:12.106030 18781 leader_election.cc:302] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2a0b5cba6b0841cc96d429b81d897f1c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a0b5cba6b0841cc96d429b81d897f1c; no voters: 2c02d356d12548a6ba3cab2218d7e6c3, 4b0c7fb902f44dfaa9fca8b0040dad8f
I20260811 16:40:12.106132 19413 raft_consensus.cc:2726] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2a0b5cba6b0841cc96d429b81d897f1c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:40:12.360709 19416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:12.360582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:43417 (local address 127.24.175.193:49945)
0811 16:40:12.360629 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:12.360668 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:43417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260811 16:40:12.438539 19420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:12.438332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:43417 (local address 127.24.175.194:58745)
0811 16:40:12.438455 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:12.438498 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:43417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":73,"threads_started":1}
I20260811 16:40:12.576138 19421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:12.575932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:43417 (local address 127.24.175.195:35017)
0811 16:40:12.576044 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:12.576094 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:43417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":62,"threads_started":1}
I20260811 16:40:13.361313 19422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:13.361086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:43417 (local address 127.24.175.193:48429)
0811 16:40:13.361222 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:13.361267 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:43417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":61,"threads_started":1}
I20260811 16:40:13.439139 19423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:13.438929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:43417 (local address 127.24.175.194:48551)
0811 16:40:13.439047 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:13.439084 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:43417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":57,"threads_started":1}
I20260811 16:40:13.576773 19425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:13.576551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:43417 (local address 127.24.175.195:59969)
0811 16:40:13.576688 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:13.576721 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:43417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":76,"threads_started":1}
I20260811 16:40:14.166743 19426 raft_consensus.cc:482] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2a0b5cba6b0841cc96d429b81d897f1c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:40:14.166843 19426 raft_consensus.cc:504] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2a0b5cba6b0841cc96d429b81d897f1c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b0c7fb902f44dfaa9fca8b0040dad8f" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42421 } } peers { permanent_uuid: "2c02d356d12548a6ba3cab2218d7e6c3" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 35265 } } peers { permanent_uuid: "2a0b5cba6b0841cc96d429b81d897f1c" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 35661 } }
I20260811 16:40:14.167011 19426 leader_election.cc:288] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2a0b5cba6b0841cc96d429b81d897f1c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b0c7fb902f44dfaa9fca8b0040dad8f (127.24.175.195:42421), 2c02d356d12548a6ba3cab2218d7e6c3 (127.24.175.194:35265)
W20260811 16:40:14.167491 18776 leader_election.cc:341] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2a0b5cba6b0841cc96d429b81d897f1c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2c02d356d12548a6ba3cab2218d7e6c3 (127.24.175.194:35265): Not found: Tablet not found: 33eca10a8d8f4d5194b88fcd8ffa8b51
W20260811 16:40:14.167662 18781 leader_election.cc:341] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2a0b5cba6b0841cc96d429b81d897f1c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4b0c7fb902f44dfaa9fca8b0040dad8f (127.24.175.195:42421): Not found: Tablet not found: 33eca10a8d8f4d5194b88fcd8ffa8b51
I20260811 16:40:14.167727 18781 leader_election.cc:302] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2a0b5cba6b0841cc96d429b81d897f1c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a0b5cba6b0841cc96d429b81d897f1c; no voters: 2c02d356d12548a6ba3cab2218d7e6c3, 4b0c7fb902f44dfaa9fca8b0040dad8f
I20260811 16:40:14.167793 19426 raft_consensus.cc:2726] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2a0b5cba6b0841cc96d429b81d897f1c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:40:14.361984 19428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:14.361743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:43417 (local address 127.24.175.193:41843)
0811 16:40:14.361893 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:14.361933 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:43417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":67,"threads_started":1}
I20260811 16:40:14.439746 19430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:14.439529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:43417 (local address 127.24.175.194:47887)
0811 16:40:14.439644 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:14.439679 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:43417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":63,"threads_started":1}
I20260811 16:40:14.577435 19432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:14.577223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:43417 (local address 127.24.175.195:44785)
0811 16:40:14.577349 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:14.577383 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:43417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":66,"threads_started":1}
I20260811 16:40:15.362627 19433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:15.362418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:43417 (local address 127.24.175.193:51269)
0811 16:40:15.362539 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:15.362577 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:43417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":67,"threads_started":1}
I20260811 16:40:15.440418 19434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:15.440213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:43417 (local address 127.24.175.194:50109)
0811 16:40:15.440338 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:15.440373 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:43417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":61,"threads_started":1}
I20260811 16:40:15.578177 19435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:15.577898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:43417 (local address 127.24.175.195:41767)
0811 16:40:15.578068 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:15.578108 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:43417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":80,"threads_started":1}
I20260811 16:40:15.823693 19436 raft_consensus.cc:482] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2a0b5cba6b0841cc96d429b81d897f1c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:40:15.823802 19436 raft_consensus.cc:504] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2a0b5cba6b0841cc96d429b81d897f1c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b0c7fb902f44dfaa9fca8b0040dad8f" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42421 } } peers { permanent_uuid: "2c02d356d12548a6ba3cab2218d7e6c3" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 35265 } } peers { permanent_uuid: "2a0b5cba6b0841cc96d429b81d897f1c" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 35661 } }
I20260811 16:40:15.823994 19436 leader_election.cc:288] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2a0b5cba6b0841cc96d429b81d897f1c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b0c7fb902f44dfaa9fca8b0040dad8f (127.24.175.195:42421), 2c02d356d12548a6ba3cab2218d7e6c3 (127.24.175.194:35265)
W20260811 16:40:15.824359 18776 leader_election.cc:341] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2a0b5cba6b0841cc96d429b81d897f1c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2c02d356d12548a6ba3cab2218d7e6c3 (127.24.175.194:35265): Not found: Tablet not found: 33eca10a8d8f4d5194b88fcd8ffa8b51
W20260811 16:40:15.824451 18781 leader_election.cc:341] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2a0b5cba6b0841cc96d429b81d897f1c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4b0c7fb902f44dfaa9fca8b0040dad8f (127.24.175.195:42421): Not found: Tablet not found: 33eca10a8d8f4d5194b88fcd8ffa8b51
I20260811 16:40:15.824493 18781 leader_election.cc:302] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2a0b5cba6b0841cc96d429b81d897f1c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a0b5cba6b0841cc96d429b81d897f1c; no voters: 2c02d356d12548a6ba3cab2218d7e6c3, 4b0c7fb902f44dfaa9fca8b0040dad8f
I20260811 16:40:15.824558 19436 raft_consensus.cc:2726] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2a0b5cba6b0841cc96d429b81d897f1c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:40:16.363214 19438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:16.363001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:43417 (local address 127.24.175.193:44263)
0811 16:40:16.363130 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:16.363167 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:43417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":65,"threads_started":1}
I20260811 16:40:16.441043 19439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:16.440837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:43417 (local address 127.24.175.194:45421)
0811 16:40:16.440964 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:16.441001 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:43417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":62,"threads_started":1}
I20260811 16:40:16.578819 19440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:16.578607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:43417 (local address 127.24.175.195:45377)
0811 16:40:16.578734 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:16.578774 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:43417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":64,"threads_started":1}
I20260811 16:40:17.363860 19441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:17.363656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:43417 (local address 127.24.175.193:58423)
0811 16:40:17.363774 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:17.363811 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:43417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":62,"threads_started":1}
I20260811 16:40:17.441753 19442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:17.441490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:43417 (local address 127.24.175.194:50747)
0811 16:40:17.441665 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:17.441706 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:43417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":110,"threads_started":1}
I20260811 16:40:17.579427 19443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:17.579203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:43417 (local address 127.24.175.195:56171)
0811 16:40:17.579346 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:17.579384 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:43417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":79,"threads_started":1}
I20260811 16:40:18.364480 19444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:18.364279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:43417 (local address 127.24.175.193:58001)
0811 16:40:18.364398 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:18.364432 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:43417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":65,"threads_started":1}
I20260811 16:40:18.442384 19446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:18.442176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:43417 (local address 127.24.175.194:59047)
0811 16:40:18.442308 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:18.442343 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:43417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":74,"threads_started":1}
I20260811 16:40:18.580085 19450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:18.579836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:43417 (local address 127.24.175.195:58061)
0811 16:40:18.579977 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:18.580016 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:43417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":86,"threads_started":1}
I20260811 16:40:19.365114 19453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:19.364912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:43417 (local address 127.24.175.193:39749)
0811 16:40:19.365034 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:19.365066 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:43417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":60,"threads_started":1}
I20260811 16:40:19.442986 19454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:19.442770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:43417 (local address 127.24.175.194:46885)
0811 16:40:19.442906 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:19.442944 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:43417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":62,"threads_started":1}
I20260811 16:40:19.580700 19456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:19.580487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:43417 (local address 127.24.175.195:58383)
0811 16:40:19.580622 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:19.580659 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:43417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":74,"threads_started":1}
I20260811 16:40:20.365810 19457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:20.365548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:43417 (local address 127.24.175.193:44139)
0811 16:40:20.365710 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:20.365748 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:43417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":78,"threads_started":1}
I20260811 16:40:20.443606 19458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:20.443420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:43417 (local address 127.24.175.194:49967)
0811 16:40:20.443534 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:20.443565 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:43417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":64,"threads_started":1}
I20260811 16:40:20.581260 19459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:20.581044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:43417 (local address 127.24.175.195:60539)
0811 16:40:20.581176 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:20.581211 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:43417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":76,"threads_started":1}
I20260811 16:40:20.771534 19460 raft_consensus.cc:482] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2a0b5cba6b0841cc96d429b81d897f1c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:40:20.771639 19460 raft_consensus.cc:504] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2a0b5cba6b0841cc96d429b81d897f1c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b0c7fb902f44dfaa9fca8b0040dad8f" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42421 } } peers { permanent_uuid: "2c02d356d12548a6ba3cab2218d7e6c3" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 35265 } } peers { permanent_uuid: "2a0b5cba6b0841cc96d429b81d897f1c" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 35661 } }
I20260811 16:40:20.771781 19460 leader_election.cc:288] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2a0b5cba6b0841cc96d429b81d897f1c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b0c7fb902f44dfaa9fca8b0040dad8f (127.24.175.195:42421), 2c02d356d12548a6ba3cab2218d7e6c3 (127.24.175.194:35265)
W20260811 16:40:20.772168 18781 leader_election.cc:341] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2a0b5cba6b0841cc96d429b81d897f1c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4b0c7fb902f44dfaa9fca8b0040dad8f (127.24.175.195:42421): Not found: Tablet not found: 33eca10a8d8f4d5194b88fcd8ffa8b51
W20260811 16:40:20.772276 18776 leader_election.cc:341] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2a0b5cba6b0841cc96d429b81d897f1c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2c02d356d12548a6ba3cab2218d7e6c3 (127.24.175.194:35265): Not found: Tablet not found: 33eca10a8d8f4d5194b88fcd8ffa8b51
I20260811 16:40:20.772408 18776 leader_election.cc:302] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2a0b5cba6b0841cc96d429b81d897f1c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a0b5cba6b0841cc96d429b81d897f1c; no voters: 2c02d356d12548a6ba3cab2218d7e6c3, 4b0c7fb902f44dfaa9fca8b0040dad8f
I20260811 16:40:20.772490 19460 raft_consensus.cc:2726] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2a0b5cba6b0841cc96d429b81d897f1c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:40:21.366439 19461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:21.366240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:43417 (local address 127.24.175.193:37245)
0811 16:40:21.366359 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:21.366393 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:43417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":63,"threads_started":1}
I20260811 16:40:21.444159 19465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:21.443960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:43417 (local address 127.24.175.194:49559)
0811 16:40:21.444086 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:21.444119 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:43417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":75,"threads_started":1}
I20260811 16:40:21.581934 19466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:21.581703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:43417 (local address 127.24.175.195:51921)
0811 16:40:21.581852 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:21.581889 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:43417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":77,"threads_started":1}
I20260811 16:40:22.367055 19468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:22.366841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:43417 (local address 127.24.175.193:52337)
0811 16:40:22.366967 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:22.367005 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:43417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":62,"threads_started":1}
I20260811 16:40:22.444710 19469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:22.444526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:43417 (local address 127.24.175.194:45109)
0811 16:40:22.444637 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:22.444668 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:43417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":57,"threads_started":1}
I20260811 16:40:22.582558 19471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:22.582370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:43417 (local address 127.24.175.195:56333)
0811 16:40:22.582481 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:22.582512 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:43417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":60,"threads_started":1}
I20260811 16:40:23.223261 19472 raft_consensus.cc:482] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2a0b5cba6b0841cc96d429b81d897f1c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:40:23.223359 19472 raft_consensus.cc:504] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2a0b5cba6b0841cc96d429b81d897f1c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b0c7fb902f44dfaa9fca8b0040dad8f" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42421 } } peers { permanent_uuid: "2c02d356d12548a6ba3cab2218d7e6c3" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 35265 } } peers { permanent_uuid: "2a0b5cba6b0841cc96d429b81d897f1c" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 35661 } }
I20260811 16:40:23.223551 19472 leader_election.cc:288] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2a0b5cba6b0841cc96d429b81d897f1c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b0c7fb902f44dfaa9fca8b0040dad8f (127.24.175.195:42421), 2c02d356d12548a6ba3cab2218d7e6c3 (127.24.175.194:35265)
W20260811 16:40:23.223874 18776 leader_election.cc:341] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2a0b5cba6b0841cc96d429b81d897f1c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2c02d356d12548a6ba3cab2218d7e6c3 (127.24.175.194:35265): Not found: Tablet not found: 33eca10a8d8f4d5194b88fcd8ffa8b51
W20260811 16:40:23.223950 18781 leader_election.cc:341] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2a0b5cba6b0841cc96d429b81d897f1c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4b0c7fb902f44dfaa9fca8b0040dad8f (127.24.175.195:42421): Not found: Tablet not found: 33eca10a8d8f4d5194b88fcd8ffa8b51
I20260811 16:40:23.224010 18781 leader_election.cc:302] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2a0b5cba6b0841cc96d429b81d897f1c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a0b5cba6b0841cc96d429b81d897f1c; no voters: 2c02d356d12548a6ba3cab2218d7e6c3, 4b0c7fb902f44dfaa9fca8b0040dad8f
I20260811 16:40:23.224089 19472 raft_consensus.cc:2726] T 33eca10a8d8f4d5194b88fcd8ffa8b51 P 2a0b5cba6b0841cc96d429b81d897f1c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:40:23.367753 19473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:23.367496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:43417 (local address 127.24.175.193:41735)
0811 16:40:23.367656 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:23.367696 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:43417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":82,"threads_started":1}
I20260811 16:40:23.445339 19474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:23.445104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:43417 (local address 127.24.175.194:50391)
0811 16:40:23.445257 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:23.445295 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:43417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":77,"threads_started":1}
I20260811 16:40:23.583184 19475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:23.582983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:43417 (local address 127.24.175.195:50113)
0811 16:40:23.583106 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:23.583140 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:43417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":73,"threads_started":1}
I20260811 16:40:24.368378 19477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:24.368188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:43417 (local address 127.24.175.193:46729)
0811 16:40:24.368298 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:24.368331 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:43417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":60,"threads_started":1}
I20260811 16:40:24.445935 19480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:24.445711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:43417 (local address 127.24.175.194:34745)
0811 16:40:24.445860 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:24.445890 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:43417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":81,"threads_started":1}
I20260811 16:40:24.583855 19481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:24.583607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:43417 (local address 127.24.175.195:58525)
0811 16:40:24.583768 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:24.583806 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:43417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":95,"threads_started":1}
I20260811 16:40:25.368994 19485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:25.368814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:43417 (local address 127.24.175.193:56433)
0811 16:40:25.368922 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:25.368950 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:43417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":62,"threads_started":1}
I20260811 16:40:25.446539 19486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:25.446355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:43417 (local address 127.24.175.194:42661)
0811 16:40:25.446467 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:25.446499 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:43417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":57,"threads_started":1}
I20260811 16:40:25.584517 19488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:25.584292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:43417 (local address 127.24.175.195:38793)
0811 16:40:25.584433 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:25.584470 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:43417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":59,"threads_started":1}
I20260811 16:40:25.592434 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 18696
I20260811 16:40:25.607262 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 18962
I20260811 16:40:25.619349 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 19182
2026-08-11T16:40:25Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (18730 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:40:25 dist-test-slave-zj8q krb5kdc[19492](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:40:25 dist-test-slave-zj8q krb5kdc[19492](info): set up 2 sockets
Aug 11 16:40:25 dist-test-slave-zj8q krb5kdc[19492](info): commencing operation
krb5kdc: starting...
W20260811 16:40:26.787420 25279 mini_kdc.cc:121] Time spent starting KDC: real 1.147s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Aug 11 16:40:26 dist-test-slave-zj8q krb5kdc[19492](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466426, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:40:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:40:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab.
Entry for principal kudu/127.24.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab.
I20260811 16:40:26.904603 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:36391
--webserver_interface=127.24.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:44797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.175.254:36391
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:40:26.985339 19513 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:40:26.985551 19513 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:40:26.985582 19513 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:40:26.986742 19513 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 16:40:26.986783 19513 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 16:40:26.986799 19513 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 16:40:26.986814 19513 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:40:26.986829 19513 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:40:26.986845 19513 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:40:26.986862 19513 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:40:26.986884 19513 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:40:26.988332 19513 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:44797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.24.175.254:36391
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:36391
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19513
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:40:26.988570 19513 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:40:26.988777 19513 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:40:26.993492 19526 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:40:26.993561 19524 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:40:26.993503 19523 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:40:26.993611 19513 server_base.cc:1034] running on GCE node
I20260811 16:40:26.994014 19513 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:40:26.994302 19513 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:40:26.995440 19513 hybrid_clock.cc:648] HybridClock initialized: now 1786466426995426 us; error 29 us; skew 500 ppm
Aug 11 16:40:26 dist-test-slave-zj8q krb5kdc[19492](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466426, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:40:26.997751 19513 init.cc:377] Logged in from keytab as kudu/127.24.175.254@KRBTEST.COM (short username kudu)
I20260811 16:40:26.998142 19513 webserver.cc:460] Webserver started at http://127.24.175.254:43503/ using document root <none> and password file <none>
I20260811 16:40:26.998418 19513 fs_manager.cc:359] Metadata directory not provided
I20260811 16:40:26.998469 19513 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:40:26.998596 19513 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:40:26.999611 19513 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/master-0/data/instance:
uuid: "5a8635a9291b404d8d80e67b5217beb4"
format_stamp: "Formatted at 2026-08-11 16:40:26 on dist-test-slave-zj8q"
server_key: "1f4e5699189ca66f70c9ae46016dae1b"
server_key_iv: "30c3a5626f5105ab2e9d0c90e6ceade4"
server_key_version: "encryptionkey@0"
I20260811 16:40:26.999951 19513 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/master-0/wal/instance:
uuid: "5a8635a9291b404d8d80e67b5217beb4"
format_stamp: "Formatted at 2026-08-11 16:40:26 on dist-test-slave-zj8q"
server_key: "1f4e5699189ca66f70c9ae46016dae1b"
server_key_iv: "30c3a5626f5105ab2e9d0c90e6ceade4"
server_key_version: "encryptionkey@0"
I20260811 16:40:27.001166 19513 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 16:40:27.001801 19537 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:40:27.001948 19513 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 16:40:27.002023 19513 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/master-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/master-0/wal
uuid: "5a8635a9291b404d8d80e67b5217beb4"
format_stamp: "Formatted at 2026-08-11 16:40:26 on dist-test-slave-zj8q"
server_key: "1f4e5699189ca66f70c9ae46016dae1b"
server_key_iv: "30c3a5626f5105ab2e9d0c90e6ceade4"
server_key_version: "encryptionkey@0"
I20260811 16:40:27.002089 19513 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:40:27.021216 19513 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:40:27.022940 19513 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:40:27.023051 19513 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:40:27.026867 19513 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.254:36391
I20260811 16:40:27.026908 19625 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.254:36391 every 8 connection(s)
I20260811 16:40:27.027238 19513 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
I20260811 16:40:27.028103 19626 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:40:27.028781 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 19513
I20260811 16:40:27.028882 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/master-0/wal/instance
I20260811 16:40:27.029093 25279 external_mini_cluster.cc:1428] Setting key 35647cb332b68c455ae3846c2b478431
I20260811 16:40:27.031162 19626 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4: Bootstrap starting.
I20260811 16:40:27.031874 19626 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4: Neither blocks nor log segments found. Creating new log.
I20260811 16:40:27.032174 19626 log.cc:824] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4: Log is configured to *not* fsync() on all Append() calls
I20260811 16:40:27.032863 19626 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4: No bootstrap required, opened a new log
I20260811 16:40:27.034947 19626 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a8635a9291b404d8d80e67b5217beb4" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 36391 } }
I20260811 16:40:27.035082 19626 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:40:27.035104 19626 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a8635a9291b404d8d80e67b5217beb4, State: Initialized, Role: FOLLOWER
I20260811 16:40:27.035211 19626 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a8635a9291b404d8d80e67b5217beb4" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 36391 } }
I20260811 16:40:27.035286 19626 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:40:27.035308 19626 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:40:27.035344 19626 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4 [term 0 FOLLOWER]: Advancing to term 1
Aug 11 16:40:27 dist-test-slave-zj8q krb5kdc[19492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466426, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:40:27.035806 19626 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a8635a9291b404d8d80e67b5217beb4" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 36391 } }
I20260811 16:40:27.035903 19626 leader_election.cc:302] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5a8635a9291b404d8d80e67b5217beb4; no voters:
I20260811 16:40:27.036063 19626 leader_election.cc:288] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:40:27.036100 19631 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:40:27.036243 19631 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4 [term 1 LEADER]: Becoming Leader. State: Replica: 5a8635a9291b404d8d80e67b5217beb4, State: Running, Role: LEADER
I20260811 16:40:27.036331 19631 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a8635a9291b404d8d80e67b5217beb4" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 36391 } }
I20260811 16:40:27.036352 19626 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:40:27.036662 19631 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5a8635a9291b404d8d80e67b5217beb4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a8635a9291b404d8d80e67b5217beb4" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 36391 } } }
I20260811 16:40:27.036744 19631 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4 [sys.catalog]: This master's current role is: LEADER
I20260811 16:40:27.036870 19631 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5a8635a9291b404d8d80e67b5217beb4. Latest consensus state: current_term: 1 leader_uuid: "5a8635a9291b404d8d80e67b5217beb4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a8635a9291b404d8d80e67b5217beb4" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 36391 } } }
I20260811 16:40:27.036927 19631 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4 [sys.catalog]: This master's current role is: LEADER
I20260811 16:40:27.037039 19642 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:40:27.037529 19642 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:40:27.039520 19629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:27.029600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43834 (local address 127.24.175.254:36391)
0811 16:40:27.029809 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:27.029818 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:27.029850 (+ 32us) server_negotiation.cc:407] Connection header received
0811 16:40:27.030413 (+ 563us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:27.030423 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:27.030489 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:27.030627 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:40:27.031246 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:27.032552 (+ 1306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:27.033316 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:27.033928 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:27.034040 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:27.036247 (+ 2207us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:40:27.036251 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:40:27.036251 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:40:27.036261 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:40:27.037962 (+ 1701us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:27.038382 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:27.038386 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:27.038386 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:27.038495 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:27.038693 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:27.038694 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:27.038695 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:27.038931 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:40:27.039087 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0811 16:40:27.039185 (+ 98us) server_negotiation.cc:299] Negotiation successful
0811 16:40:27.039316 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":66,"threads_started":1}
I20260811 16:40:27.039642 19642 catalog_manager.cc:1347] Generated new cluster ID: 3944e9f67efe48f6bb42d6f97625b090
I20260811 16:40:27.039685 19642 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:40:27.067010 19642 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:40:27.067559 19642 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:40:27.073024 19642 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4: Generated new TSK 0
I20260811 16:40:27.073230 19642 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.175.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab.
Entry for principal kudu/127.24.175.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab.
I20260811 16:40:27.106973 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.193:0
--local_ip_for_outbound_sockets=127.24.175.193
--webserver_interface=127.24.175.193
--webserver_port=0
--tserver_master_addrs=127.24.175.254:36391
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab
--principal=kudu/127.24.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:44797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:40:27.208093 19667 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:40:27.208295 19667 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:40:27.208328 19667 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:40:27.209465 19667 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:40:27.209503 19667 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:40:27.209539 19667 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.193
I20260811 16:40:27.211012 19667 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:44797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab
--principal=kudu/127.24.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.175.193
--webserver_port=0
--tserver_master_addrs=127.24.175.254:36391
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19667
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.193
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:40:27.211248 19667 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:40:27.211454 19667 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:40:27.216847 19676 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:40:27.216840 19673 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:40:27.216886 19667 server_base.cc:1034] running on GCE node
W20260811 16:40:27.216841 19678 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:40:27.217199 19667 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:40:27.217450 19667 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:40:27.218585 19667 hybrid_clock.cc:648] HybridClock initialized: now 1786466427218570 us; error 33 us; skew 500 ppm
Aug 11 16:40:27 dist-test-slave-zj8q krb5kdc[19492](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466427, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:40:27.220974 19667 init.cc:377] Logged in from keytab as kudu/127.24.175.193@KRBTEST.COM (short username kudu)
I20260811 16:40:27.221380 19667 webserver.cc:460] Webserver started at http://127.24.175.193:41611/ using document root <none> and password file <none>
I20260811 16:40:27.221576 19667 fs_manager.cc:359] Metadata directory not provided
I20260811 16:40:27.221624 19667 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:40:27.221755 19667 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:40:27.222808 19667 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-0/data/instance:
uuid: "3df5160026ee4c649e68690a9a69c32e"
format_stamp: "Formatted at 2026-08-11 16:40:27 on dist-test-slave-zj8q"
server_key: "85e026ce24b12ddb135e9195c635d895"
server_key_iv: "fc193234b0795821d07ec169fd1a5040"
server_key_version: "encryptionkey@0"
I20260811 16:40:27.223131 19667 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-0/wal/instance:
uuid: "3df5160026ee4c649e68690a9a69c32e"
format_stamp: "Formatted at 2026-08-11 16:40:27 on dist-test-slave-zj8q"
server_key: "85e026ce24b12ddb135e9195c635d895"
server_key_iv: "fc193234b0795821d07ec169fd1a5040"
server_key_version: "encryptionkey@0"
I20260811 16:40:27.224370 19667 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:40:27.225062 19689 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:40:27.225232 19667 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:40:27.225317 19667 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-0/wal
uuid: "3df5160026ee4c649e68690a9a69c32e"
format_stamp: "Formatted at 2026-08-11 16:40:27 on dist-test-slave-zj8q"
server_key: "85e026ce24b12ddb135e9195c635d895"
server_key_iv: "fc193234b0795821d07ec169fd1a5040"
server_key_version: "encryptionkey@0"
I20260811 16:40:27.225375 19667 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:40:27.239439 19667 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:40:27.241789 19667 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:40:27.241937 19667 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:40:27.242290 19667 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:40:27.242708 19667 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:40:27.242765 19667 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:40:27.242795 19667 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:40:27.242846 19667 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:40:27.248595 19667 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.193:34953
I20260811 16:40:27.248670 19878 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.193:34953 every 8 connection(s)
I20260811 16:40:27.248960 19667 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
I20260811 16:40:27.253252 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 19667
I20260811 16:40:27.253367 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-0/wal/instance
I20260811 16:40:27.253556 25279 external_mini_cluster.cc:1428] Setting key afca0ce40e9b07f13974bbbfec1ff2bf
Aug 11 16:40:27 dist-test-slave-zj8q krb5kdc[19492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466427, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.193@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:40:27.258334 19629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:27.249645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:50751 (local address 127.24.175.254:36391)
0811 16:40:27.249695 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:27.249697 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:27.249874 (+ 177us) server_negotiation.cc:407] Connection header received
0811 16:40:27.250437 (+ 563us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:27.250438 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:27.250451 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:27.250503 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:40:27.251446 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:27.251973 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:27.252950 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:27.253230 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:27.253296 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:27.255621 (+ 2325us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:40:27.255623 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:40:27.255623 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:40:27.255631 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:40:27.256915 (+ 1284us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:27.257346 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:27.257347 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:27.257348 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:27.257407 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:27.257671 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:27.257672 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:27.257672 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:27.257785 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:40:27.257835 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 16:40:27.258142 (+ 307us) server_negotiation.cc:299] Negotiation successful
0811 16:40:27.258266 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 16:40:27.258562 19882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:27.249609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:36391 (local address 127.24.175.193:50751)
0811 16:40:27.249765 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:27.249800 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 16:40:27.250342 (+ 542us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:40:27.250573 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:40:27.250578 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:40:27.251159 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:40:27.251354 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:27.251360 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:27.252070 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:27.252071 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:27.252870 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:27.252872 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:27.253338 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:27.253339 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:27.253488 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:27.254112 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:40:27.254122 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:40:27.255525 (+ 1403us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:40:27.256998 (+ 1473us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:40:27.257006 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:40:27.257008 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:40:27.257274 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:40:27.257468 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:40:27.257469 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:40:27.257470 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:40:27.257610 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:40:27.257839 (+ 229us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:40:27.257846 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:40:27.258009 (+ 163us) client_negotiation.cc:769] Sending connection context
0811 16:40:27.258117 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 16:40:27.258303 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":81,"threads_started":1}
I20260811 16:40:27.259069 19879 heartbeater.cc:347] Connected to a master server at 127.24.175.254:36391
I20260811 16:40:27.259181 19879 heartbeater.cc:464] Registering TS with master...
I20260811 16:40:27.259421 19879 heartbeater.cc:511] Master 127.24.175.254:36391 requested a full tablet report, sending...
I20260811 16:40:27.259994 19568 ts_manager.cc:194] Registered new tserver with Master: 3df5160026ee4c649e68690a9a69c32e (127.24.175.193:34953)
I20260811 16:40:27.260579 19568 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.175.193@KRBTEST.COM'} at 127.24.175.193:50751
WARNING: no policy specified for kudu/127.24.175.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab.
Entry for principal kudu/127.24.175.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab.
I20260811 16:40:27.278896 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.194:0
--local_ip_for_outbound_sockets=127.24.175.194
--webserver_interface=127.24.175.194
--webserver_port=0
--tserver_master_addrs=127.24.175.254:36391
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab
--principal=kudu/127.24.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:44797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:40:27.361500 19885 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:40:27.361708 19885 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:40:27.361732 19885 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:40:27.362874 19885 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:40:27.362912 19885 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:40:27.362936 19885 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.194
I20260811 16:40:27.364406 19885 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:44797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab
--principal=kudu/127.24.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.175.194
--webserver_port=0
--tserver_master_addrs=127.24.175.254:36391
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19885
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.194
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:40:27.364614 19885 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:40:27.364794 19885 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:40:27.369663 19893 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:40:27.369694 19897 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:40:27.369674 19894 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:40:27.369881 19885 server_base.cc:1034] running on GCE node
I20260811 16:40:27.370070 19885 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:40:27.370325 19885 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:40:27.371466 19885 hybrid_clock.cc:648] HybridClock initialized: now 1786466427371450 us; error 30 us; skew 500 ppm
Aug 11 16:40:27 dist-test-slave-zj8q krb5kdc[19492](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466427, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:40:27.373912 19885 init.cc:377] Logged in from keytab as kudu/127.24.175.194@KRBTEST.COM (short username kudu)
I20260811 16:40:27.374334 19885 webserver.cc:460] Webserver started at http://127.24.175.194:36695/ using document root <none> and password file <none>
I20260811 16:40:27.374532 19885 fs_manager.cc:359] Metadata directory not provided
I20260811 16:40:27.374572 19885 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:40:27.374665 19885 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:40:27.375659 19885 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-1/data/instance:
uuid: "c2e1d9970c1e451d9d630b54876760eb"
format_stamp: "Formatted at 2026-08-11 16:40:27 on dist-test-slave-zj8q"
server_key: "ac6acf5cfc4771e46083bb0809c7c3aa"
server_key_iv: "b65bf81e89bfdbdc47e672d7663ba48c"
server_key_version: "encryptionkey@0"
I20260811 16:40:27.375968 19885 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-1/wal/instance:
uuid: "c2e1d9970c1e451d9d630b54876760eb"
format_stamp: "Formatted at 2026-08-11 16:40:27 on dist-test-slave-zj8q"
server_key: "ac6acf5cfc4771e46083bb0809c7c3aa"
server_key_iv: "b65bf81e89bfdbdc47e672d7663ba48c"
server_key_version: "encryptionkey@0"
I20260811 16:40:27.377209 19885 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:40:27.377904 19908 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:40:27.378053 19885 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:40:27.378139 19885 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-1/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-1/wal
uuid: "c2e1d9970c1e451d9d630b54876760eb"
format_stamp: "Formatted at 2026-08-11 16:40:27 on dist-test-slave-zj8q"
server_key: "ac6acf5cfc4771e46083bb0809c7c3aa"
server_key_iv: "b65bf81e89bfdbdc47e672d7663ba48c"
server_key_version: "encryptionkey@0"
I20260811 16:40:27.378233 19885 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:40:27.416177 19885 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:40:27.418382 19885 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:40:27.418521 19885 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:40:27.418748 19885 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:40:27.419059 19885 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:40:27.419091 19885 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:40:27.419121 19885 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:40:27.419144 19885 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:40:27.424638 19885 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.194:43295
I20260811 16:40:27.424732 20098 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.194:43295 every 8 connection(s)
I20260811 16:40:27.424997 19885 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
Aug 11 16:40:27 dist-test-slave-zj8q krb5kdc[19492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466427, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.194@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:40:27.433449 19629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:27.425712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:37663 (local address 127.24.175.254:36391)
0811 16:40:27.425780 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:27.425783 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:27.425963 (+ 180us) server_negotiation.cc:407] Connection header received
0811 16:40:27.426491 (+ 528us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:27.426492 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:27.426503 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:27.426554 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:40:27.427449 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:27.427978 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:27.428945 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:27.429169 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:27.429218 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:27.431264 (+ 2046us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:40:27.431265 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:40:27.431266 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:40:27.431273 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:40:27.432334 (+ 1061us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:27.432673 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:27.432674 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:27.432674 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:27.432720 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:27.432896 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:27.432897 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:27.432897 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:27.432991 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:40:27.433038 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 16:40:27.433322 (+ 284us) server_negotiation.cc:299] Negotiation successful
0811 16:40:27.433382 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 16:40:27.433681 20101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:27.425680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:36391 (local address 127.24.175.194:37663)
0811 16:40:27.425847 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:27.425883 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 16:40:27.426406 (+ 523us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:40:27.426611 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:40:27.426614 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:40:27.427171 (+ 557us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:40:27.427378 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:27.427383 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:27.428060 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:27.428061 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:27.428871 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:27.428873 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:27.429254 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:27.429256 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:27.429367 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:27.429821 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:40:27.429830 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:40:27.431179 (+ 1349us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:40:27.432398 (+ 1219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:40:27.432404 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:40:27.432406 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:40:27.432610 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:40:27.432763 (+ 153us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:40:27.432764 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:40:27.432764 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:40:27.432855 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:40:27.433070 (+ 215us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:40:27.433077 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:40:27.433203 (+ 126us) client_negotiation.cc:769] Sending connection context
0811 16:40:27.433299 (+ 96us) client_negotiation.cc:240] Negotiation successful
0811 16:40:27.433425 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":88,"threads_started":1}
I20260811 16:40:27.434191 20099 heartbeater.cc:347] Connected to a master server at 127.24.175.254:36391
I20260811 16:40:27.434290 20099 heartbeater.cc:464] Registering TS with master...
I20260811 16:40:27.434465 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 19885
I20260811 16:40:27.434490 20099 heartbeater.cc:511] Master 127.24.175.254:36391 requested a full tablet report, sending...
I20260811 16:40:27.434582 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-1/wal/instance
I20260811 16:40:27.434785 25279 external_mini_cluster.cc:1428] Setting key 8640e576d66d5bce4aa9912223ede980
I20260811 16:40:27.434927 19568 ts_manager.cc:194] Registered new tserver with Master: c2e1d9970c1e451d9d630b54876760eb (127.24.175.194:43295)
I20260811 16:40:27.435420 19568 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.175.194@KRBTEST.COM'} at 127.24.175.194:37663
WARNING: no policy specified for kudu/127.24.175.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab.
Entry for principal kudu/127.24.175.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab.
I20260811 16:40:27.459084 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.195:0
--local_ip_for_outbound_sockets=127.24.175.195
--webserver_interface=127.24.175.195
--webserver_port=0
--tserver_master_addrs=127.24.175.254:36391
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab
--principal=kudu/127.24.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:44797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:40:27.542227 20107 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:40:27.542428 20107 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:40:27.542450 20107 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:40:27.543583 20107 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:40:27.543630 20107 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:40:27.543665 20107 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.195
I20260811 16:40:27.545104 20107 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:44797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab
--principal=kudu/127.24.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.175.195
--webserver_port=0
--tserver_master_addrs=127.24.175.254:36391
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20107
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.195
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:40:27.545300 20107 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:40:27.545478 20107 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:40:27.550328 20113 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:40:27.550333 20114 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:40:27.550333 20117 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:40:27.550367 20107 server_base.cc:1034] running on GCE node
I20260811 16:40:27.550724 20107 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:40:27.550944 20107 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:40:27.552101 20107 hybrid_clock.cc:648] HybridClock initialized: now 1786466427552085 us; error 27 us; skew 500 ppm
Aug 11 16:40:27 dist-test-slave-zj8q krb5kdc[19492](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466427, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:40:27.554618 20107 init.cc:377] Logged in from keytab as kudu/127.24.175.195@KRBTEST.COM (short username kudu)
I20260811 16:40:27.555058 20107 webserver.cc:460] Webserver started at http://127.24.175.195:43205/ using document root <none> and password file <none>
I20260811 16:40:27.555282 20107 fs_manager.cc:359] Metadata directory not provided
I20260811 16:40:27.555332 20107 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:40:27.555459 20107 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:40:27.556468 20107 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-2/data/instance:
uuid: "84819ebc34634d3eba41af0144edfc5e"
format_stamp: "Formatted at 2026-08-11 16:40:27 on dist-test-slave-zj8q"
server_key: "abbf5b25a49ae4779b050efe00989570"
server_key_iv: "229651cbf43fb9ab94ec8f456afe847d"
server_key_version: "encryptionkey@0"
I20260811 16:40:27.556804 20107 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-2/wal/instance:
uuid: "84819ebc34634d3eba41af0144edfc5e"
format_stamp: "Formatted at 2026-08-11 16:40:27 on dist-test-slave-zj8q"
server_key: "abbf5b25a49ae4779b050efe00989570"
server_key_iv: "229651cbf43fb9ab94ec8f456afe847d"
server_key_version: "encryptionkey@0"
I20260811 16:40:27.558043 20107 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 16:40:27.558759 20133 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:40:27.558908 20107 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 16:40:27.558993 20107 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-2/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-2/wal
uuid: "84819ebc34634d3eba41af0144edfc5e"
format_stamp: "Formatted at 2026-08-11 16:40:27 on dist-test-slave-zj8q"
server_key: "abbf5b25a49ae4779b050efe00989570"
server_key_iv: "229651cbf43fb9ab94ec8f456afe847d"
server_key_version: "encryptionkey@0"
I20260811 16:40:27.559062 20107 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:40:27.576891 20107 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:40:27.578738 20107 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:40:27.578887 20107 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:40:27.579106 20107 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:40:27.579425 20107 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:40:27.579470 20107 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:40:27.579501 20107 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:40:27.579524 20107 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:40:27.585337 20107 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.195:35689
I20260811 16:40:27.585394 20324 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.195:35689 every 8 connection(s)
I20260811 16:40:27.585729 20107 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
Aug 11 16:40:27 dist-test-slave-zj8q krb5kdc[19492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466427, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.195@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:40:27.594018 19629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:27.586402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.195:60257 (local address 127.24.175.254:36391)
0811 16:40:27.586446 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:27.586448 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:27.586632 (+ 184us) server_negotiation.cc:407] Connection header received
0811 16:40:27.587118 (+ 486us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:27.587119 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:27.587130 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:27.587179 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:40:27.588069 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:27.588583 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:27.589526 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:27.589706 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:27.589751 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:27.591784 (+ 2033us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:40:27.591785 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:40:27.591786 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:40:27.591793 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:40:27.593032 (+ 1239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:27.593339 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:27.593339 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:27.593340 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:27.593385 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:27.593553 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:27.593554 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:27.593554 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:27.593652 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:40:27.593695 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0811 16:40:27.593897 (+ 202us) server_negotiation.cc:299] Negotiation successful
0811 16:40:27.593953 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 16:40:27.594238 20328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:27.586381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:36391 (local address 127.24.175.195:60257)
0811 16:40:27.586522 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:27.586559 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 16:40:27.587039 (+ 480us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:40:27.587234 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:40:27.587237 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:40:27.587805 (+ 568us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:40:27.588001 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:27.588006 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:27.588647 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:27.588648 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:27.589465 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:27.589468 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:27.589759 (+ 291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:27.589760 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:27.589856 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:27.590335 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:40:27.590343 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:40:27.591698 (+ 1355us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:40:27.593090 (+ 1392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:40:27.593093 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:40:27.593095 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:40:27.593289 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:40:27.593428 (+ 139us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:40:27.593429 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:40:27.593429 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:40:27.593515 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:40:27.593692 (+ 177us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:40:27.593695 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:40:27.593805 (+ 110us) client_negotiation.cc:769] Sending connection context
0811 16:40:27.593880 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 16:40:27.593995 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":71,"threads_started":1}
I20260811 16:40:27.594376 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 20107
I20260811 16:40:27.594477 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-2/wal/instance
I20260811 16:40:27.594655 25279 external_mini_cluster.cc:1428] Setting key 8195710f8eb0ce5db12f24d42ab2bf5a
I20260811 16:40:27.594702 20325 heartbeater.cc:347] Connected to a master server at 127.24.175.254:36391
I20260811 16:40:27.594848 20325 heartbeater.cc:464] Registering TS with master...
I20260811 16:40:27.595073 20325 heartbeater.cc:511] Master 127.24.175.254:36391 requested a full tablet report, sending...
I20260811 16:40:27.595445 19567 ts_manager.cc:194] Registered new tserver with Master: 84819ebc34634d3eba41af0144edfc5e (127.24.175.195:35689)
I20260811 16:40:27.595829 19567 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.175.195@KRBTEST.COM'} at 127.24.175.195:60257
I20260811 16:40:27.606235 25279 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 16:40:27.612805 19629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:27.607459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43844 (local address 127.24.175.254:36391)
0811 16:40:27.607510 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:27.607512 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:27.607614 (+ 102us) server_negotiation.cc:407] Connection header received
0811 16:40:27.607694 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:27.607695 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:27.607706 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:27.607753 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:40:27.608274 (+ 521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:27.608748 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:27.609438 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:27.609624 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:27.609678 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:27.610772 (+ 1094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:40:27.610773 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:40:27.610773 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:40:27.610781 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:40:27.611762 (+ 981us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:27.612057 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:27.612058 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:27.612058 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:27.612110 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:27.612281 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:27.612282 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:27.612282 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:27.612429 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:40:27.612518 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 16:40:27.612637 (+ 119us) server_negotiation.cc:299] Negotiation successful
0811 16:40:27.612719 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 16:40:27.614271 19567 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43844:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:40:27.615863 19567 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:40:27.622166 20346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:27.618226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.194:43295 (local address 127.0.0.1:60844)
0811 16:40:27.618404 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:27.618441 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 16:40:27.618504 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:40:27.618821 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:40:27.618824 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:40:27.618826 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:40:27.618893 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:27.618895 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:27.620215 (+ 1320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:27.620216 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:27.621219 (+ 1003us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:27.621221 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:27.621939 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:27.621940 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:27.621998 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:27.622009 (+ 11us) client_negotiation.cc:769] Sending connection context
0811 16:40:27.622061 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 16:40:27.622097 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"spinlock_wait_cycles":768,"thread_start_us":96,"threads_started":1}
I20260811 16:40:27.622221 20354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:27.618516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60844 (local address 127.24.175.194:43295)
0811 16:40:27.618678 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:27.618681 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:27.618689 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:40:27.618720 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:27.618722 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:27.618734 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:27.618801 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:40:27.618971 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:27.620099 (+ 1128us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:27.621297 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:27.621864 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:27.621939 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:27.621991 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 16:40:27.622074 (+ 83us) server_negotiation.cc:299] Negotiation successful
0811 16:40:27.622114 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":83,"threads_started":1}
I20260811 16:40:27.622640 20348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:27.618228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.195:35689 (local address 127.0.0.1:55988)
0811 16:40:27.618787 (+ 559us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:27.618797 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:40:27.618859 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:40:27.619046 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:40:27.619047 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:40:27.619049 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:40:27.619103 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:27.619105 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:27.620295 (+ 1190us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:27.620296 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:27.621540 (+ 1244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:27.621542 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:27.622421 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:27.622422 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:27.622485 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:27.622488 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:40:27.622538 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 16:40:27.622577 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":539,"mutex_wait_us":76,"thread_start_us":71,"threads_started":1}
I20260811 16:40:27.622670 20353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:27.618412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55988 (local address 127.24.175.195:35689)
0811 16:40:27.618593 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:27.618598 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:27.618916 (+ 318us) server_negotiation.cc:407] Connection header received
0811 16:40:27.618961 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:27.618963 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:27.618978 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:27.619051 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:40:27.619173 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:27.620220 (+ 1047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:27.621625 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:27.622348 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:27.622419 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:27.622470 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 16:40:27.622558 (+ 88us) server_negotiation.cc:299] Negotiation successful
0811 16:40:27.622598 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":97,"threads_started":1}
I20260811 16:40:27.622924 19994 tablet_service.cc:1467] Processing CreateTablet for tablet 4c01b0a232644468b5f2096dd30c8aab (DEFAULT_TABLE table=test-table [id=4f89514b16cd42688163584f07f7b3f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:40:27.623301 19994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c01b0a232644468b5f2096dd30c8aab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:40:27.623456 20203 tablet_service.cc:1467] Processing CreateTablet for tablet 4c01b0a232644468b5f2096dd30c8aab (DEFAULT_TABLE table=test-table [id=4f89514b16cd42688163584f07f7b3f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:40:27.623773 20352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:27.618244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.193:34953 (local address 127.0.0.1:56156)
0811 16:40:27.619143 (+ 899us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:27.619152 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:40:27.619201 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:40:27.619366 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:40:27.619368 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:40:27.619369 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:40:27.619417 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:27.619418 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:27.620257 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:27.620258 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:27.621540 (+ 1282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:27.621542 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:27.623539 (+ 1997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:27.623540 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:27.623607 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:27.623612 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 16:40:27.623671 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 16:40:27.623711 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":881,"mutex_wait_us":86,"thread_start_us":87,"threads_started":1}
I20260811 16:40:27.623785 20203 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c01b0a232644468b5f2096dd30c8aab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:40:27.623824 20358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:27.618622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56156 (local address 127.24.175.193:34953)
0811 16:40:27.618793 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:27.618905 (+ 112us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:27.619202 (+ 297us) server_negotiation.cc:407] Connection header received
0811 16:40:27.619277 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:27.619279 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:27.619294 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:27.619361 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:40:27.619470 (+ 109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:27.620162 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:27.622511 (+ 2349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:27.623453 (+ 942us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:27.623530 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:27.623580 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 16:40:27.623696 (+ 116us) server_negotiation.cc:299] Negotiation successful
0811 16:40:27.623741 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":75,"threads_started":1}
I20260811 16:40:27.624473 19772 tablet_service.cc:1467] Processing CreateTablet for tablet 4c01b0a232644468b5f2096dd30c8aab (DEFAULT_TABLE table=test-table [id=4f89514b16cd42688163584f07f7b3f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:40:27.624804 19772 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c01b0a232644468b5f2096dd30c8aab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:40:27.626047 20361 tablet_bootstrap.cc:492] T 4c01b0a232644468b5f2096dd30c8aab P c2e1d9970c1e451d9d630b54876760eb: Bootstrap starting.
I20260811 16:40:27.626703 20361 tablet_bootstrap.cc:654] T 4c01b0a232644468b5f2096dd30c8aab P c2e1d9970c1e451d9d630b54876760eb: Neither blocks nor log segments found. Creating new log.
I20260811 16:40:27.627027 20362 tablet_bootstrap.cc:492] T 4c01b0a232644468b5f2096dd30c8aab P 84819ebc34634d3eba41af0144edfc5e: Bootstrap starting.
I20260811 16:40:27.627349 20361 log.cc:824] T 4c01b0a232644468b5f2096dd30c8aab P c2e1d9970c1e451d9d630b54876760eb: Log is configured to *not* fsync() on all Append() calls
I20260811 16:40:27.627722 20362 tablet_bootstrap.cc:654] T 4c01b0a232644468b5f2096dd30c8aab P 84819ebc34634d3eba41af0144edfc5e: Neither blocks nor log segments found. Creating new log.
I20260811 16:40:27.628165 20361 tablet_bootstrap.cc:492] T 4c01b0a232644468b5f2096dd30c8aab P c2e1d9970c1e451d9d630b54876760eb: No bootstrap required, opened a new log
I20260811 16:40:27.628248 20361 ts_tablet_manager.cc:1397] T 4c01b0a232644468b5f2096dd30c8aab P c2e1d9970c1e451d9d630b54876760eb: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:40:27.628252 20362 log.cc:824] T 4c01b0a232644468b5f2096dd30c8aab P 84819ebc34634d3eba41af0144edfc5e: Log is configured to *not* fsync() on all Append() calls
I20260811 16:40:27.628418 20367 tablet_bootstrap.cc:492] T 4c01b0a232644468b5f2096dd30c8aab P 3df5160026ee4c649e68690a9a69c32e: Bootstrap starting.
I20260811 16:40:27.628976 20367 tablet_bootstrap.cc:654] T 4c01b0a232644468b5f2096dd30c8aab P 3df5160026ee4c649e68690a9a69c32e: Neither blocks nor log segments found. Creating new log.
I20260811 16:40:27.629050 20362 tablet_bootstrap.cc:492] T 4c01b0a232644468b5f2096dd30c8aab P 84819ebc34634d3eba41af0144edfc5e: No bootstrap required, opened a new log
I20260811 16:40:27.629120 20362 ts_tablet_manager.cc:1397] T 4c01b0a232644468b5f2096dd30c8aab P 84819ebc34634d3eba41af0144edfc5e: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:40:27.629462 20367 log.cc:824] T 4c01b0a232644468b5f2096dd30c8aab P 3df5160026ee4c649e68690a9a69c32e: Log is configured to *not* fsync() on all Append() calls
I20260811 16:40:27.630071 20367 tablet_bootstrap.cc:492] T 4c01b0a232644468b5f2096dd30c8aab P 3df5160026ee4c649e68690a9a69c32e: No bootstrap required, opened a new log
I20260811 16:40:27.630129 20367 ts_tablet_manager.cc:1397] T 4c01b0a232644468b5f2096dd30c8aab P 3df5160026ee4c649e68690a9a69c32e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 16:40:27.630384 20361 raft_consensus.cc:348] T 4c01b0a232644468b5f2096dd30c8aab P c2e1d9970c1e451d9d630b54876760eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84819ebc34634d3eba41af0144edfc5e" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 35689 } } peers { permanent_uuid: "c2e1d9970c1e451d9d630b54876760eb" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 43295 } } peers { permanent_uuid: "3df5160026ee4c649e68690a9a69c32e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 34953 } }
I20260811 16:40:27.630563 20361 raft_consensus.cc:374] T 4c01b0a232644468b5f2096dd30c8aab P c2e1d9970c1e451d9d630b54876760eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:40:27.630596 20361 raft_consensus.cc:729] T 4c01b0a232644468b5f2096dd30c8aab P c2e1d9970c1e451d9d630b54876760eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2e1d9970c1e451d9d630b54876760eb, State: Initialized, Role: FOLLOWER
I20260811 16:40:27.630707 20361 consensus_queue.cc:260] T 4c01b0a232644468b5f2096dd30c8aab P c2e1d9970c1e451d9d630b54876760eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84819ebc34634d3eba41af0144edfc5e" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 35689 } } peers { permanent_uuid: "c2e1d9970c1e451d9d630b54876760eb" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 43295 } } peers { permanent_uuid: "3df5160026ee4c649e68690a9a69c32e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 34953 } }
I20260811 16:40:27.630987 20361 ts_tablet_manager.cc:1428] T 4c01b0a232644468b5f2096dd30c8aab P c2e1d9970c1e451d9d630b54876760eb: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260811 16:40:27.631117 20099 heartbeater.cc:503] Master 127.24.175.254:36391 was elected leader, sending a full tablet report...
I20260811 16:40:27.631042 20362 raft_consensus.cc:348] T 4c01b0a232644468b5f2096dd30c8aab P 84819ebc34634d3eba41af0144edfc5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84819ebc34634d3eba41af0144edfc5e" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 35689 } } peers { permanent_uuid: "c2e1d9970c1e451d9d630b54876760eb" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 43295 } } peers { permanent_uuid: "3df5160026ee4c649e68690a9a69c32e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 34953 } }
I20260811 16:40:27.631192 20362 raft_consensus.cc:374] T 4c01b0a232644468b5f2096dd30c8aab P 84819ebc34634d3eba41af0144edfc5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:40:27.631242 20362 raft_consensus.cc:729] T 4c01b0a232644468b5f2096dd30c8aab P 84819ebc34634d3eba41af0144edfc5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84819ebc34634d3eba41af0144edfc5e, State: Initialized, Role: FOLLOWER
I20260811 16:40:27.631351 20362 consensus_queue.cc:260] T 4c01b0a232644468b5f2096dd30c8aab P 84819ebc34634d3eba41af0144edfc5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84819ebc34634d3eba41af0144edfc5e" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 35689 } } peers { permanent_uuid: "c2e1d9970c1e451d9d630b54876760eb" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 43295 } } peers { permanent_uuid: "3df5160026ee4c649e68690a9a69c32e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 34953 } }
I20260811 16:40:27.631613 20362 ts_tablet_manager.cc:1428] T 4c01b0a232644468b5f2096dd30c8aab P 84819ebc34634d3eba41af0144edfc5e: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 16:40:27.631738 20325 heartbeater.cc:503] Master 127.24.175.254:36391 was elected leader, sending a full tablet report...
I20260811 16:40:27.632437 20367 raft_consensus.cc:348] T 4c01b0a232644468b5f2096dd30c8aab P 3df5160026ee4c649e68690a9a69c32e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84819ebc34634d3eba41af0144edfc5e" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 35689 } } peers { permanent_uuid: "c2e1d9970c1e451d9d630b54876760eb" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 43295 } } peers { permanent_uuid: "3df5160026ee4c649e68690a9a69c32e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 34953 } }
I20260811 16:40:27.632571 20367 raft_consensus.cc:374] T 4c01b0a232644468b5f2096dd30c8aab P 3df5160026ee4c649e68690a9a69c32e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:40:27.632592 20367 raft_consensus.cc:729] T 4c01b0a232644468b5f2096dd30c8aab P 3df5160026ee4c649e68690a9a69c32e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3df5160026ee4c649e68690a9a69c32e, State: Initialized, Role: FOLLOWER
I20260811 16:40:27.632668 20367 consensus_queue.cc:260] T 4c01b0a232644468b5f2096dd30c8aab P 3df5160026ee4c649e68690a9a69c32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84819ebc34634d3eba41af0144edfc5e" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 35689 } } peers { permanent_uuid: "c2e1d9970c1e451d9d630b54876760eb" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 43295 } } peers { permanent_uuid: "3df5160026ee4c649e68690a9a69c32e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 34953 } }
I20260811 16:40:27.632860 20367 ts_tablet_manager.cc:1428] T 4c01b0a232644468b5f2096dd30c8aab P 3df5160026ee4c649e68690a9a69c32e: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260811 16:40:27.632925 19879 heartbeater.cc:503] Master 127.24.175.254:36391 was elected leader, sending a full tablet report...
W20260811 16:40:27.675611 20100 tablet.cc:2369] T 4c01b0a232644468b5f2096dd30c8aab P c2e1d9970c1e451d9d630b54876760eb: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 16:40:27.749667 19880 tablet.cc:2369] T 4c01b0a232644468b5f2096dd30c8aab P 3df5160026ee4c649e68690a9a69c32e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 16:40:27.836310 20327 tablet.cc:2369] T 4c01b0a232644468b5f2096dd30c8aab P 84819ebc34634d3eba41af0144edfc5e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:40:27.880367 20372 raft_consensus.cc:482] T 4c01b0a232644468b5f2096dd30c8aab P 3df5160026ee4c649e68690a9a69c32e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:40:27.880493 20372 raft_consensus.cc:504] T 4c01b0a232644468b5f2096dd30c8aab P 3df5160026ee4c649e68690a9a69c32e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84819ebc34634d3eba41af0144edfc5e" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 35689 } } peers { permanent_uuid: "c2e1d9970c1e451d9d630b54876760eb" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 43295 } } peers { permanent_uuid: "3df5160026ee4c649e68690a9a69c32e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 34953 } }
I20260811 16:40:27.880872 20372 leader_election.cc:288] T 4c01b0a232644468b5f2096dd30c8aab P 3df5160026ee4c649e68690a9a69c32e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84819ebc34634d3eba41af0144edfc5e (127.24.175.195:35689), c2e1d9970c1e451d9d630b54876760eb (127.24.175.194:43295)
I20260811 16:40:27.883714 20354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:27.881138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:57343 (local address 127.24.175.194:43295)
0811 16:40:27.881193 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:27.881195 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:27.881274 (+ 79us) server_negotiation.cc:407] Connection header received
0811 16:40:27.881379 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:27.881379 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:27.881390 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:27.881445 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:40:27.881619 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:27.882135 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:27.883041 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:27.883409 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:27.883471 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:27.883480 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 16:40:27.883615 (+ 135us) server_negotiation.cc:299] Negotiation successful
0811 16:40:27.883650 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 16:40:27.883718 20353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:27.881160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:53167 (local address 127.24.175.195:35689)
0811 16:40:27.881212 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:27.881214 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:27.881243 (+ 29us) server_negotiation.cc:407] Connection header received
0811 16:40:27.881309 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:27.881310 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:27.881320 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:27.881367 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:40:27.881518 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:27.882048 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:27.883042 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:27.883404 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:27.883464 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:27.883474 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 16:40:27.883606 (+ 132us) server_negotiation.cc:299] Negotiation successful
0811 16:40:27.883641 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 16:40:27.883747 20373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:27.881041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.194:43295 (local address 127.24.175.193:57343)
0811 16:40:27.881195 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:27.881206 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:40:27.881271 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:40:27.881470 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:40:27.881471 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:40:27.881473 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:40:27.881554 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:27.881556 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:27.882222 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:27.882224 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:27.882957 (+ 733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:27.882959 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:27.883487 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:27.883488 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:27.883552 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:27.883556 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:40:27.883604 (+ 48us) client_negotiation.cc:240] Negotiation successful
0811 16:40:27.883643 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":65,"threads_started":1}
I20260811 16:40:27.883752 20375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:27.881032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.195:35689 (local address 127.24.175.193:53167)
0811 16:40:27.881179 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:27.881191 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:40:27.881239 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:40:27.881374 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:40:27.881375 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:40:27.881377 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:40:27.881461 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:27.881464 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:27.882121 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:27.882122 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:27.882959 (+ 837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:27.882961 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:27.883476 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:27.883478 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:27.883546 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:27.883549 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:40:27.883592 (+ 43us) client_negotiation.cc:240] Negotiation successful
0811 16:40:27.883631 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":82,"threads_started":1}
I20260811 16:40:27.884183 20028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c01b0a232644468b5f2096dd30c8aab" candidate_uuid: "3df5160026ee4c649e68690a9a69c32e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2e1d9970c1e451d9d630b54876760eb" is_pre_election: true
I20260811 16:40:27.884222 20247 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c01b0a232644468b5f2096dd30c8aab" candidate_uuid: "3df5160026ee4c649e68690a9a69c32e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84819ebc34634d3eba41af0144edfc5e" is_pre_election: true
I20260811 16:40:27.884330 20028 raft_consensus.cc:2454] T 4c01b0a232644468b5f2096dd30c8aab P c2e1d9970c1e451d9d630b54876760eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3df5160026ee4c649e68690a9a69c32e in term 0.
I20260811 16:40:27.884352 20247 raft_consensus.cc:2454] T 4c01b0a232644468b5f2096dd30c8aab P 84819ebc34634d3eba41af0144edfc5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3df5160026ee4c649e68690a9a69c32e in term 0.
I20260811 16:40:27.884562 19690 leader_election.cc:302] T 4c01b0a232644468b5f2096dd30c8aab P 3df5160026ee4c649e68690a9a69c32e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3df5160026ee4c649e68690a9a69c32e, c2e1d9970c1e451d9d630b54876760eb; no voters:
I20260811 16:40:27.884675 20372 raft_consensus.cc:2781] T 4c01b0a232644468b5f2096dd30c8aab P 3df5160026ee4c649e68690a9a69c32e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:40:27.884738 20372 raft_consensus.cc:482] T 4c01b0a232644468b5f2096dd30c8aab P 3df5160026ee4c649e68690a9a69c32e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:40:27.884754 20372 raft_consensus.cc:3037] T 4c01b0a232644468b5f2096dd30c8aab P 3df5160026ee4c649e68690a9a69c32e [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:40:27.885545 20372 raft_consensus.cc:504] T 4c01b0a232644468b5f2096dd30c8aab P 3df5160026ee4c649e68690a9a69c32e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84819ebc34634d3eba41af0144edfc5e" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 35689 } } peers { permanent_uuid: "c2e1d9970c1e451d9d630b54876760eb" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 43295 } } peers { permanent_uuid: "3df5160026ee4c649e68690a9a69c32e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 34953 } }
I20260811 16:40:27.885664 20372 leader_election.cc:288] T 4c01b0a232644468b5f2096dd30c8aab P 3df5160026ee4c649e68690a9a69c32e [CANDIDATE]: Term 1 election: Requested vote from peers 84819ebc34634d3eba41af0144edfc5e (127.24.175.195:35689), c2e1d9970c1e451d9d630b54876760eb (127.24.175.194:43295)
I20260811 16:40:27.885805 20028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c01b0a232644468b5f2096dd30c8aab" candidate_uuid: "3df5160026ee4c649e68690a9a69c32e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2e1d9970c1e451d9d630b54876760eb"
I20260811 16:40:27.885810 20247 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c01b0a232644468b5f2096dd30c8aab" candidate_uuid: "3df5160026ee4c649e68690a9a69c32e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84819ebc34634d3eba41af0144edfc5e"
I20260811 16:40:27.885871 20028 raft_consensus.cc:3037] T 4c01b0a232644468b5f2096dd30c8aab P c2e1d9970c1e451d9d630b54876760eb [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:40:27.885877 20247 raft_consensus.cc:3037] T 4c01b0a232644468b5f2096dd30c8aab P 84819ebc34634d3eba41af0144edfc5e [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:40:27.886601 20028 raft_consensus.cc:2454] T 4c01b0a232644468b5f2096dd30c8aab P c2e1d9970c1e451d9d630b54876760eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3df5160026ee4c649e68690a9a69c32e in term 1.
I20260811 16:40:27.886662 20247 raft_consensus.cc:2454] T 4c01b0a232644468b5f2096dd30c8aab P 84819ebc34634d3eba41af0144edfc5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3df5160026ee4c649e68690a9a69c32e in term 1.
I20260811 16:40:27.886785 19690 leader_election.cc:302] T 4c01b0a232644468b5f2096dd30c8aab P 3df5160026ee4c649e68690a9a69c32e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3df5160026ee4c649e68690a9a69c32e, c2e1d9970c1e451d9d630b54876760eb; no voters:
I20260811 16:40:27.886909 20372 raft_consensus.cc:2781] T 4c01b0a232644468b5f2096dd30c8aab P 3df5160026ee4c649e68690a9a69c32e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:40:27.887064 20372 raft_consensus.cc:686] T 4c01b0a232644468b5f2096dd30c8aab P 3df5160026ee4c649e68690a9a69c32e [term 1 LEADER]: Becoming Leader. State: Replica: 3df5160026ee4c649e68690a9a69c32e, State: Running, Role: LEADER
I20260811 16:40:27.887164 20372 consensus_queue.cc:237] T 4c01b0a232644468b5f2096dd30c8aab P 3df5160026ee4c649e68690a9a69c32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84819ebc34634d3eba41af0144edfc5e" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 35689 } } peers { permanent_uuid: "c2e1d9970c1e451d9d630b54876760eb" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 43295 } } peers { permanent_uuid: "3df5160026ee4c649e68690a9a69c32e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 34953 } }
I20260811 16:40:27.888010 19566 catalog_manager.cc:5495] T 4c01b0a232644468b5f2096dd30c8aab P 3df5160026ee4c649e68690a9a69c32e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3df5160026ee4c649e68690a9a69c32e (127.24.175.193). New cstate: current_term: 1 leader_uuid: "3df5160026ee4c649e68690a9a69c32e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84819ebc34634d3eba41af0144edfc5e" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 35689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2e1d9970c1e451d9d630b54876760eb" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 43295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3df5160026ee4c649e68690a9a69c32e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 34953 } health_report { overall_health: HEALTHY } } }
I20260811 16:40:27.903090 20358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:27.900916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56162 (local address 127.24.175.193:34953)
0811 16:40:27.900985 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:27.900987 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:27.900994 (+ 7us) server_negotiation.cc:407] Connection header received
0811 16:40:27.901024 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:27.901024 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:27.901043 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:27.901099 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:40:27.901218 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:27.901659 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:27.902424 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:27.902617 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:27.902667 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:27.902817 (+ 150us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:40:27.902914 (+ 97us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:40:27.902985 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 16:40:27.903004 (+ 19us) server_negotiation.cc:299] Negotiation successful
0811 16:40:27.903024 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 16:40:27.904667 20247 raft_consensus.cc:1261] T 4c01b0a232644468b5f2096dd30c8aab P 84819ebc34634d3eba41af0144edfc5e [term 1 FOLLOWER]: Refusing update from remote peer 3df5160026ee4c649e68690a9a69c32e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:40:27.904667 20028 raft_consensus.cc:1261] T 4c01b0a232644468b5f2096dd30c8aab P c2e1d9970c1e451d9d630b54876760eb [term 1 FOLLOWER]: Refusing update from remote peer 3df5160026ee4c649e68690a9a69c32e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:40:27.904970 20372 consensus_queue.cc:1035] T 4c01b0a232644468b5f2096dd30c8aab P 3df5160026ee4c649e68690a9a69c32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "84819ebc34634d3eba41af0144edfc5e" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 35689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:40:27.905110 20376 consensus_queue.cc:1035] T 4c01b0a232644468b5f2096dd30c8aab P 3df5160026ee4c649e68690a9a69c32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2e1d9970c1e451d9d630b54876760eb" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 43295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:40:27.907279 20381 mvcc.cc:205] Tried to move back new op lower bound from 7317366488695185408 to 7317366488626376704. Current Snapshot: MvccSnapshot[applied={T|T < 7317366488695185408}]
I20260811 16:40:27.907411 20385 mvcc.cc:205] Tried to move back new op lower bound from 7317366488695185408 to 7317366488626376704. Current Snapshot: MvccSnapshot[applied={T|T < 7317366488695185408}]
I20260811 16:40:27.909520 19568 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43844:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:40:27.909600 19568 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43844:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:40:27.910274 19568 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4: Sending DeleteTablet for 3 replicas of tablet 4c01b0a232644468b5f2096dd30c8aab
I20260811 16:40:27.910609 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 19667
I20260811 16:40:27.910643 19994 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c01b0a232644468b5f2096dd30c8aab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:40:27 UTC) from {username='kudu', principal='kudu/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:60844
I20260811 16:40:27.910633 19772 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c01b0a232644468b5f2096dd30c8aab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:40:27 UTC) from {username='kudu', principal='kudu/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:56156
I20260811 16:40:27.913408 20396 tablet_replica.cc:330] T 4c01b0a232644468b5f2096dd30c8aab P c2e1d9970c1e451d9d630b54876760eb: stopping tablet replica
I20260811 16:40:27.913496 20396 raft_consensus.cc:2229] T 4c01b0a232644468b5f2096dd30c8aab P c2e1d9970c1e451d9d630b54876760eb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:40:27.913573 20396 raft_consensus.cc:2258] T 4c01b0a232644468b5f2096dd30c8aab P c2e1d9970c1e451d9d630b54876760eb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:40:27.917985 20396 ts_tablet_manager.cc:1905] T 4c01b0a232644468b5f2096dd30c8aab P c2e1d9970c1e451d9d630b54876760eb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:40:27.919843 20396 ts_tablet_manager.cc:1918] T 4c01b0a232644468b5f2096dd30c8aab P c2e1d9970c1e451d9d630b54876760eb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:40:27.919970 20396 log.cc:1196] T 4c01b0a232644468b5f2096dd30c8aab P c2e1d9970c1e451d9d630b54876760eb: Deleting WAL directory at /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-1/wal/wals/4c01b0a232644468b5f2096dd30c8aab
I20260811 16:40:27.920327 20396 ts_tablet_manager.cc:1939] T 4c01b0a232644468b5f2096dd30c8aab P c2e1d9970c1e451d9d630b54876760eb: Deleting consensus metadata
I20260811 16:40:27.920929 19538 catalog_manager.cc:4841] TS c2e1d9970c1e451d9d630b54876760eb (127.24.175.194:43295): tablet 4c01b0a232644468b5f2096dd30c8aab (table test-table [id=4f89514b16cd42688163584f07f7b3f3]) successfully deleted
I20260811 16:40:27.921990 20203 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c01b0a232644468b5f2096dd30c8aab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:40:27 UTC) from {username='kudu', principal='kudu/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:55988
I20260811 16:40:27.922250 20397 tablet_replica.cc:330] T 4c01b0a232644468b5f2096dd30c8aab P 84819ebc34634d3eba41af0144edfc5e: stopping tablet replica
I20260811 16:40:27.922355 20397 raft_consensus.cc:2229] T 4c01b0a232644468b5f2096dd30c8aab P 84819ebc34634d3eba41af0144edfc5e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:40:27.922463 20397 raft_consensus.cc:2258] T 4c01b0a232644468b5f2096dd30c8aab P 84819ebc34634d3eba41af0144edfc5e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:40:27.922834 20397 ts_tablet_manager.cc:1905] T 4c01b0a232644468b5f2096dd30c8aab P 84819ebc34634d3eba41af0144edfc5e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:40:27.924089 20397 ts_tablet_manager.cc:1918] T 4c01b0a232644468b5f2096dd30c8aab P 84819ebc34634d3eba41af0144edfc5e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:40:27.924150 20397 log.cc:1196] T 4c01b0a232644468b5f2096dd30c8aab P 84819ebc34634d3eba41af0144edfc5e: Deleting WAL directory at /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-2/wal/wals/4c01b0a232644468b5f2096dd30c8aab
I20260811 16:40:27.924371 20397 ts_tablet_manager.cc:1939] T 4c01b0a232644468b5f2096dd30c8aab P 84819ebc34634d3eba41af0144edfc5e: Deleting consensus metadata
I20260811 16:40:27.924733 19542 catalog_manager.cc:4841] TS 84819ebc34634d3eba41af0144edfc5e (127.24.175.195:35689): tablet 4c01b0a232644468b5f2096dd30c8aab (table test-table [id=4f89514b16cd42688163584f07f7b3f3]) successfully deleted
W20260811 16:40:27.926681 19541 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.24.175.193:34953 (error 108)
I20260811 16:40:27.926879 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 19885
I20260811 16:40:27.928759 20352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:27.928645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.193:34953 (local address 127.0.0.1:56168)
0811 16:40:27.928692 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:27.928730 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.193:34953: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260811 16:40:27.928879 19541 catalog_manager.cc:4584] TS 3df5160026ee4c649e68690a9a69c32e (127.24.175.193:34953): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4c01b0a232644468b5f2096dd30c8aab: Network error: Client connection negotiation failed: client connection to 127.24.175.193:34953: connect: Connection refused (error 111)
I20260811 16:40:27.935866 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 20107
I20260811 16:40:27.948585 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 19513
I20260811 16:40:47.959802 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:36391
--webserver_interface=127.24.175.254
--webserver_port=43503
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:44797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.175.254:36391
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:40:48.043653 20399 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:40:48.043848 20399 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:40:48.043869 20399 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:40:48.044966 20399 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 16:40:48.045006 20399 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 16:40:48.045018 20399 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 16:40:48.045029 20399 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:40:48.045042 20399 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:40:48.045068 20399 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:40:48.045089 20399 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:40:48.045109 20399 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:40:48.046643 20399 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:44797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.24.175.254:36391
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:36391
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.175.254
--webserver_port=43503
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20399
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:40:48.046878 20399 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:40:48.047088 20399 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:40:48.056197 20409 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:40:48.056216 20411 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:40:48.056208 20413 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:40:48.056233 20399 server_base.cc:1034] running on GCE node
I20260811 16:40:48.056730 20399 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:40:48.057026 20399 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:40:48.058178 20399 hybrid_clock.cc:648] HybridClock initialized: now 1786466448058159 us; error 30 us; skew 500 ppm
Aug 11 16:40:48 dist-test-slave-zj8q krb5kdc[19492](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466448, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:40:48.060541 20399 init.cc:377] Logged in from keytab as kudu/127.24.175.254@KRBTEST.COM (short username kudu)
I20260811 16:40:48.060998 20399 webserver.cc:460] Webserver started at http://127.24.175.254:43503/ using document root <none> and password file <none>
I20260811 16:40:48.061230 20399 fs_manager.cc:359] Metadata directory not provided
I20260811 16:40:48.061297 20399 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:40:48.062693 20399 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:40:48.063266 20421 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:40:48.063412 20399 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:40:48.063500 20399 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/master-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/master-0/wal
uuid: "5a8635a9291b404d8d80e67b5217beb4"
format_stamp: "Formatted at 2026-08-11 16:40:26 on dist-test-slave-zj8q"
server_key: "1f4e5699189ca66f70c9ae46016dae1b"
server_key_iv: "30c3a5626f5105ab2e9d0c90e6ceade4"
server_key_version: "encryptionkey@0"
I20260811 16:40:48.063886 20399 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:40:48.090098 20399 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:40:48.091951 20399 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:40:48.092090 20399 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:40:48.096068 20399 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.254:36391
I20260811 16:40:48.096105 20508 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.254:36391 every 8 connection(s)
I20260811 16:40:48.096480 20399 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
I20260811 16:40:48.097970 20509 sys_catalog.cc:263] Verifying existing consensus state
I20260811 16:40:48.098701 20509 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4: Bootstrap starting.
I20260811 16:40:48.105664 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 20399
I20260811 16:40:48.105912 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.193:34953
--local_ip_for_outbound_sockets=127.24.175.193
--tserver_master_addrs=127.24.175.254:36391
--webserver_port=41611
--webserver_interface=127.24.175.193
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab
--principal=kudu/127.24.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:44797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 16:40:48.107936 20509 log.cc:824] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4: Log is configured to *not* fsync() on all Append() calls
I20260811 16:40:48.110100 20509 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:40:48.110513 20509 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4: Bootstrap complete.
I20260811 16:40:48.112759 20509 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a8635a9291b404d8d80e67b5217beb4" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 36391 } }
I20260811 16:40:48.112985 20509 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a8635a9291b404d8d80e67b5217beb4, State: Initialized, Role: FOLLOWER
I20260811 16:40:48.113145 20509 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a8635a9291b404d8d80e67b5217beb4" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 36391 } }
I20260811 16:40:48.113222 20509 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:40:48.113278 20509 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:40:48.113325 20509 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:40:48.114344 20509 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a8635a9291b404d8d80e67b5217beb4" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 36391 } }
I20260811 16:40:48.114442 20509 leader_election.cc:302] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5a8635a9291b404d8d80e67b5217beb4; no voters:
I20260811 16:40:48.114593 20509 leader_election.cc:288] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 16:40:48.114638 20514 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:40:48.114796 20514 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4 [term 2 LEADER]: Becoming Leader. State: Replica: 5a8635a9291b404d8d80e67b5217beb4, State: Running, Role: LEADER
I20260811 16:40:48.114879 20509 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:40:48.114908 20514 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a8635a9291b404d8d80e67b5217beb4" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 36391 } }
I20260811 16:40:48.115175 20514 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5a8635a9291b404d8d80e67b5217beb4. Latest consensus state: current_term: 2 leader_uuid: "5a8635a9291b404d8d80e67b5217beb4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a8635a9291b404d8d80e67b5217beb4" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 36391 } } }
I20260811 16:40:48.115247 20514 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4 [sys.catalog]: This master's current role is: LEADER
I20260811 16:40:48.115394 20515 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "5a8635a9291b404d8d80e67b5217beb4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a8635a9291b404d8d80e67b5217beb4" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 36391 } } }
I20260811 16:40:48.115455 20515 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4 [sys.catalog]: This master's current role is: LEADER
I20260811 16:40:48.115752 20526 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:40:48.116659 20526 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:40:48.116819 20526 catalog_manager.cc:1259] Loaded cluster ID: 3944e9f67efe48f6bb42d6f97625b090
I20260811 16:40:48.117038 20526 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:40:48.118355 20526 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:40:48.118548 20526 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4: Loaded TSK: 0
I20260811 16:40:48.129401 20526 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4: Generated new TSK 1
I20260811 16:40:48.129498 20526 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 16:40:48.189417 20511 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:40:48.189615 20511 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:40:48.189646 20511 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:40:48.190798 20511 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:40:48.190840 20511 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:40:48.190874 20511 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.193
I20260811 16:40:48.192341 20511 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:44797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab
--principal=kudu/127.24.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.193:34953
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.175.193
--webserver_port=41611
--tserver_master_addrs=127.24.175.254:36391
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20511
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.193
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:40:48.192564 20511 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:40:48.192770 20511 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:40:48.198545 20561 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:40:48.198559 20566 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:40:48.198542 20562 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:40:48.198863 20511 server_base.cc:1034] running on GCE node
I20260811 16:40:48.199047 20511 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:40:48.199275 20511 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:40:48.200414 20511 hybrid_clock.cc:648] HybridClock initialized: now 1786466448200402 us; error 30 us; skew 500 ppm
Aug 11 16:40:48 dist-test-slave-zj8q krb5kdc[19492](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466448, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:40:48.203052 20511 init.cc:377] Logged in from keytab as kudu/127.24.175.193@KRBTEST.COM (short username kudu)
I20260811 16:40:48.203579 20511 webserver.cc:460] Webserver started at http://127.24.175.193:41611/ using document root <none> and password file <none>
I20260811 16:40:48.203820 20511 fs_manager.cc:359] Metadata directory not provided
I20260811 16:40:48.203897 20511 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:40:48.205557 20511 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:40:48.206290 20579 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:40:48.206444 20511 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 16:40:48.206542 20511 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-0/wal
uuid: "3df5160026ee4c649e68690a9a69c32e"
format_stamp: "Formatted at 2026-08-11 16:40:27 on dist-test-slave-zj8q"
server_key: "85e026ce24b12ddb135e9195c635d895"
server_key_iv: "fc193234b0795821d07ec169fd1a5040"
server_key_version: "encryptionkey@0"
I20260811 16:40:48.206947 20511 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:40:48.220377 20511 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:40:48.222707 20511 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:40:48.222856 20511 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:40:48.223111 20511 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:40:48.223603 20591 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 16:40:48.225020 20511 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 16:40:48.225091 20511 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260811 16:40:48.225123 20511 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 16:40:48.225986 20511 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 16:40:48.226032 20511 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260811 16:40:48.226087 20591 tablet_bootstrap.cc:492] T 4c01b0a232644468b5f2096dd30c8aab P 3df5160026ee4c649e68690a9a69c32e: Bootstrap starting.
I20260811 16:40:48.233349 20511 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.193:34953
I20260811 16:40:48.233796 20511 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
I20260811 16:40:48.236768 20591 log.cc:824] T 4c01b0a232644468b5f2096dd30c8aab P 3df5160026ee4c649e68690a9a69c32e: Log is configured to *not* fsync() on all Append() calls
I20260811 16:40:48.237104 20780 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.193:34953 every 8 connection(s)
I20260811 16:40:48.239481 20591 tablet_bootstrap.cc:492] T 4c01b0a232644468b5f2096dd30c8aab P 3df5160026ee4c649e68690a9a69c32e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:40:48.239782 20591 tablet_bootstrap.cc:492] T 4c01b0a232644468b5f2096dd30c8aab P 3df5160026ee4c649e68690a9a69c32e: Bootstrap complete.
I20260811 16:40:48.240940 20591 ts_tablet_manager.cc:1397] T 4c01b0a232644468b5f2096dd30c8aab P 3df5160026ee4c649e68690a9a69c32e: Time spent bootstrapping tablet: real 0.015s user 0.008s sys 0.004s
Aug 11 16:40:48 dist-test-slave-zj8q krb5kdc[19492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466448, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.193@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:40:48.241876 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 20511
I20260811 16:40:48.242141 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.194:43295
--local_ip_for_outbound_sockets=127.24.175.194
--tserver_master_addrs=127.24.175.254:36391
--webserver_port=36695
--webserver_interface=127.24.175.194
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab
--principal=kudu/127.24.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:44797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 16:40:48.242276 20591 raft_consensus.cc:348] T 4c01b0a232644468b5f2096dd30c8aab P 3df5160026ee4c649e68690a9a69c32e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84819ebc34634d3eba41af0144edfc5e" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 35689 } } peers { permanent_uuid: "c2e1d9970c1e451d9d630b54876760eb" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 43295 } } peers { permanent_uuid: "3df5160026ee4c649e68690a9a69c32e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 34953 } }
I20260811 16:40:48.242600 20591 raft_consensus.cc:729] T 4c01b0a232644468b5f2096dd30c8aab P 3df5160026ee4c649e68690a9a69c32e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3df5160026ee4c649e68690a9a69c32e, State: Initialized, Role: FOLLOWER
I20260811 16:40:48.242734 20591 consensus_queue.cc:260] T 4c01b0a232644468b5f2096dd30c8aab P 3df5160026ee4c649e68690a9a69c32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84819ebc34634d3eba41af0144edfc5e" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 35689 } } peers { permanent_uuid: "c2e1d9970c1e451d9d630b54876760eb" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 43295 } } peers { permanent_uuid: "3df5160026ee4c649e68690a9a69c32e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 34953 } }
I20260811 16:40:48.243005 20591 ts_tablet_manager.cc:1428] T 4c01b0a232644468b5f2096dd30c8aab P 3df5160026ee4c649e68690a9a69c32e: Time spent starting tablet: real 0.002s user 0.005s sys 0.000s
I20260811 16:40:48.247298 20783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:48.234579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:36391 (local address 127.24.175.193:40305)
0811 16:40:48.234916 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:48.234972 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 16:40:48.235647 (+ 675us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:40:48.236592 (+ 945us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:40:48.236597 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:40:48.236941 (+ 344us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:40:48.237211 (+ 270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:48.237218 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:48.238475 (+ 1257us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:48.238477 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:48.239312 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:48.239314 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:48.239989 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:48.239990 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:48.240121 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:48.240642 (+ 521us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:40:48.240650 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:40:48.243014 (+ 2364us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:40:48.245396 (+ 2382us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:40:48.245403 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:40:48.245405 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:40:48.245725 (+ 320us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:40:48.246017 (+ 292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:40:48.246018 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:40:48.246019 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:40:48.246204 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:40:48.246644 (+ 440us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:40:48.246652 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:40:48.246811 (+ 159us) client_negotiation.cc:769] Sending connection context
0811 16:40:48.246923 (+ 112us) client_negotiation.cc:240] Negotiation successful
0811 16:40:48.247102 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"thread_start_us":127,"threads_started":1}
I20260811 16:40:48.247355 20785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:48.234690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:40305 (local address 127.24.175.254:36391)
0811 16:40:48.236062 (+ 1372us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:48.236074 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:48.236132 (+ 58us) server_negotiation.cc:407] Connection header received
0811 16:40:48.236287 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:48.236294 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:48.236363 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:48.236522 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:40:48.237355 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:48.238345 (+ 990us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:48.239402 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:48.239886 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:48.240057 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:48.243243 (+ 3186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:40:48.243248 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:40:48.243248 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:40:48.243261 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:40:48.245283 (+ 2022us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:48.245818 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:48.245821 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:48.245821 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:48.245944 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:48.246269 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:48.246270 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:48.246270 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:48.246569 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:40:48.246649 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 16:40:48.246997 (+ 348us) server_negotiation.cc:299] Negotiation successful
0811 16:40:48.247152 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1308,"thread_start_us":93,"threads_started":1}
I20260811 16:40:48.248020 20781 heartbeater.cc:347] Connected to a master server at 127.24.175.254:36391
I20260811 16:40:48.248126 20781 heartbeater.cc:464] Registering TS with master...
I20260811 16:40:48.248322 20781 heartbeater.cc:511] Master 127.24.175.254:36391 requested a full tablet report, sending...
I20260811 16:40:48.249151 20454 ts_manager.cc:194] Registered new tserver with Master: 3df5160026ee4c649e68690a9a69c32e (127.24.175.193:34953)
I20260811 16:40:48.250742 20454 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.175.193@KRBTEST.COM'} at 127.24.175.193:40305
I20260811 16:40:48.251757 20781 heartbeater.cc:503] Master 127.24.175.254:36391 was elected leader, sending a full tablet report...
I20260811 16:40:48.257632 20789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:48.250357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.193:34953 (local address 127.0.0.1:52684)
0811 16:40:48.250525 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:48.250562 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 16:40:48.250636 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:40:48.254456 (+ 3820us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:40:48.254459 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:40:48.254462 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:40:48.254528 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:48.254530 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:48.255751 (+ 1221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:48.255751 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:48.256526 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:48.256528 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:48.257394 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:48.257395 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:48.257460 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:48.257470 (+ 10us) client_negotiation.cc:769] Sending connection context
0811 16:40:48.257527 (+ 57us) client_negotiation.cc:240] Negotiation successful
0811 16:40:48.257576 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":90,"threads_started":1}
I20260811 16:40:48.257652 20792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:48.250421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52684 (local address 127.24.175.193:34953)
0811 16:40:48.254264 (+ 3843us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:48.254269 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:48.254280 (+ 11us) server_negotiation.cc:407] Connection header received
0811 16:40:48.254316 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:48.254318 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:48.254333 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:48.254415 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:40:48.254599 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:48.255670 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:48.256601 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:48.257311 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:48.257382 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:48.257432 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 16:40:48.257548 (+ 116us) server_negotiation.cc:299] Negotiation successful
0811 16:40:48.257584 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3808,"thread_start_us":64,"threads_started":1}
I20260811 16:40:48.258055 20651 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c01b0a232644468b5f2096dd30c8aab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:40:27 UTC) from {username='kudu', principal='kudu/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:52684
I20260811 16:40:48.258658 20793 tablet_replica.cc:330] stopping tablet replica
I20260811 16:40:48.258764 20793 raft_consensus.cc:2229] T 4c01b0a232644468b5f2096dd30c8aab P 3df5160026ee4c649e68690a9a69c32e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:40:48.258834 20793 raft_consensus.cc:2258] T 4c01b0a232644468b5f2096dd30c8aab P 3df5160026ee4c649e68690a9a69c32e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:40:48.259114 20793 ts_tablet_manager.cc:1905] T 4c01b0a232644468b5f2096dd30c8aab P 3df5160026ee4c649e68690a9a69c32e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:40:48.261013 20793 ts_tablet_manager.cc:1918] T 4c01b0a232644468b5f2096dd30c8aab P 3df5160026ee4c649e68690a9a69c32e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:40:48.261083 20793 log.cc:1196] T 4c01b0a232644468b5f2096dd30c8aab P 3df5160026ee4c649e68690a9a69c32e: Deleting WAL directory at /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-0/wal/wals/4c01b0a232644468b5f2096dd30c8aab
I20260811 16:40:48.261307 20793 ts_tablet_manager.cc:1939] T 4c01b0a232644468b5f2096dd30c8aab P 3df5160026ee4c649e68690a9a69c32e: Deleting consensus metadata
I20260811 16:40:48.261804 20431 catalog_manager.cc:4841] TS 3df5160026ee4c649e68690a9a69c32e (127.24.175.193:34953): tablet 4c01b0a232644468b5f2096dd30c8aab (table test-table [id=4f89514b16cd42688163584f07f7b3f3]) successfully deleted
W20260811 16:40:48.329317 20788 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:40:48.329509 20788 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:40:48.329538 20788 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:40:48.330668 20788 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:40:48.330708 20788 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:40:48.330732 20788 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.194
I20260811 16:40:48.332114 20788 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:44797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab
--principal=kudu/127.24.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.194:43295
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.175.194
--webserver_port=36695
--tserver_master_addrs=127.24.175.254:36391
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20788
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.194
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:40:48.332290 20788 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:40:48.332465 20788 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:40:48.337421 20802 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:40:48.337472 20805 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:40:48.337466 20803 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:40:48.337492 20788 server_base.cc:1034] running on GCE node
I20260811 16:40:48.337842 20788 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:40:48.338114 20788 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:40:48.339277 20788 hybrid_clock.cc:648] HybridClock initialized: now 1786466448339274 us; error 35 us; skew 500 ppm
Aug 11 16:40:48 dist-test-slave-zj8q krb5kdc[19492](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466448, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:40:48.341636 20788 init.cc:377] Logged in from keytab as kudu/127.24.175.194@KRBTEST.COM (short username kudu)
I20260811 16:40:48.342034 20788 webserver.cc:460] Webserver started at http://127.24.175.194:36695/ using document root <none> and password file <none>
I20260811 16:40:48.342264 20788 fs_manager.cc:359] Metadata directory not provided
I20260811 16:40:48.342329 20788 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:40:48.343672 20788 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:40:48.344215 20815 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:40:48.344370 20788 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 16:40:48.344457 20788 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-1/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-1/wal
uuid: "c2e1d9970c1e451d9d630b54876760eb"
format_stamp: "Formatted at 2026-08-11 16:40:27 on dist-test-slave-zj8q"
server_key: "ac6acf5cfc4771e46083bb0809c7c3aa"
server_key_iv: "b65bf81e89bfdbdc47e672d7663ba48c"
server_key_version: "encryptionkey@0"
I20260811 16:40:48.344789 20788 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:40:48.356211 20788 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:40:48.358266 20788 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:40:48.358402 20788 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:40:48.358609 20788 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:40:48.358891 20788 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:40:48.358922 20788 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:40:48.358949 20788 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:40:48.358973 20788 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:40:48.364353 20788 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.194:43295
I20260811 16:40:48.364428 21018 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.194:43295 every 8 connection(s)
I20260811 16:40:48.364722 20788 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
I20260811 16:40:48.369630 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 20788
I20260811 16:40:48.369925 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.195:35689
--local_ip_for_outbound_sockets=127.24.175.195
--tserver_master_addrs=127.24.175.254:36391
--webserver_port=43205
--webserver_interface=127.24.175.195
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab
--principal=kudu/127.24.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:44797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 16:40:48 dist-test-slave-zj8q krb5kdc[19492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466448, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.194@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:40:48.373773 20785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:48.365403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:32959 (local address 127.24.175.254:36391)
0811 16:40:48.365464 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:48.365466 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:48.365679 (+ 213us) server_negotiation.cc:407] Connection header received
0811 16:40:48.366143 (+ 464us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:48.366144 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:48.366187 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:48.366248 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:40:48.367150 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:48.367690 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:48.368642 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:48.368838 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:48.368887 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:48.371230 (+ 2343us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:40:48.371231 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:40:48.371232 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:40:48.371239 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:40:48.372473 (+ 1234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:48.372865 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:48.372867 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:48.372867 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:48.372924 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:48.373141 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:48.373142 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:48.373143 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:48.373264 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:40:48.373321 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 16:40:48.373580 (+ 259us) server_negotiation.cc:299] Negotiation successful
0811 16:40:48.373682 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 16:40:48.373922 21023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:48.365382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:36391 (local address 127.24.175.194:32959)
0811 16:40:48.365562 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:48.365603 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 16:40:48.366064 (+ 461us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:40:48.366313 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:40:48.366317 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:40:48.366876 (+ 559us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:40:48.367066 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:48.367071 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:48.367774 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:48.367775 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:48.368571 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:48.368574 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:48.368911 (+ 337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:48.368912 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:48.369015 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:48.369456 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:40:48.369466 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:40:48.371125 (+ 1659us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:40:48.372553 (+ 1428us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:40:48.372561 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:40:48.372563 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:40:48.372794 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:40:48.372979 (+ 185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:40:48.372979 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:40:48.372980 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:40:48.373085 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:40:48.373322 (+ 237us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:40:48.373329 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:40:48.373462 (+ 133us) client_negotiation.cc:769] Sending connection context
0811 16:40:48.373550 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 16:40:48.373702 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":71,"threads_started":1}
I20260811 16:40:48.374439 21020 heartbeater.cc:347] Connected to a master server at 127.24.175.254:36391
I20260811 16:40:48.374555 21020 heartbeater.cc:464] Registering TS with master...
I20260811 16:40:48.374758 21020 heartbeater.cc:511] Master 127.24.175.254:36391 requested a full tablet report, sending...
I20260811 16:40:48.375157 20454 ts_manager.cc:194] Registered new tserver with Master: c2e1d9970c1e451d9d630b54876760eb (127.24.175.194:43295)
I20260811 16:40:48.375540 20454 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.175.194@KRBTEST.COM'} at 127.24.175.194:32959
W20260811 16:40:48.451990 21024 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:40:48.452194 21024 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:40:48.452225 21024 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:40:48.453366 21024 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:40:48.453406 21024 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:40:48.453440 21024 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.195
I20260811 16:40:48.454910 21024 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:44797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab
--principal=kudu/127.24.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.195:35689
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.175.195
--webserver_port=43205
--tserver_master_addrs=127.24.175.254:36391
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21024
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.195
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:40:48.455150 21024 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:40:48.455353 21024 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:40:48.460096 21034 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:40:48.460183 21036 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:40:48.460119 21030 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:40:48.460278 21024 server_base.cc:1034] running on GCE node
I20260811 16:40:48.460527 21024 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:40:48.460737 21024 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:40:48.461870 21024 hybrid_clock.cc:648] HybridClock initialized: now 1786466448461853 us; error 35 us; skew 500 ppm
Aug 11 16:40:48 dist-test-slave-zj8q krb5kdc[19492](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466448, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:40:48.464251 21024 init.cc:377] Logged in from keytab as kudu/127.24.175.195@KRBTEST.COM (short username kudu)
I20260811 16:40:48.464643 21024 webserver.cc:460] Webserver started at http://127.24.175.195:43205/ using document root <none> and password file <none>
I20260811 16:40:48.464848 21024 fs_manager.cc:359] Metadata directory not provided
I20260811 16:40:48.464911 21024 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:40:48.466300 21024 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:40:48.466845 21049 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:40:48.467013 21024 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 16:40:48.467093 21024 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-2/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-2/wal
uuid: "84819ebc34634d3eba41af0144edfc5e"
format_stamp: "Formatted at 2026-08-11 16:40:27 on dist-test-slave-zj8q"
server_key: "abbf5b25a49ae4779b050efe00989570"
server_key_iv: "229651cbf43fb9ab94ec8f456afe847d"
server_key_version: "encryptionkey@0"
I20260811 16:40:48.467407 21024 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:40:48.477902 21024 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:40:48.479513 21024 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:40:48.479616 21024 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:40:48.479772 21024 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:40:48.479998 21024 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:40:48.480026 21024 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:40:48.480044 21024 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:40:48.480060 21024 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:40:48.485564 21024 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.195:35689
I20260811 16:40:48.485603 21251 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.195:35689 every 8 connection(s)
I20260811 16:40:48.485882 21024 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
Aug 11 16:40:48 dist-test-slave-zj8q krb5kdc[19492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466448, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.195@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:40:48.494053 20785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:48.486597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.195:39753 (local address 127.24.175.254:36391)
0811 16:40:48.486643 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:48.486645 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:48.486845 (+ 200us) server_negotiation.cc:407] Connection header received
0811 16:40:48.487297 (+ 452us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:48.487297 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:48.487307 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:48.487354 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:40:48.488191 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:48.488670 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:48.489590 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:48.489784 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:48.489827 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:48.491864 (+ 2037us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:40:48.491866 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:40:48.491867 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:40:48.491875 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:40:48.492975 (+ 1100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:48.493311 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:48.493312 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:48.493312 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:48.493356 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:48.493526 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:48.493526 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:48.493527 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:48.493648 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:40:48.493694 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 16:40:48.493914 (+ 220us) server_negotiation.cc:299] Negotiation successful
0811 16:40:48.493985 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 16:40:48.494199 21257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:48.486571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:36391 (local address 127.24.175.195:39753)
0811 16:40:48.486736 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:48.486770 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 16:40:48.487221 (+ 451us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:40:48.487407 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:40:48.487410 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:40:48.487942 (+ 532us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:40:48.488123 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:48.488127 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:48.488740 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:48.488741 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:48.489529 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:48.489531 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:48.489836 (+ 305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:48.489837 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:48.489931 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:48.490430 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:40:48.490439 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:40:48.491780 (+ 1341us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:40:48.493042 (+ 1262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:40:48.493048 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:40:48.493050 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:40:48.493256 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:40:48.493400 (+ 144us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:40:48.493400 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:40:48.493400 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:40:48.493486 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:40:48.493691 (+ 205us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:40:48.493693 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:40:48.493805 (+ 112us) client_negotiation.cc:769] Sending connection context
0811 16:40:48.493878 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 16:40:48.493996 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":86,"threads_started":1}
I20260811 16:40:48.494659 21254 heartbeater.cc:347] Connected to a master server at 127.24.175.254:36391
I20260811 16:40:48.494760 21254 heartbeater.cc:464] Registering TS with master...
I20260811 16:40:48.494925 21254 heartbeater.cc:511] Master 127.24.175.254:36391 requested a full tablet report, sending...
I20260811 16:40:48.495270 20454 ts_manager.cc:194] Registered new tserver with Master: 84819ebc34634d3eba41af0144edfc5e (127.24.175.195:35689)
I20260811 16:40:48.495555 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 21024
I20260811 16:40:48.495747 20454 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.175.195@KRBTEST.COM'} at 127.24.175.195:39753
I20260811 16:40:48.501088 20785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:48.496046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39042 (local address 127.24.175.254:36391)
0811 16:40:48.496087 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:48.496089 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:48.496119 (+ 30us) server_negotiation.cc:407] Connection header received
0811 16:40:48.496173 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:48.496173 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:48.496183 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:48.496241 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:40:48.496766 (+ 525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:48.497213 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:48.497884 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:48.498058 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:48.498102 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:48.499204 (+ 1102us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:40:48.499206 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:40:48.499206 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:40:48.499212 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:40:48.500356 (+ 1144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:48.500600 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:48.500601 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:48.500601 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:48.500644 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:48.500764 (+ 120us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:48.500764 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:48.500764 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:48.500845 (+ 81us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:40:48.500952 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0811 16:40:48.500977 (+ 25us) server_negotiation.cc:299] Negotiation successful
0811 16:40:48.501028 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 16:40:48.501767 25279 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 16:40:48.504038 20785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:48.502034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39054 (local address 127.24.175.254:36391)
0811 16:40:48.502091 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:48.502093 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:48.502213 (+ 120us) server_negotiation.cc:407] Connection header received
0811 16:40:48.502282 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:48.502283 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:48.502310 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:48.502362 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:40:48.502435 (+ 73us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:48.502876 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:48.503532 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:48.503716 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:48.503762 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:48.503847 (+ 85us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:40:48.503884 (+ 37us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0811 16:40:48.504001 (+ 117us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:39054: token expired
Metrics: {"server-negotiator.queue_time_us":34}
W20260811 16:40:48.504077 20785 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:39054: token expired
W20260811 16:40:48.504230 20335 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.24.175.254:36391)
I20260811 16:40:48.508920 20785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:48.504453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39066 (local address 127.24.175.254:36391)
0811 16:40:48.504482 (+ 29us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:48.504484 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:48.504491 (+ 7us) server_negotiation.cc:407] Connection header received
0811 16:40:48.504528 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:48.504528 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:48.504536 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:48.504589 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:40:48.504983 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:48.505414 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:48.506006 (+ 592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:48.506211 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:48.506259 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:48.507144 (+ 885us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:40:48.507145 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:40:48.507145 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:40:48.507150 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:40:48.508164 (+ 1014us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:48.508431 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:48.508432 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:48.508432 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:48.508472 (+ 40us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:40:48.508576 (+ 104us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:40:48.508577 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:40:48.508577 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:40:48.508677 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:40:48.508743 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 16:40:48.508818 (+ 75us) server_negotiation.cc:299] Negotiation successful
0811 16:40:48.508870 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260811 16:40:48.509960 20454 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39066:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:40:48.511648 20454 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:40:48.513648 20651 tablet_service.cc:1467] Processing CreateTablet for tablet b759c53deb104ee1992e12f00639c1da (DEFAULT_TABLE table=test-table [id=92d48e09203a43edaca2180a19e268f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:40:48.513859 20651 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b759c53deb104ee1992e12f00639c1da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:40:48.515280 20591 tablet_bootstrap.cc:492] T b759c53deb104ee1992e12f00639c1da P 3df5160026ee4c649e68690a9a69c32e: Bootstrap starting.
I20260811 16:40:48.515609 20591 tablet_bootstrap.cc:654] T b759c53deb104ee1992e12f00639c1da P 3df5160026ee4c649e68690a9a69c32e: Neither blocks nor log segments found. Creating new log.
I20260811 16:40:48.516251 20591 tablet_bootstrap.cc:492] T b759c53deb104ee1992e12f00639c1da P 3df5160026ee4c649e68690a9a69c32e: No bootstrap required, opened a new log
I20260811 16:40:48.516304 20591 ts_tablet_manager.cc:1397] T b759c53deb104ee1992e12f00639c1da P 3df5160026ee4c649e68690a9a69c32e: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 16:40:48.516436 20591 raft_consensus.cc:348] T b759c53deb104ee1992e12f00639c1da P 3df5160026ee4c649e68690a9a69c32e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2e1d9970c1e451d9d630b54876760eb" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 43295 } } peers { permanent_uuid: "84819ebc34634d3eba41af0144edfc5e" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 35689 } } peers { permanent_uuid: "3df5160026ee4c649e68690a9a69c32e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 34953 } }
I20260811 16:40:48.516508 20591 raft_consensus.cc:374] T b759c53deb104ee1992e12f00639c1da P 3df5160026ee4c649e68690a9a69c32e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:40:48.516556 20591 raft_consensus.cc:729] T b759c53deb104ee1992e12f00639c1da P 3df5160026ee4c649e68690a9a69c32e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3df5160026ee4c649e68690a9a69c32e, State: Initialized, Role: FOLLOWER
I20260811 16:40:48.516604 20591 consensus_queue.cc:260] T b759c53deb104ee1992e12f00639c1da P 3df5160026ee4c649e68690a9a69c32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2e1d9970c1e451d9d630b54876760eb" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 43295 } } peers { permanent_uuid: "84819ebc34634d3eba41af0144edfc5e" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 35689 } } peers { permanent_uuid: "3df5160026ee4c649e68690a9a69c32e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 34953 } }
I20260811 16:40:48.516705 20591 ts_tablet_manager.cc:1428] T b759c53deb104ee1992e12f00639c1da P 3df5160026ee4c649e68690a9a69c32e: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 16:40:48.517010 20789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:48.513396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.194:43295 (local address 127.0.0.1:53162)
0811 16:40:48.513441 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:48.513450 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:40:48.513483 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:40:48.513882 (+ 399us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:40:48.513883 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:40:48.513885 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:40:48.513922 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:48.513923 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:48.514960 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:48.514960 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:48.515832 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:48.515836 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:48.516733 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:48.516734 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:48.516796 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:48.516848 (+ 52us) client_negotiation.cc:769] Sending connection context
0811 16:40:48.516899 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 16:40:48.516940 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30,"mutex_wait_us":45}
I20260811 16:40:48.517436 21266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:48.513486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53162 (local address 127.24.175.194:43295)
0811 16:40:48.513724 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:48.513729 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:48.513740 (+ 11us) server_negotiation.cc:407] Connection header received
0811 16:40:48.513780 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:48.513782 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:48.513798 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:48.513869 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:40:48.513969 (+ 100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:48.514870 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:48.515903 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:48.516614 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:48.516699 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:48.516761 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 16:40:48.517244 (+ 483us) server_negotiation.cc:299] Negotiation successful
0811 16:40:48.517285 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":203,"thread_start_us":96,"threads_started":1}
I20260811 16:40:48.518144 20894 tablet_service.cc:1467] Processing CreateTablet for tablet b759c53deb104ee1992e12f00639c1da (DEFAULT_TABLE table=test-table [id=92d48e09203a43edaca2180a19e268f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:40:48.518566 20894 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b759c53deb104ee1992e12f00639c1da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:40:48.518762 21264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:48.513424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.195:35689 (local address 127.0.0.1:41826)
0811 16:40:48.515293 (+ 1869us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:48.515303 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:40:48.515354 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:40:48.515532 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:40:48.515532 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:40:48.515534 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:40:48.515579 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:48.515580 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:48.516690 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:48.516691 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:48.517663 (+ 972us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:48.517666 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:48.518543 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:48.518544 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:48.518595 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:48.518598 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:40:48.518647 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 16:40:48.518711 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1855,"thread_start_us":72,"threads_started":1}
I20260811 16:40:48.518793 21267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:48.513606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41826 (local address 127.24.175.195:35689)
0811 16:40:48.513777 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:48.513782 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:48.515405 (+ 1623us) server_negotiation.cc:407] Connection header received
0811 16:40:48.515449 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:48.515451 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:48.515466 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:48.515534 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:40:48.515665 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:48.516560 (+ 895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:48.517770 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:48.518465 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:48.518542 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:48.518594 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 16:40:48.518674 (+ 80us) server_negotiation.cc:299] Negotiation successful
0811 16:40:48.518722 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":82,"threads_started":1}
I20260811 16:40:48.519337 21133 tablet_service.cc:1467] Processing CreateTablet for tablet b759c53deb104ee1992e12f00639c1da (DEFAULT_TABLE table=test-table [id=92d48e09203a43edaca2180a19e268f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:40:48.519662 21133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b759c53deb104ee1992e12f00639c1da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:40:48.521481 21270 tablet_bootstrap.cc:492] T b759c53deb104ee1992e12f00639c1da P c2e1d9970c1e451d9d630b54876760eb: Bootstrap starting.
I20260811 16:40:48.522198 21270 tablet_bootstrap.cc:654] T b759c53deb104ee1992e12f00639c1da P c2e1d9970c1e451d9d630b54876760eb: Neither blocks nor log segments found. Creating new log.
I20260811 16:40:48.522630 21274 tablet_bootstrap.cc:492] T b759c53deb104ee1992e12f00639c1da P 84819ebc34634d3eba41af0144edfc5e: Bootstrap starting.
I20260811 16:40:48.522799 21270 log.cc:824] T b759c53deb104ee1992e12f00639c1da P c2e1d9970c1e451d9d630b54876760eb: Log is configured to *not* fsync() on all Append() calls
I20260811 16:40:48.523172 21274 tablet_bootstrap.cc:654] T b759c53deb104ee1992e12f00639c1da P 84819ebc34634d3eba41af0144edfc5e: Neither blocks nor log segments found. Creating new log.
I20260811 16:40:48.523468 21270 tablet_bootstrap.cc:492] T b759c53deb104ee1992e12f00639c1da P c2e1d9970c1e451d9d630b54876760eb: No bootstrap required, opened a new log
I20260811 16:40:48.523522 21270 ts_tablet_manager.cc:1397] T b759c53deb104ee1992e12f00639c1da P c2e1d9970c1e451d9d630b54876760eb: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:40:48.523674 21274 log.cc:824] T b759c53deb104ee1992e12f00639c1da P 84819ebc34634d3eba41af0144edfc5e: Log is configured to *not* fsync() on all Append() calls
I20260811 16:40:48.524361 21274 tablet_bootstrap.cc:492] T b759c53deb104ee1992e12f00639c1da P 84819ebc34634d3eba41af0144edfc5e: No bootstrap required, opened a new log
I20260811 16:40:48.524415 21274 ts_tablet_manager.cc:1397] T b759c53deb104ee1992e12f00639c1da P 84819ebc34634d3eba41af0144edfc5e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 16:40:48.525048 21270 raft_consensus.cc:348] T b759c53deb104ee1992e12f00639c1da P c2e1d9970c1e451d9d630b54876760eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2e1d9970c1e451d9d630b54876760eb" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 43295 } } peers { permanent_uuid: "84819ebc34634d3eba41af0144edfc5e" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 35689 } } peers { permanent_uuid: "3df5160026ee4c649e68690a9a69c32e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 34953 } }
I20260811 16:40:48.525184 21270 raft_consensus.cc:374] T b759c53deb104ee1992e12f00639c1da P c2e1d9970c1e451d9d630b54876760eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:40:48.525218 21270 raft_consensus.cc:729] T b759c53deb104ee1992e12f00639c1da P c2e1d9970c1e451d9d630b54876760eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2e1d9970c1e451d9d630b54876760eb, State: Initialized, Role: FOLLOWER
I20260811 16:40:48.525328 21270 consensus_queue.cc:260] T b759c53deb104ee1992e12f00639c1da P c2e1d9970c1e451d9d630b54876760eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2e1d9970c1e451d9d630b54876760eb" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 43295 } } peers { permanent_uuid: "84819ebc34634d3eba41af0144edfc5e" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 35689 } } peers { permanent_uuid: "3df5160026ee4c649e68690a9a69c32e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 34953 } }
I20260811 16:40:48.525589 21270 ts_tablet_manager.cc:1428] T b759c53deb104ee1992e12f00639c1da P c2e1d9970c1e451d9d630b54876760eb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:40:48.525615 21020 heartbeater.cc:503] Master 127.24.175.254:36391 was elected leader, sending a full tablet report...
I20260811 16:40:48.525908 21274 raft_consensus.cc:348] T b759c53deb104ee1992e12f00639c1da P 84819ebc34634d3eba41af0144edfc5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2e1d9970c1e451d9d630b54876760eb" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 43295 } } peers { permanent_uuid: "84819ebc34634d3eba41af0144edfc5e" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 35689 } } peers { permanent_uuid: "3df5160026ee4c649e68690a9a69c32e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 34953 } }
I20260811 16:40:48.526170 21274 raft_consensus.cc:374] T b759c53deb104ee1992e12f00639c1da P 84819ebc34634d3eba41af0144edfc5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:40:48.526226 21274 raft_consensus.cc:729] T b759c53deb104ee1992e12f00639c1da P 84819ebc34634d3eba41af0144edfc5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84819ebc34634d3eba41af0144edfc5e, State: Initialized, Role: FOLLOWER
I20260811 16:40:48.526341 21274 consensus_queue.cc:260] T b759c53deb104ee1992e12f00639c1da P 84819ebc34634d3eba41af0144edfc5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2e1d9970c1e451d9d630b54876760eb" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 43295 } } peers { permanent_uuid: "84819ebc34634d3eba41af0144edfc5e" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 35689 } } peers { permanent_uuid: "3df5160026ee4c649e68690a9a69c32e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 34953 } }
I20260811 16:40:48.526624 21274 ts_tablet_manager.cc:1428] T b759c53deb104ee1992e12f00639c1da P 84819ebc34634d3eba41af0144edfc5e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:40:48.526638 21254 heartbeater.cc:503] Master 127.24.175.254:36391 was elected leader, sending a full tablet report...
W20260811 16:40:48.615234 21022 tablet.cc:2369] T b759c53deb104ee1992e12f00639c1da P c2e1d9970c1e451d9d630b54876760eb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:40:48.673722 20787 raft_consensus.cc:482] T b759c53deb104ee1992e12f00639c1da P 3df5160026ee4c649e68690a9a69c32e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:40:48.673869 20787 raft_consensus.cc:504] T b759c53deb104ee1992e12f00639c1da P 3df5160026ee4c649e68690a9a69c32e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2e1d9970c1e451d9d630b54876760eb" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 43295 } } peers { permanent_uuid: "84819ebc34634d3eba41af0144edfc5e" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 35689 } } peers { permanent_uuid: "3df5160026ee4c649e68690a9a69c32e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 34953 } }
I20260811 16:40:48.674353 20787 leader_election.cc:288] T b759c53deb104ee1992e12f00639c1da P 3df5160026ee4c649e68690a9a69c32e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c2e1d9970c1e451d9d630b54876760eb (127.24.175.194:43295), 84819ebc34634d3eba41af0144edfc5e (127.24.175.195:35689)
I20260811 16:40:48.678408 21266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:48.674640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:55835 (local address 127.24.175.194:43295)
0811 16:40:48.674705 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:48.674707 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:48.674974 (+ 267us) server_negotiation.cc:407] Connection header received
0811 16:40:48.675006 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:48.675007 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:48.675016 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:48.675061 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:40:48.675199 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:48.675948 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:48.677450 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:48.678038 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:48.678113 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:48.678123 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 16:40:48.678303 (+ 180us) server_negotiation.cc:299] Negotiation successful
0811 16:40:48.678342 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 16:40:48.678454 21267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:48.674640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:55605 (local address 127.24.175.195:35689)
0811 16:40:48.674694 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:48.674696 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:48.674706 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:40:48.674735 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:48.674736 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:48.674746 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:48.674799 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:40:48.675248 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:48.675949 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:48.677441 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:48.678067 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:48.678141 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:48.678184 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0811 16:40:48.678343 (+ 159us) server_negotiation.cc:299] Negotiation successful
0811 16:40:48.678383 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 16:40:48.678462 20783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:48.674559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.195:35689 (local address 127.24.175.193:55605)
0811 16:40:48.674607 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:48.674619 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:40:48.674665 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:40:48.674822 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:40:48.674824 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:40:48.674826 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:40:48.675176 (+ 350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:48.675178 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:48.676024 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:48.676025 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:48.677324 (+ 1299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:48.677327 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:48.678191 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:48.678192 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:48.678277 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:48.678279 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 16:40:48.678326 (+ 47us) client_negotiation.cc:240] Negotiation successful
0811 16:40:48.678381 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25,"mutex_wait_us":9}
I20260811 16:40:48.678463 21281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:48.674559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.194:43295 (local address 127.24.175.193:55835)
0811 16:40:48.674897 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:48.674907 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:40:48.674957 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:40:48.675062 (+ 105us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:40:48.675063 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:40:48.675064 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:40:48.675135 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:48.675137 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:48.676028 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:48.676029 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:48.677324 (+ 1295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:40:48.677327 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:40:48.678177 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:40:48.678179 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:40:48.678237 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:48.678241 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:40:48.678288 (+ 47us) client_negotiation.cc:240] Negotiation successful
0811 16:40:48.678331 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":320,"mutex_wait_us":212,"thread_start_us":134,"threads_started":1}
I20260811 16:40:48.678846 21169 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b759c53deb104ee1992e12f00639c1da" candidate_uuid: "3df5160026ee4c649e68690a9a69c32e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84819ebc34634d3eba41af0144edfc5e" is_pre_election: true
I20260811 16:40:48.678900 20929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b759c53deb104ee1992e12f00639c1da" candidate_uuid: "3df5160026ee4c649e68690a9a69c32e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2e1d9970c1e451d9d630b54876760eb" is_pre_election: true
I20260811 16:40:48.678997 21169 raft_consensus.cc:2454] T b759c53deb104ee1992e12f00639c1da P 84819ebc34634d3eba41af0144edfc5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3df5160026ee4c649e68690a9a69c32e in term 0.
I20260811 16:40:48.679036 20929 raft_consensus.cc:2454] T b759c53deb104ee1992e12f00639c1da P c2e1d9970c1e451d9d630b54876760eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3df5160026ee4c649e68690a9a69c32e in term 0.
I20260811 16:40:48.679245 20580 leader_election.cc:302] T b759c53deb104ee1992e12f00639c1da P 3df5160026ee4c649e68690a9a69c32e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3df5160026ee4c649e68690a9a69c32e, c2e1d9970c1e451d9d630b54876760eb; no voters:
I20260811 16:40:48.679390 20787 raft_consensus.cc:2781] T b759c53deb104ee1992e12f00639c1da P 3df5160026ee4c649e68690a9a69c32e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:40:48.679472 20787 raft_consensus.cc:482] T b759c53deb104ee1992e12f00639c1da P 3df5160026ee4c649e68690a9a69c32e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:40:48.679497 20787 raft_consensus.cc:3037] T b759c53deb104ee1992e12f00639c1da P 3df5160026ee4c649e68690a9a69c32e [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:40:48.680225 20787 raft_consensus.cc:504] T b759c53deb104ee1992e12f00639c1da P 3df5160026ee4c649e68690a9a69c32e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2e1d9970c1e451d9d630b54876760eb" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 43295 } } peers { permanent_uuid: "84819ebc34634d3eba41af0144edfc5e" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 35689 } } peers { permanent_uuid: "3df5160026ee4c649e68690a9a69c32e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 34953 } }
I20260811 16:40:48.680379 20787 leader_election.cc:288] T b759c53deb104ee1992e12f00639c1da P 3df5160026ee4c649e68690a9a69c32e [CANDIDATE]: Term 1 election: Requested vote from peers c2e1d9970c1e451d9d630b54876760eb (127.24.175.194:43295), 84819ebc34634d3eba41af0144edfc5e (127.24.175.195:35689)
I20260811 16:40:48.680555 20929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b759c53deb104ee1992e12f00639c1da" candidate_uuid: "3df5160026ee4c649e68690a9a69c32e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2e1d9970c1e451d9d630b54876760eb"
I20260811 16:40:48.680563 21169 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b759c53deb104ee1992e12f00639c1da" candidate_uuid: "3df5160026ee4c649e68690a9a69c32e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84819ebc34634d3eba41af0144edfc5e"
I20260811 16:40:48.680634 20929 raft_consensus.cc:3037] T b759c53deb104ee1992e12f00639c1da P c2e1d9970c1e451d9d630b54876760eb [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:40:48.680641 21169 raft_consensus.cc:3037] T b759c53deb104ee1992e12f00639c1da P 84819ebc34634d3eba41af0144edfc5e [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:40:48.681348 20929 raft_consensus.cc:2454] T b759c53deb104ee1992e12f00639c1da P c2e1d9970c1e451d9d630b54876760eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3df5160026ee4c649e68690a9a69c32e in term 1.
I20260811 16:40:48.681409 21169 raft_consensus.cc:2454] T b759c53deb104ee1992e12f00639c1da P 84819ebc34634d3eba41af0144edfc5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3df5160026ee4c649e68690a9a69c32e in term 1.
I20260811 16:40:48.681552 20580 leader_election.cc:302] T b759c53deb104ee1992e12f00639c1da P 3df5160026ee4c649e68690a9a69c32e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3df5160026ee4c649e68690a9a69c32e, c2e1d9970c1e451d9d630b54876760eb; no voters:
I20260811 16:40:48.681674 20787 raft_consensus.cc:2781] T b759c53deb104ee1992e12f00639c1da P 3df5160026ee4c649e68690a9a69c32e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:40:48.681972 20787 raft_consensus.cc:686] T b759c53deb104ee1992e12f00639c1da P 3df5160026ee4c649e68690a9a69c32e [term 1 LEADER]: Becoming Leader. State: Replica: 3df5160026ee4c649e68690a9a69c32e, State: Running, Role: LEADER
I20260811 16:40:48.682067 20787 consensus_queue.cc:237] T b759c53deb104ee1992e12f00639c1da P 3df5160026ee4c649e68690a9a69c32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2e1d9970c1e451d9d630b54876760eb" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 43295 } } peers { permanent_uuid: "84819ebc34634d3eba41af0144edfc5e" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 35689 } } peers { permanent_uuid: "3df5160026ee4c649e68690a9a69c32e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 34953 } }
I20260811 16:40:48.682927 20453 catalog_manager.cc:5495] T b759c53deb104ee1992e12f00639c1da P 3df5160026ee4c649e68690a9a69c32e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3df5160026ee4c649e68690a9a69c32e (127.24.175.193). New cstate: current_term: 1 leader_uuid: "3df5160026ee4c649e68690a9a69c32e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2e1d9970c1e451d9d630b54876760eb" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 43295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84819ebc34634d3eba41af0144edfc5e" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 35689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3df5160026ee4c649e68690a9a69c32e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 34953 } health_report { overall_health: HEALTHY } } }
I20260811 16:40:48.697252 20792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:48.695239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52692 (local address 127.24.175.193:34953)
0811 16:40:48.695315 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 16:40:48.695317 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:40:48.695325 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:40:48.695353 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:40:48.695354 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:40:48.695371 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:40:48.695431 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:40:48.695524 (+ 93us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:48.695973 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:48.696665 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:40:48.696840 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:40:48.696882 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:40:48.697015 (+ 133us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:40:48.697116 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:40:48.697169 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 16:40:48.697184 (+ 15us) server_negotiation.cc:299] Negotiation successful
0811 16:40:48.697201 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 16:40:48.698740 20929 raft_consensus.cc:1261] T b759c53deb104ee1992e12f00639c1da P c2e1d9970c1e451d9d630b54876760eb [term 1 FOLLOWER]: Refusing update from remote peer 3df5160026ee4c649e68690a9a69c32e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:40:48.698740 21169 raft_consensus.cc:1261] T b759c53deb104ee1992e12f00639c1da P 84819ebc34634d3eba41af0144edfc5e [term 1 FOLLOWER]: Refusing update from remote peer 3df5160026ee4c649e68690a9a69c32e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:40:48.699083 21282 consensus_queue.cc:1035] T b759c53deb104ee1992e12f00639c1da P 3df5160026ee4c649e68690a9a69c32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2e1d9970c1e451d9d630b54876760eb" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 43295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:40:48.699204 20787 consensus_queue.cc:1035] T b759c53deb104ee1992e12f00639c1da P 3df5160026ee4c649e68690a9a69c32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "84819ebc34634d3eba41af0144edfc5e" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 35689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:40:48.701352 21286 mvcc.cc:205] Tried to move back new op lower bound from 7317366573867745280 to 7317366573802455040. Current Snapshot: MvccSnapshot[applied={T|T < 7317366573867745280}]
I20260811 16:40:48.702028 21288 mvcc.cc:205] Tried to move back new op lower bound from 7317366573867745280 to 7317366573802455040. Current Snapshot: MvccSnapshot[applied={T|T < 7317366573867745280 or (T in {7317366573867745280})}]
I20260811 16:40:48.703557 20454 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39066:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:40:48.703636 20454 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39066:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:40:48.704303 20454 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4: Sending DeleteTablet for 3 replicas of tablet b759c53deb104ee1992e12f00639c1da
I20260811 16:40:48.704571 20894 tablet_service.cc:1514] Processing DeleteTablet for tablet b759c53deb104ee1992e12f00639c1da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:40:48 UTC) from {username='kudu', principal='kudu/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:53162
I20260811 16:40:48.704656 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 20511
I20260811 16:40:48.704619 21133 tablet_service.cc:1514] Processing DeleteTablet for tablet b759c53deb104ee1992e12f00639c1da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:40:48 UTC) from {username='kudu', principal='kudu/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:41826
I20260811 16:40:48.711143 21301 tablet_replica.cc:330] T b759c53deb104ee1992e12f00639c1da P 84819ebc34634d3eba41af0144edfc5e: stopping tablet replica
I20260811 16:40:48.711259 21301 raft_consensus.cc:2229] T b759c53deb104ee1992e12f00639c1da P 84819ebc34634d3eba41af0144edfc5e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:40:48.711355 21301 raft_consensus.cc:2258] T b759c53deb104ee1992e12f00639c1da P 84819ebc34634d3eba41af0144edfc5e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:40:48.712378 21301 ts_tablet_manager.cc:1905] T b759c53deb104ee1992e12f00639c1da P 84819ebc34634d3eba41af0144edfc5e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:40:48.713496 21299 tablet_replica.cc:330] T b759c53deb104ee1992e12f00639c1da P c2e1d9970c1e451d9d630b54876760eb: stopping tablet replica
I20260811 16:40:48.713603 21299 raft_consensus.cc:2229] T b759c53deb104ee1992e12f00639c1da P c2e1d9970c1e451d9d630b54876760eb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:40:48.713706 21299 raft_consensus.cc:2258] T b759c53deb104ee1992e12f00639c1da P c2e1d9970c1e451d9d630b54876760eb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:40:48.714018 21301 ts_tablet_manager.cc:1918] T b759c53deb104ee1992e12f00639c1da P 84819ebc34634d3eba41af0144edfc5e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:40:48.714114 21301 log.cc:1196] T b759c53deb104ee1992e12f00639c1da P 84819ebc34634d3eba41af0144edfc5e: Deleting WAL directory at /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-2/wal/wals/b759c53deb104ee1992e12f00639c1da
I20260811 16:40:48.714546 21301 ts_tablet_manager.cc:1939] T b759c53deb104ee1992e12f00639c1da P 84819ebc34634d3eba41af0144edfc5e: Deleting consensus metadata
I20260811 16:40:48.715091 21299 ts_tablet_manager.cc:1905] T b759c53deb104ee1992e12f00639c1da P c2e1d9970c1e451d9d630b54876760eb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:40:48.716467 20432 catalog_manager.cc:4841] TS 84819ebc34634d3eba41af0144edfc5e (127.24.175.195:35689): tablet b759c53deb104ee1992e12f00639c1da (table test-table [id=92d48e09203a43edaca2180a19e268f8]) successfully deleted
I20260811 16:40:48.716938 21299 ts_tablet_manager.cc:1918] T b759c53deb104ee1992e12f00639c1da P c2e1d9970c1e451d9d630b54876760eb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:40:48.717013 21299 log.cc:1196] T b759c53deb104ee1992e12f00639c1da P c2e1d9970c1e451d9d630b54876760eb: Deleting WAL directory at /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-1/wal/wals/b759c53deb104ee1992e12f00639c1da
I20260811 16:40:48.717264 21299 ts_tablet_manager.cc:1939] T b759c53deb104ee1992e12f00639c1da P c2e1d9970c1e451d9d630b54876760eb: Deleting consensus metadata
I20260811 16:40:48.717681 20425 catalog_manager.cc:4841] TS c2e1d9970c1e451d9d630b54876760eb (127.24.175.194:43295): tablet b759c53deb104ee1992e12f00639c1da (table test-table [id=92d48e09203a43edaca2180a19e268f8]) successfully deleted
W20260811 16:40:48.721028 20431 connection.cc:535] client connection to 127.24.175.193:34953 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260811 16:40:48.721150 20431 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 16:40:48.721482 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 20788
I20260811 16:40:48.726429 21264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:40:48.721533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.193:34953 (local address 127.0.0.1:52706)
0811 16:40:48.726350 (+ 4817us) negotiation.cc:107] Waiting for socket to connect
0811 16:40:48.726398 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.193:34953: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":4793}
W20260811 16:40:48.726543 20431 catalog_manager.cc:4584] TS 3df5160026ee4c649e68690a9a69c32e (127.24.175.193:34953): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b759c53deb104ee1992e12f00639c1da: Network error: Client connection negotiation failed: client connection to 127.24.175.193:34953: connect: Connection refused (error 111)
I20260811 16:40:48.734391 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 21024
I20260811 16:40:48.751816 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 20399
I20260811 16:41:08.767313 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:36391
--webserver_interface=127.24.175.254
--webserver_port=43503
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:44797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.175.254:36391
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:41:08.851416 21304 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:41:08.851632 21304 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:41:08.851665 21304 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:41:08.852799 21304 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 16:41:08.852842 21304 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 16:41:08.852859 21304 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 16:41:08.852875 21304 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:41:08.852890 21304 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:41:08.852907 21304 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:41:08.852931 21304 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:41:08.852948 21304 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:41:08.854507 21304 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:44797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.24.175.254:36391
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:36391
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.175.254
--webserver_port=43503
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21304
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:41:08.854813 21304 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:41:08.855031 21304 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 16:41:08.860320 21304 server_base.cc:1034] running on GCE node
W20260811 16:41:08.860317 21313 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:41:08.860293 21314 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:41:08.860385 21316 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:08.860818 21304 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:41:08.861122 21304 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:41:08.862252 21304 hybrid_clock.cc:648] HybridClock initialized: now 1786466468862233 us; error 33 us; skew 500 ppm
Aug 11 16:41:08 dist-test-slave-zj8q krb5kdc[19492](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466468, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:41:08.864753 21304 init.cc:377] Logged in from keytab as kudu/127.24.175.254@KRBTEST.COM (short username kudu)
I20260811 16:41:08.865190 21304 webserver.cc:460] Webserver started at http://127.24.175.254:43503/ using document root <none> and password file <none>
I20260811 16:41:08.865433 21304 fs_manager.cc:359] Metadata directory not provided
I20260811 16:41:08.865485 21304 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:41:08.866854 21304 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.000s
I20260811 16:41:08.867484 21324 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:08.867645 21304 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:41:08.867753 21304 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/master-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/master-0/wal
uuid: "5a8635a9291b404d8d80e67b5217beb4"
format_stamp: "Formatted at 2026-08-11 16:40:26 on dist-test-slave-zj8q"
server_key: "1f4e5699189ca66f70c9ae46016dae1b"
server_key_iv: "30c3a5626f5105ab2e9d0c90e6ceade4"
server_key_version: "encryptionkey@0"
I20260811 16:41:08.868089 21304 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:41:08.876534 21304 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:41:08.878206 21304 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:41:08.878338 21304 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:41:08.882133 21304 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.254:36391
I20260811 16:41:08.882203 21408 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.254:36391 every 8 connection(s)
I20260811 16:41:08.882553 21304 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
I20260811 16:41:08.882997 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 21304
I20260811 16:41:08.883260 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.193:34953
--local_ip_for_outbound_sockets=127.24.175.193
--tserver_master_addrs=127.24.175.254:36391
--webserver_port=41611
--webserver_interface=127.24.175.193
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab
--principal=kudu/127.24.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:44797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 16:41:08.884143 21409 sys_catalog.cc:263] Verifying existing consensus state
I20260811 16:41:08.884794 21409 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4: Bootstrap starting.
I20260811 16:41:08.893819 21409 log.cc:824] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4: Log is configured to *not* fsync() on all Append() calls
I20260811 16:41:08.896080 21409 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:41:08.896361 21409 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4: Bootstrap complete.
I20260811 16:41:08.898598 21409 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a8635a9291b404d8d80e67b5217beb4" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 36391 } }
I20260811 16:41:08.898834 21409 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a8635a9291b404d8d80e67b5217beb4, State: Initialized, Role: FOLLOWER
I20260811 16:41:08.898988 21409 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a8635a9291b404d8d80e67b5217beb4" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 36391 } }
I20260811 16:41:08.899065 21409 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:41:08.899116 21409 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:41:08.899163 21409 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:41:08.900146 21409 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a8635a9291b404d8d80e67b5217beb4" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 36391 } }
I20260811 16:41:08.900245 21409 leader_election.cc:302] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5a8635a9291b404d8d80e67b5217beb4; no voters:
I20260811 16:41:08.900405 21409 leader_election.cc:288] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260811 16:41:08.900484 21415 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:41:08.900625 21415 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4 [term 3 LEADER]: Becoming Leader. State: Replica: 5a8635a9291b404d8d80e67b5217beb4, State: Running, Role: LEADER
I20260811 16:41:08.900691 21409 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:41:08.900743 21415 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a8635a9291b404d8d80e67b5217beb4" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 36391 } }
I20260811 16:41:08.901104 21416 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "5a8635a9291b404d8d80e67b5217beb4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a8635a9291b404d8d80e67b5217beb4" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 36391 } } }
I20260811 16:41:08.901194 21416 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4 [sys.catalog]: This master's current role is: LEADER
I20260811 16:41:08.901373 21417 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5a8635a9291b404d8d80e67b5217beb4. Latest consensus state: current_term: 3 leader_uuid: "5a8635a9291b404d8d80e67b5217beb4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a8635a9291b404d8d80e67b5217beb4" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 36391 } } }
I20260811 16:41:08.901427 21417 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4 [sys.catalog]: This master's current role is: LEADER
I20260811 16:41:08.901512 21427 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:41:08.902340 21427 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:41:08.902447 21427 catalog_manager.cc:1259] Loaded cluster ID: 3944e9f67efe48f6bb42d6f97625b090
I20260811 16:41:08.902527 21427 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:41:08.903877 21427 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:41:08.904070 21427 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4: Loaded TSK: 0
I20260811 16:41:08.904121 21427 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 5a8635a9291b404d8d80e67b5217beb4: Loaded TSK: 1
F20260811 16:41:08.904340 21427 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fa5669d49ad google::LogMessage::Fail() at ??:0
@ 0x7fa5669d788a google::LogMessage::SendToLog() at ??:0
@ 0x7fa5669d44de google::LogMessage::Flush() at ??:0
@ 0x7fa5669d5a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fa569141104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7fa56913ed41 kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7fa56e92e1cd kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7fa56e92e48e kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7fa56e92e594 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7fa56e8f4c48 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7fa56e8fead0 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fa5688a20d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fa568897954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fa5696fb6db start_thread at ??:0
@ 0x7fa5654d261f clone at ??:0
W20260811 16:41:08.983301 21412 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:41:08.983492 21412 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:41:08.983515 21412 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:41:08.984617 21412 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:41:08.984658 21412 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:41:08.984691 21412 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.193
I20260811 16:41:08.986129 21412 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:44797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab
--principal=kudu/127.24.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.193:34953
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.175.193
--webserver_port=41611
--tserver_master_addrs=127.24.175.254:36391
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21412
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.193
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:41:08.986377 21412 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:41:08.986585 21412 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:41:08.992609 21477 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:41:08.992651 21478 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:08.992818 21412 server_base.cc:1034] running on GCE node
W20260811 16:41:08.992631 21480 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:08.993139 21412 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:41:08.993378 21412 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:41:08.994542 21412 hybrid_clock.cc:648] HybridClock initialized: now 1786466468994532 us; error 27 us; skew 500 ppm
Aug 11 16:41:08 dist-test-slave-zj8q krb5kdc[19492](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466468, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:41:08.997059 21412 init.cc:377] Logged in from keytab as kudu/127.24.175.193@KRBTEST.COM (short username kudu)
I20260811 16:41:08.997505 21412 webserver.cc:460] Webserver started at http://127.24.175.193:41611/ using document root <none> and password file <none>
I20260811 16:41:08.997723 21412 fs_manager.cc:359] Metadata directory not provided
I20260811 16:41:08.997773 21412 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:41:08.999125 21412 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:41:08.999763 21489 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:08.999953 21412 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:41:09.000063 21412 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-0/wal
uuid: "3df5160026ee4c649e68690a9a69c32e"
format_stamp: "Formatted at 2026-08-11 16:40:27 on dist-test-slave-zj8q"
server_key: "85e026ce24b12ddb135e9195c635d895"
server_key_iv: "fc193234b0795821d07ec169fd1a5040"
server_key_version: "encryptionkey@0"
I20260811 16:41:09.000525 21412 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:41:09.014814 21412 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:41:09.017283 21412 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:41:09.017442 21412 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:41:09.017712 21412 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:41:09.018280 21498 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 16:41:09.019815 21412 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 16:41:09.019878 21412 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260811 16:41:09.019912 21412 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 16:41:09.020792 21412 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 16:41:09.020840 21412 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260811 16:41:09.020895 21498 tablet_bootstrap.cc:492] T b759c53deb104ee1992e12f00639c1da P 3df5160026ee4c649e68690a9a69c32e: Bootstrap starting.
I20260811 16:41:09.027884 21412 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.193:34953
I20260811 16:41:09.027933 21682 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.193:34953 every 8 connection(s)
I20260811 16:41:09.028344 21412 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
I20260811 16:41:09.029223 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 21412
I20260811 16:41:09.029543 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.194:43295
--local_ip_for_outbound_sockets=127.24.175.194
--tserver_master_addrs=127.24.175.254:36391
--webserver_port=36695
--webserver_interface=127.24.175.194
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab
--principal=kudu/127.24.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:44797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 16:41:09.030791 21498 log.cc:824] T b759c53deb104ee1992e12f00639c1da P 3df5160026ee4c649e68690a9a69c32e: Log is configured to *not* fsync() on all Append() calls
I20260811 16:41:09.033660 21498 tablet_bootstrap.cc:492] T b759c53deb104ee1992e12f00639c1da P 3df5160026ee4c649e68690a9a69c32e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:41:09.033979 21498 tablet_bootstrap.cc:492] T b759c53deb104ee1992e12f00639c1da P 3df5160026ee4c649e68690a9a69c32e: Bootstrap complete.
I20260811 16:41:09.035168 21498 ts_tablet_manager.cc:1397] T b759c53deb104ee1992e12f00639c1da P 3df5160026ee4c649e68690a9a69c32e: Time spent bootstrapping tablet: real 0.014s user 0.011s sys 0.002s
I20260811 16:41:09.036590 21498 raft_consensus.cc:348] T b759c53deb104ee1992e12f00639c1da P 3df5160026ee4c649e68690a9a69c32e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2e1d9970c1e451d9d630b54876760eb" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 43295 } } peers { permanent_uuid: "84819ebc34634d3eba41af0144edfc5e" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 35689 } } peers { permanent_uuid: "3df5160026ee4c649e68690a9a69c32e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 34953 } }
I20260811 16:41:09.036959 21498 raft_consensus.cc:729] T b759c53deb104ee1992e12f00639c1da P 3df5160026ee4c649e68690a9a69c32e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3df5160026ee4c649e68690a9a69c32e, State: Initialized, Role: FOLLOWER
I20260811 16:41:09.037104 21498 consensus_queue.cc:260] T b759c53deb104ee1992e12f00639c1da P 3df5160026ee4c649e68690a9a69c32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2e1d9970c1e451d9d630b54876760eb" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 43295 } } peers { permanent_uuid: "84819ebc34634d3eba41af0144edfc5e" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 35689 } } peers { permanent_uuid: "3df5160026ee4c649e68690a9a69c32e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 34953 } }
I20260811 16:41:09.037390 21498 ts_tablet_manager.cc:1428] T b759c53deb104ee1992e12f00639c1da P 3df5160026ee4c649e68690a9a69c32e: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
W20260811 16:41:09.108489 21685 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:41:09.029112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:36391 (local address 127.24.175.193:36205)
0811 16:41:09.031071 (+ 1959us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:09.031117 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 16:41:09.032485 (+ 1368us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:41:09.108277 (+ 75792us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:36391: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":1914,"thread_start_us":91,"threads_started":1}
W20260811 16:41:09.108762 21683 heartbeater.cc:644] Failed to heartbeat to 127.24.175.254:36391 (0 consecutive failures): Network error: Failed to ping master at 127.24.175.254:36391: Client connection negotiation failed: client connection to 127.24.175.254:36391: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 16:41:09.109102 21685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:09.108973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:36391 (local address 127.24.175.193:51225)
0811 16:41:09.109020 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:09.109075 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:36391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260811 16:41:09.109452 21685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:09.109303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:36391 (local address 127.24.175.193:37451)
0811 16:41:09.109370 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:09.109428 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:36391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260811 16:41:09.109573 21683 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 16:41:09.117648 21689 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:41:09.117837 21689 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:41:09.117867 21689 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:41:09.119019 21689 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:41:09.119061 21689 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:41:09.119095 21689 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.194
I20260811 16:41:09.120517 21689 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:44797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab
--principal=kudu/127.24.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.194:43295
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.175.194
--webserver_port=36695
--tserver_master_addrs=127.24.175.254:36391
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21689
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.194
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:41:09.120767 21689 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:41:09.120967 21689 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:41:09.125849 21704 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:41:09.125876 21701 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:09.125959 21689 server_base.cc:1034] running on GCE node
W20260811 16:41:09.126022 21707 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:09.126236 21689 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:41:09.126470 21689 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:41:09.127607 21689 hybrid_clock.cc:648] HybridClock initialized: now 1786466469127604 us; error 50 us; skew 500 ppm
Aug 11 16:41:09 dist-test-slave-zj8q krb5kdc[19492](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466469, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:41:09.130009 21689 init.cc:377] Logged in from keytab as kudu/127.24.175.194@KRBTEST.COM (short username kudu)
I20260811 16:41:09.130442 21689 webserver.cc:460] Webserver started at http://127.24.175.194:36695/ using document root <none> and password file <none>
I20260811 16:41:09.130656 21689 fs_manager.cc:359] Metadata directory not provided
I20260811 16:41:09.130712 21689 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:41:09.131971 21689 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:41:09.132535 21718 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:09.132717 21689 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 16:41:09.132802 21689 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-1/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-1/wal
uuid: "c2e1d9970c1e451d9d630b54876760eb"
format_stamp: "Formatted at 2026-08-11 16:40:27 on dist-test-slave-zj8q"
server_key: "ac6acf5cfc4771e46083bb0809c7c3aa"
server_key_iv: "b65bf81e89bfdbdc47e672d7663ba48c"
server_key_version: "encryptionkey@0"
I20260811 16:41:09.133114 21689 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:41:09.152032 21689 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:41:09.153959 21689 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:41:09.154093 21689 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:41:09.154332 21689 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:41:09.154631 21689 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:41:09.154671 21689 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:09.154702 21689 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:41:09.154726 21689 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:09.160296 21689 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.194:43295
I20260811 16:41:09.160377 21915 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.194:43295 every 8 connection(s)
I20260811 16:41:09.160725 21689 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
I20260811 16:41:09.162026 21921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:09.161431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:36391 (local address 127.24.175.194:53177)
0811 16:41:09.161584 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:09.161673 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:36391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":71,"threads_started":1}
W20260811 16:41:09.162286 21918 heartbeater.cc:644] Failed to heartbeat to 127.24.175.254:36391 (0 consecutive failures): Network error: Failed to ping master at 127.24.175.254:36391: Client connection negotiation failed: client connection to 127.24.175.254:36391: connect: Connection refused (error 111)
I20260811 16:41:09.162539 21921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:09.162452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:36391 (local address 127.24.175.194:35477)
0811 16:41:09.162493 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:09.162520 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:36391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260811 16:41:09.162778 21921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:09.162716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:36391 (local address 127.24.175.194:52935)
0811 16:41:09.162747 (+ 31us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:09.162766 (+ 19us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:36391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
W20260811 16:41:09.162865 21918 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 16:41:09.167325 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 21689
I20260811 16:41:09.167605 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.195:35689
--local_ip_for_outbound_sockets=127.24.175.195
--tserver_master_addrs=127.24.175.254:36391
--webserver_port=43205
--webserver_interface=127.24.175.195
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab
--principal=kudu/127.24.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:44797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:41:09.251073 21922 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:41:09.251264 21922 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:41:09.251286 21922 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:41:09.252357 21922 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:41:09.252391 21922 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:41:09.252416 21922 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.195
I20260811 16:41:09.253901 21922 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:44797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab
--principal=kudu/127.24.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.195:35689
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.175.195
--webserver_port=43205
--tserver_master_addrs=127.24.175.254:36391
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21922
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.195
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:41:09.254096 21922 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:41:09.254314 21922 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:41:09.259298 21934 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:41:09.259311 21932 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:41:09.259312 21930 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:09.259614 21922 server_base.cc:1034] running on GCE node
I20260811 16:41:09.259809 21922 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:41:09.260006 21922 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:41:09.261140 21922 hybrid_clock.cc:648] HybridClock initialized: now 1786466469261130 us; error 28 us; skew 500 ppm
Aug 11 16:41:09 dist-test-slave-zj8q krb5kdc[19492](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466469, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:41:09.263772 21922 init.cc:377] Logged in from keytab as kudu/127.24.175.195@KRBTEST.COM (short username kudu)
I20260811 16:41:09.264220 21922 webserver.cc:460] Webserver started at http://127.24.175.195:43205/ using document root <none> and password file <none>
I20260811 16:41:09.264446 21922 fs_manager.cc:359] Metadata directory not provided
I20260811 16:41:09.264495 21922 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:41:09.265892 21922 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:41:09.266553 21948 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:09.266737 21922 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:09.266829 21922 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-2/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-2/wal
uuid: "84819ebc34634d3eba41af0144edfc5e"
format_stamp: "Formatted at 2026-08-11 16:40:27 on dist-test-slave-zj8q"
server_key: "abbf5b25a49ae4779b050efe00989570"
server_key_iv: "229651cbf43fb9ab94ec8f456afe847d"
server_key_version: "encryptionkey@0"
I20260811 16:41:09.267159 21922 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:41:09.277225 21922 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:41:09.279331 21922 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:41:09.279470 21922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:41:09.279680 21922 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:41:09.279968 21922 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:41:09.280001 21922 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:09.280030 21922 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:41:09.280047 21922 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:09.285796 21922 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.195:35689
I20260811 16:41:09.285858 22132 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.195:35689 every 8 connection(s)
I20260811 16:41:09.286209 21922 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
I20260811 16:41:09.287204 22136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:09.286847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:36391 (local address 127.24.175.195:57473)
0811 16:41:09.286988 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:09.287059 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:36391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":71,"threads_started":1}
W20260811 16:41:09.287597 22134 heartbeater.cc:644] Failed to heartbeat to 127.24.175.254:36391 (0 consecutive failures): Network error: Failed to ping master at 127.24.175.254:36391: Client connection negotiation failed: client connection to 127.24.175.254:36391: connect: Connection refused (error 111)
I20260811 16:41:09.287876 22136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:09.287782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:36391 (local address 127.24.175.195:46821)
0811 16:41:09.287827 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:09.287854 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:36391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260811 16:41:09.288138 22136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:09.288059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:36391 (local address 127.24.175.195:60319)
0811 16:41:09.288097 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:09.288118 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:36391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260811 16:41:09.288231 22134 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 16:41:09.293511 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 21922
I20260811 16:41:10.110100 22139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:10.109868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:36391 (local address 127.24.175.193:36819)
0811 16:41:10.109992 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:10.110029 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:36391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":61,"threads_started":1}
I20260811 16:41:10.163334 22140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:10.163131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:36391 (local address 127.24.175.194:34623)
0811 16:41:10.163253 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:10.163285 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:36391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":61,"threads_started":1}
I20260811 16:41:10.282707 22141 raft_consensus.cc:482] T b759c53deb104ee1992e12f00639c1da P 3df5160026ee4c649e68690a9a69c32e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:41:10.282858 22141 raft_consensus.cc:504] T b759c53deb104ee1992e12f00639c1da P 3df5160026ee4c649e68690a9a69c32e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2e1d9970c1e451d9d630b54876760eb" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 43295 } } peers { permanent_uuid: "84819ebc34634d3eba41af0144edfc5e" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 35689 } } peers { permanent_uuid: "3df5160026ee4c649e68690a9a69c32e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 34953 } }
I20260811 16:41:10.283218 22141 leader_election.cc:288] T b759c53deb104ee1992e12f00639c1da P 3df5160026ee4c649e68690a9a69c32e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c2e1d9970c1e451d9d630b54876760eb (127.24.175.194:43295), 84819ebc34634d3eba41af0144edfc5e (127.24.175.195:35689)
I20260811 16:41:10.288722 22147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:10.288513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:36391 (local address 127.24.175.195:38107)
0811 16:41:10.288639 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:10.288681 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:36391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":53,"threads_started":1}
Aug 11 16:41:10 dist-test-slave-zj8q krb5kdc[19492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466468, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.193@KRBTEST.COM for kudu/127.24.175.195@KRBTEST.COM
Aug 11 16:41:10 dist-test-slave-zj8q krb5kdc[19492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466468, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.193@KRBTEST.COM for kudu/127.24.175.194@KRBTEST.COM
I20260811 16:41:10.299520 22142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:10.283429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.194:43295 (local address 127.24.175.193:58275)
0811 16:41:10.283550 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:10.283560 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:41:10.283614 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:41:10.284528 (+ 914us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:41:10.284531 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:41:10.285036 (+ 505us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:41:10.285325 (+ 289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:10.285334 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:10.287062 (+ 1728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:10.287063 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:10.288435 (+ 1372us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:10.288438 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:10.289262 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:10.289263 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:10.289406 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:10.293577 (+ 4171us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:41:10.293588 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:41:10.295822 (+ 2234us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:41:10.297701 (+ 1879us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:41:10.297703 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:41:10.297703 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:41:10.297971 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:41:10.298287 (+ 316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:41:10.298288 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:41:10.298288 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:41:10.298461 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:41:10.298918 (+ 457us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:41:10.298926 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:41:10.299092 (+ 166us) client_negotiation.cc:769] Sending connection context
0811 16:41:10.299219 (+ 127us) client_negotiation.cc:240] Negotiation successful
0811 16:41:10.299403 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"mutex_wait_us":99,"thread_start_us":58,"threads_started":1}
I20260811 16:41:10.299541 22143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:10.283514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:49661 (local address 127.24.175.195:35689)
0811 16:41:10.283633 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:10.283645 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:10.283683 (+ 38us) server_negotiation.cc:407] Connection header received
0811 16:41:10.284230 (+ 547us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:10.284233 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:10.284311 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:10.284462 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:41:10.285461 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:10.286929 (+ 1468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:10.288623 (+ 1694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:10.289232 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:10.289323 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:10.295659 (+ 6336us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:41:10.295664 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:41:10.295665 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:41:10.295678 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:41:10.297502 (+ 1824us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:41:10.298053 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:41:10.298057 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:41:10.298057 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:41:10.298209 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:41:10.298525 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:41:10.298525 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:41:10.298526 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:41:10.298846 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:41:10.298934 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:10.299298 (+ 364us) server_negotiation.cc:299] Negotiation successful
0811 16:41:10.299432 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80,"thread_start_us":51,"threads_started":1}
I20260811 16:41:10.299589 22139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:10.283396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.195:35689 (local address 127.24.175.193:49661)
0811 16:41:10.283455 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:10.283467 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:41:10.283522 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:41:10.284528 (+ 1006us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:41:10.284531 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:41:10.285036 (+ 505us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:41:10.285326 (+ 290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:10.285334 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:10.287060 (+ 1726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:10.287061 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:10.288435 (+ 1374us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:10.288438 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:10.289312 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:10.289312 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:10.289406 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:10.293577 (+ 4171us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:41:10.293588 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:41:10.295542 (+ 1954us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:41:10.297584 (+ 2042us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:41:10.297591 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:41:10.297593 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:41:10.297971 (+ 378us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:41:10.298287 (+ 316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:41:10.298288 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:41:10.298288 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:41:10.298461 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:41:10.298919 (+ 458us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:41:10.298926 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:41:10.299092 (+ 166us) client_negotiation.cc:769] Sending connection context
0811 16:41:10.299218 (+ 126us) client_negotiation.cc:240] Negotiation successful
0811 16:41:10.299472 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40,"mutex_wait_us":197}
I20260811 16:41:10.299541 22146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:10.283530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:58275 (local address 127.24.175.194:43295)
0811 16:41:10.283682 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:10.283689 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:10.283719 (+ 30us) server_negotiation.cc:407] Connection header received
0811 16:41:10.284257 (+ 538us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:10.284259 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:10.284311 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:10.284462 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:41:10.285460 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:10.286927 (+ 1467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:10.288534 (+ 1607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:10.289154 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:10.289299 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:10.295922 (+ 6623us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:41:10.295927 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:41:10.295927 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:41:10.295940 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:41:10.297594 (+ 1654us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:41:10.298053 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:41:10.298057 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:41:10.298057 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:41:10.298209 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:41:10.298525 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:41:10.298525 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:41:10.298526 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:41:10.298846 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:41:10.298934 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:10.299286 (+ 352us) server_negotiation.cc:299] Negotiation successful
0811 16:41:10.299430 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":53,"threads_started":1}
W20260811 16:41:10.300526 21495 leader_election.cc:341] T b759c53deb104ee1992e12f00639c1da P 3df5160026ee4c649e68690a9a69c32e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 84819ebc34634d3eba41af0144edfc5e (127.24.175.195:35689): Not found: Tablet not found: b759c53deb104ee1992e12f00639c1da
W20260811 16:41:10.300729 21490 leader_election.cc:341] T b759c53deb104ee1992e12f00639c1da P 3df5160026ee4c649e68690a9a69c32e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c2e1d9970c1e451d9d630b54876760eb (127.24.175.194:43295): Not found: Tablet not found: b759c53deb104ee1992e12f00639c1da
I20260811 16:41:10.300776 21490 leader_election.cc:302] T b759c53deb104ee1992e12f00639c1da P 3df5160026ee4c649e68690a9a69c32e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3df5160026ee4c649e68690a9a69c32e; no voters: 84819ebc34634d3eba41af0144edfc5e, c2e1d9970c1e451d9d630b54876760eb
I20260811 16:41:10.300901 22141 raft_consensus.cc:2726] T b759c53deb104ee1992e12f00639c1da P 3df5160026ee4c649e68690a9a69c32e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:41:11.110723 22150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:11.110498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:36391 (local address 127.24.175.193:51495)
0811 16:41:11.110636 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:11.110672 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:36391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":68,"threads_started":1}
I20260811 16:41:11.163935 22152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:11.163732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:36391 (local address 127.24.175.194:54255)
0811 16:41:11.163862 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:11.163894 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:36391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":72,"threads_started":1}
I20260811 16:41:11.289280 22153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:11.289082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:36391 (local address 127.24.175.195:41297)
0811 16:41:11.289206 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:11.289238 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:36391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":74,"threads_started":1}
I20260811 16:41:11.809181 22162 raft_consensus.cc:482] T b759c53deb104ee1992e12f00639c1da P 3df5160026ee4c649e68690a9a69c32e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:41:11.809288 22162 raft_consensus.cc:504] T b759c53deb104ee1992e12f00639c1da P 3df5160026ee4c649e68690a9a69c32e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2e1d9970c1e451d9d630b54876760eb" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 43295 } } peers { permanent_uuid: "84819ebc34634d3eba41af0144edfc5e" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 35689 } } peers { permanent_uuid: "3df5160026ee4c649e68690a9a69c32e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 34953 } }
I20260811 16:41:11.809466 22162 leader_election.cc:288] T b759c53deb104ee1992e12f00639c1da P 3df5160026ee4c649e68690a9a69c32e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c2e1d9970c1e451d9d630b54876760eb (127.24.175.194:43295), 84819ebc34634d3eba41af0144edfc5e (127.24.175.195:35689)
W20260811 16:41:11.809890 21495 leader_election.cc:341] T b759c53deb104ee1992e12f00639c1da P 3df5160026ee4c649e68690a9a69c32e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 84819ebc34634d3eba41af0144edfc5e (127.24.175.195:35689): Not found: Tablet not found: b759c53deb104ee1992e12f00639c1da
W20260811 16:41:11.809999 21490 leader_election.cc:341] T b759c53deb104ee1992e12f00639c1da P 3df5160026ee4c649e68690a9a69c32e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c2e1d9970c1e451d9d630b54876760eb (127.24.175.194:43295): Not found: Tablet not found: b759c53deb104ee1992e12f00639c1da
I20260811 16:41:11.810068 21490 leader_election.cc:302] T b759c53deb104ee1992e12f00639c1da P 3df5160026ee4c649e68690a9a69c32e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3df5160026ee4c649e68690a9a69c32e; no voters: 84819ebc34634d3eba41af0144edfc5e, c2e1d9970c1e451d9d630b54876760eb
I20260811 16:41:11.810186 22162 raft_consensus.cc:2726] T b759c53deb104ee1992e12f00639c1da P 3df5160026ee4c649e68690a9a69c32e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:41:12.111419 22163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:12.111185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:36391 (local address 127.24.175.193:38077)
0811 16:41:12.111325 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:12.111369 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:36391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":66,"threads_started":1}
I20260811 16:41:12.164629 22164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:12.164392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:36391 (local address 127.24.175.194:40535)
0811 16:41:12.164539 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:12.164578 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:36391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":79,"threads_started":1}
I20260811 16:41:12.289980 22165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:12.289753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:36391 (local address 127.24.175.195:57021)
0811 16:41:12.289880 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:12.289918 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:36391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":61,"threads_started":1}
I20260811 16:41:13.112181 22166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:13.111947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:36391 (local address 127.24.175.193:55129)
0811 16:41:13.112091 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:13.112131 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:36391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":68,"threads_started":1}
I20260811 16:41:13.165335 22167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:13.165098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:36391 (local address 127.24.175.194:40947)
0811 16:41:13.165251 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:13.165289 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:36391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":81,"threads_started":1}
I20260811 16:41:13.290663 22169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:13.290398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:36391 (local address 127.24.175.195:49077)
0811 16:41:13.290571 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:13.290614 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:36391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":74,"threads_started":1}
I20260811 16:41:13.856508 22170 raft_consensus.cc:482] T b759c53deb104ee1992e12f00639c1da P 3df5160026ee4c649e68690a9a69c32e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:41:13.856614 22170 raft_consensus.cc:504] T b759c53deb104ee1992e12f00639c1da P 3df5160026ee4c649e68690a9a69c32e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2e1d9970c1e451d9d630b54876760eb" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 43295 } } peers { permanent_uuid: "84819ebc34634d3eba41af0144edfc5e" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 35689 } } peers { permanent_uuid: "3df5160026ee4c649e68690a9a69c32e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 34953 } }
I20260811 16:41:13.856784 22170 leader_election.cc:288] T b759c53deb104ee1992e12f00639c1da P 3df5160026ee4c649e68690a9a69c32e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c2e1d9970c1e451d9d630b54876760eb (127.24.175.194:43295), 84819ebc34634d3eba41af0144edfc5e (127.24.175.195:35689)
W20260811 16:41:13.857161 21495 leader_election.cc:341] T b759c53deb104ee1992e12f00639c1da P 3df5160026ee4c649e68690a9a69c32e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 84819ebc34634d3eba41af0144edfc5e (127.24.175.195:35689): Not found: Tablet not found: b759c53deb104ee1992e12f00639c1da
W20260811 16:41:13.857266 21490 leader_election.cc:341] T b759c53deb104ee1992e12f00639c1da P 3df5160026ee4c649e68690a9a69c32e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c2e1d9970c1e451d9d630b54876760eb (127.24.175.194:43295): Not found: Tablet not found: b759c53deb104ee1992e12f00639c1da
I20260811 16:41:13.857322 21490 leader_election.cc:302] T b759c53deb104ee1992e12f00639c1da P 3df5160026ee4c649e68690a9a69c32e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3df5160026ee4c649e68690a9a69c32e; no voters: 84819ebc34634d3eba41af0144edfc5e, c2e1d9970c1e451d9d630b54876760eb
I20260811 16:41:13.857395 22170 raft_consensus.cc:2726] T b759c53deb104ee1992e12f00639c1da P 3df5160026ee4c649e68690a9a69c32e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:41:14.112855 22171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:14.112631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:36391 (local address 127.24.175.193:38421)
0811 16:41:14.112771 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:14.112808 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:36391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":77,"threads_started":1}
I20260811 16:41:14.166064 22174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:14.165816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:36391 (local address 127.24.175.194:60651)
0811 16:41:14.165986 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:14.166018 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:36391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":77,"threads_started":1}
I20260811 16:41:14.291380 22176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:14.291156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:36391 (local address 127.24.175.195:34383)
0811 16:41:14.291295 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:14.291331 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:36391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":77,"threads_started":1}
I20260811 16:41:15.113667 22178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:15.113414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:36391 (local address 127.24.175.193:52231)
0811 16:41:15.113577 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:15.113617 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:36391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":72,"threads_started":1}
I20260811 16:41:15.166815 22179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:15.166582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:36391 (local address 127.24.175.194:35671)
0811 16:41:15.166726 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:15.166766 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:36391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":71,"threads_started":1}
I20260811 16:41:15.292035 22181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:15.291825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:36391 (local address 127.24.175.195:59599)
0811 16:41:15.291955 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:15.291989 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:36391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":64,"threads_started":1}
I20260811 16:41:15.952620 22183 raft_consensus.cc:482] T b759c53deb104ee1992e12f00639c1da P 3df5160026ee4c649e68690a9a69c32e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:41:15.952723 22183 raft_consensus.cc:504] T b759c53deb104ee1992e12f00639c1da P 3df5160026ee4c649e68690a9a69c32e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2e1d9970c1e451d9d630b54876760eb" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 43295 } } peers { permanent_uuid: "84819ebc34634d3eba41af0144edfc5e" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 35689 } } peers { permanent_uuid: "3df5160026ee4c649e68690a9a69c32e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 34953 } }
I20260811 16:41:15.952879 22183 leader_election.cc:288] T b759c53deb104ee1992e12f00639c1da P 3df5160026ee4c649e68690a9a69c32e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c2e1d9970c1e451d9d630b54876760eb (127.24.175.194:43295), 84819ebc34634d3eba41af0144edfc5e (127.24.175.195:35689)
W20260811 16:41:15.953220 21495 leader_election.cc:341] T b759c53deb104ee1992e12f00639c1da P 3df5160026ee4c649e68690a9a69c32e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 84819ebc34634d3eba41af0144edfc5e (127.24.175.195:35689): Not found: Tablet not found: b759c53deb104ee1992e12f00639c1da
W20260811 16:41:15.953307 21490 leader_election.cc:341] T b759c53deb104ee1992e12f00639c1da P 3df5160026ee4c649e68690a9a69c32e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c2e1d9970c1e451d9d630b54876760eb (127.24.175.194:43295): Not found: Tablet not found: b759c53deb104ee1992e12f00639c1da
I20260811 16:41:15.953365 21490 leader_election.cc:302] T b759c53deb104ee1992e12f00639c1da P 3df5160026ee4c649e68690a9a69c32e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3df5160026ee4c649e68690a9a69c32e; no voters: 84819ebc34634d3eba41af0144edfc5e, c2e1d9970c1e451d9d630b54876760eb
I20260811 16:41:15.953447 22183 raft_consensus.cc:2726] T b759c53deb104ee1992e12f00639c1da P 3df5160026ee4c649e68690a9a69c32e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:41:16.114454 22185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:16.114237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:36391 (local address 127.24.175.193:37839)
0811 16:41:16.114362 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:16.114404 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:36391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":61,"threads_started":1}
I20260811 16:41:16.167579 22187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:16.167341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:36391 (local address 127.24.175.194:41435)
0811 16:41:16.167466 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:16.167507 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:36391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":65,"threads_started":1}
I20260811 16:41:16.292662 22189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:16.292446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:36391 (local address 127.24.175.195:44777)
0811 16:41:16.292561 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:16.292596 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:36391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":62,"threads_started":1}
I20260811 16:41:17.115083 22190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:17.114882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:36391 (local address 127.24.175.193:39653)
0811 16:41:17.115001 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:17.115035 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:36391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":62,"threads_started":1}
I20260811 16:41:17.168169 22192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:17.167975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:36391 (local address 127.24.175.194:35973)
0811 16:41:17.168086 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:17.168120 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:36391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":59,"threads_started":1}
I20260811 16:41:17.293288 22194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:17.293078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:36391 (local address 127.24.175.195:38497)
0811 16:41:17.293209 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:17.293244 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:36391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":71,"threads_started":1}
I20260811 16:41:18.115752 22197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:18.115530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:36391 (local address 127.24.175.193:50953)
0811 16:41:18.115661 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:18.115703 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:36391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":77,"threads_started":1}
I20260811 16:41:18.168768 22198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:18.168558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:36391 (local address 127.24.175.194:40183)
0811 16:41:18.168687 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:18.168723 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:36391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":74,"threads_started":1}
I20260811 16:41:18.293911 22200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:18.293684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:36391 (local address 127.24.175.195:46001)
0811 16:41:18.293831 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:18.293866 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:36391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":77,"threads_started":1}
I20260811 16:41:19.116384 22201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:19.116159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:36391 (local address 127.24.175.193:56385)
0811 16:41:19.116297 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:19.116333 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:36391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":67,"threads_started":1}
I20260811 16:41:19.169435 22203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:19.169202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:36391 (local address 127.24.175.194:56393)
0811 16:41:19.169341 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:19.169382 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:36391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":77,"threads_started":1}
I20260811 16:41:19.294574 22205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:19.294342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:36391 (local address 127.24.175.195:48879)
0811 16:41:19.294480 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:19.294520 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:36391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":59,"threads_started":1}
I20260811 16:41:20.117066 22209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:20.116811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:36391 (local address 127.24.175.193:34853)
0811 16:41:20.116975 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:20.117016 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:36391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":81,"threads_started":1}
I20260811 16:41:20.170034 22211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:20.169842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:36391 (local address 127.24.175.194:41581)
0811 16:41:20.169957 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:20.169989 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:36391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":65,"threads_started":1}
I20260811 16:41:20.295219 22212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:20.295018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:36391 (local address 127.24.175.195:51639)
0811 16:41:20.295127 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:20.295161 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:36391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":64,"threads_started":1}
I20260811 16:41:21.117728 22214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:21.117511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:36391 (local address 127.24.175.193:51747)
0811 16:41:21.117639 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:21.117677 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:36391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":70,"threads_started":1}
I20260811 16:41:21.170744 22218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:21.170460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:36391 (local address 127.24.175.194:44625)
0811 16:41:21.170640 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:21.170695 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:36391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":73,"threads_started":1}
I20260811 16:41:21.295766 22219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:21.295564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:36391 (local address 127.24.175.195:38899)
0811 16:41:21.295687 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:21.295720 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:36391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":58,"threads_started":1}
I20260811 16:41:22.118407 22221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:22.118196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:36391 (local address 127.24.175.193:34725)
0811 16:41:22.118326 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:22.118359 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:36391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":76,"threads_started":1}
I20260811 16:41:22.171412 22223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:22.171177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:36391 (local address 127.24.175.194:40211)
0811 16:41:22.171324 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:22.171362 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:36391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":77,"threads_started":1}
I20260811 16:41:22.296386 22225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:22.296173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:36391 (local address 127.24.175.195:56113)
0811 16:41:22.296301 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:22.296339 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:36391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":67,"threads_started":1}
I20260811 16:41:22.780269 22226 raft_consensus.cc:482] T b759c53deb104ee1992e12f00639c1da P 3df5160026ee4c649e68690a9a69c32e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:41:22.780381 22226 raft_consensus.cc:504] T b759c53deb104ee1992e12f00639c1da P 3df5160026ee4c649e68690a9a69c32e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2e1d9970c1e451d9d630b54876760eb" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 43295 } } peers { permanent_uuid: "84819ebc34634d3eba41af0144edfc5e" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 35689 } } peers { permanent_uuid: "3df5160026ee4c649e68690a9a69c32e" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 34953 } }
I20260811 16:41:22.780603 22226 leader_election.cc:288] T b759c53deb104ee1992e12f00639c1da P 3df5160026ee4c649e68690a9a69c32e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c2e1d9970c1e451d9d630b54876760eb (127.24.175.194:43295), 84819ebc34634d3eba41af0144edfc5e (127.24.175.195:35689)
W20260811 16:41:22.780988 21495 leader_election.cc:341] T b759c53deb104ee1992e12f00639c1da P 3df5160026ee4c649e68690a9a69c32e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 84819ebc34634d3eba41af0144edfc5e (127.24.175.195:35689): Not found: Tablet not found: b759c53deb104ee1992e12f00639c1da
W20260811 16:41:22.781077 21490 leader_election.cc:341] T b759c53deb104ee1992e12f00639c1da P 3df5160026ee4c649e68690a9a69c32e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c2e1d9970c1e451d9d630b54876760eb (127.24.175.194:43295): Not found: Tablet not found: b759c53deb104ee1992e12f00639c1da
I20260811 16:41:22.781144 21490 leader_election.cc:302] T b759c53deb104ee1992e12f00639c1da P 3df5160026ee4c649e68690a9a69c32e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3df5160026ee4c649e68690a9a69c32e; no voters: 84819ebc34634d3eba41af0144edfc5e, c2e1d9970c1e451d9d630b54876760eb
I20260811 16:41:22.781199 22226 raft_consensus.cc:2726] T b759c53deb104ee1992e12f00639c1da P 3df5160026ee4c649e68690a9a69c32e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:41:23.119045 22227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:23.118821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:36391 (local address 127.24.175.193:33345)
0811 16:41:23.118958 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:23.118997 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:36391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":65,"threads_started":1}
I20260811 16:41:23.172075 22229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:23.171864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:36391 (local address 127.24.175.194:34805)
0811 16:41:23.171990 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:23.172026 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:36391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":62,"threads_started":1}
I20260811 16:41:23.297051 22230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:23.296842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:36391 (local address 127.24.175.195:58779)
0811 16:41:23.296963 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:23.297000 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:36391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":63,"threads_started":1}
I20260811 16:41:24.119717 22233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:24.119494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:36391 (local address 127.24.175.193:35699)
0811 16:41:24.119630 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:24.119670 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:36391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":59,"threads_started":1}
I20260811 16:41:24.172816 22234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:24.172583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:36391 (local address 127.24.175.194:57721)
0811 16:41:24.172732 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:24.172767 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:36391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":93,"threads_started":1}
I20260811 16:41:24.294765 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 21412
I20260811 16:41:24.306906 22236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:24.301603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:36391 (local address 127.24.175.195:57831)
0811 16:41:24.306782 (+ 5179us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:24.306840 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.254:36391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":5155,"thread_start_us":54,"threads_started":1}
I20260811 16:41:24.311352 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 21689
I20260811 16:41:24.328380 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 21922
2026-08-11T16:41:24Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (58712 ms)
[----------] 30 tests from SecurityITest (234899 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:41:24 dist-test-slave-zj8q krb5kdc[22240](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:41:24 dist-test-slave-zj8q krb5kdc[22240](info): set up 2 sockets
Aug 11 16:41:24 dist-test-slave-zj8q krb5kdc[22240](info): commencing operation
krb5kdc: starting...
W20260811 16:41:25.503340 25279 mini_kdc.cc:121] Time spent starting KDC: real 1.150s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Aug 11 16:41:25 dist-test-slave-zj8q krb5kdc[22240](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466485, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:41:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:41:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab.
Entry for principal kudu/127.24.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab.
I20260811 16:41:25.621073 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:45649
--webserver_interface=127.24.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:45629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.175.254:45649
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:41:25.701603 22262 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:41:25.701804 22262 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:41:25.701834 22262 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:41:25.702979 22262 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:41:25.703022 22262 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:41:25.703040 22262 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:41:25.703055 22262 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:41:25.703073 22262 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:41:25.704591 22262 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:45629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.175.254:45649
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:45649
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22262
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:41:25.704833 22262 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:41:25.705039 22262 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:41:25.709841 22277 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:41:25.709848 22270 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:41:25.709849 22272 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:25.710144 22262 server_base.cc:1034] running on GCE node
I20260811 16:41:25.710402 22262 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:41:25.710677 22262 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:41:25.711826 22262 hybrid_clock.cc:648] HybridClock initialized: now 1786466485711808 us; error 29 us; skew 500 ppm
Aug 11 16:41:25 dist-test-slave-zj8q krb5kdc[22240](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466485, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:41:25.714280 22262 init.cc:377] Logged in from keytab as kudu/127.24.175.254@KRBTEST.COM (short username kudu)
I20260811 16:41:25.714706 22262 webserver.cc:460] Webserver started at http://127.24.175.254:42063/ using document root <none> and password file <none>
I20260811 16:41:25.714929 22262 fs_manager.cc:359] Metadata directory not provided
I20260811 16:41:25.714978 22262 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:41:25.715109 22262 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:41:25.716116 22262 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/master-0/data/instance:
uuid: "b2b27726d16a44f8a388a17fe20a009b"
format_stamp: "Formatted at 2026-08-11 16:41:25 on dist-test-slave-zj8q"
server_key: "dd748bdfdd2b616091cf7a3334f1c47c"
server_key_iv: "e1ac2b843d058d4ed9b2d96038bddf9c"
server_key_version: "encryptionkey@0"
I20260811 16:41:25.716449 22262 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/master-0/wal/instance:
uuid: "b2b27726d16a44f8a388a17fe20a009b"
format_stamp: "Formatted at 2026-08-11 16:41:25 on dist-test-slave-zj8q"
server_key: "dd748bdfdd2b616091cf7a3334f1c47c"
server_key_iv: "e1ac2b843d058d4ed9b2d96038bddf9c"
server_key_version: "encryptionkey@0"
I20260811 16:41:25.717639 22262 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 16:41:25.718305 22286 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:25.718441 22262 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:25.718524 22262 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/master-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/master-0/wal
uuid: "b2b27726d16a44f8a388a17fe20a009b"
format_stamp: "Formatted at 2026-08-11 16:41:25 on dist-test-slave-zj8q"
server_key: "dd748bdfdd2b616091cf7a3334f1c47c"
server_key_iv: "e1ac2b843d058d4ed9b2d96038bddf9c"
server_key_version: "encryptionkey@0"
I20260811 16:41:25.718590 22262 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:41:25.726843 22262 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:41:25.728773 22262 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:41:25.728899 22262 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:41:25.732789 22262 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.254:45649
I20260811 16:41:25.732821 22375 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.254:45649 every 8 connection(s)
I20260811 16:41:25.733130 22262 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
I20260811 16:41:25.733940 22377 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:41:25.735370 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 22262
I20260811 16:41:25.735486 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/master-0/wal/instance
I20260811 16:41:25.735687 25279 external_mini_cluster.cc:1428] Setting key f75ea1f5f7014b4abbe550191edbee56
I20260811 16:41:25.736608 22377 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b2b27726d16a44f8a388a17fe20a009b: Bootstrap starting.
I20260811 16:41:25.737268 22377 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b2b27726d16a44f8a388a17fe20a009b: Neither blocks nor log segments found. Creating new log.
I20260811 16:41:25.737583 22377 log.cc:824] T 00000000000000000000000000000000 P b2b27726d16a44f8a388a17fe20a009b: Log is configured to *not* fsync() on all Append() calls
I20260811 16:41:25.738262 22377 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b2b27726d16a44f8a388a17fe20a009b: No bootstrap required, opened a new log
I20260811 16:41:25.740492 22377 raft_consensus.cc:348] T 00000000000000000000000000000000 P b2b27726d16a44f8a388a17fe20a009b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2b27726d16a44f8a388a17fe20a009b" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 45649 } }
I20260811 16:41:25.740645 22377 raft_consensus.cc:374] T 00000000000000000000000000000000 P b2b27726d16a44f8a388a17fe20a009b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:41:25.740679 22377 raft_consensus.cc:729] T 00000000000000000000000000000000 P b2b27726d16a44f8a388a17fe20a009b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2b27726d16a44f8a388a17fe20a009b, State: Initialized, Role: FOLLOWER
I20260811 16:41:25.740826 22377 consensus_queue.cc:260] T 00000000000000000000000000000000 P b2b27726d16a44f8a388a17fe20a009b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2b27726d16a44f8a388a17fe20a009b" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 45649 } }
I20260811 16:41:25.740916 22377 raft_consensus.cc:388] T 00000000000000000000000000000000 P b2b27726d16a44f8a388a17fe20a009b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:41:25.740945 22377 raft_consensus.cc:482] T 00000000000000000000000000000000 P b2b27726d16a44f8a388a17fe20a009b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:41:25.740993 22377 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b2b27726d16a44f8a388a17fe20a009b [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:41:25.741665 22377 raft_consensus.cc:504] T 00000000000000000000000000000000 P b2b27726d16a44f8a388a17fe20a009b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2b27726d16a44f8a388a17fe20a009b" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 45649 } }
I20260811 16:41:25.741781 22377 leader_election.cc:302] T 00000000000000000000000000000000 P b2b27726d16a44f8a388a17fe20a009b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b2b27726d16a44f8a388a17fe20a009b; no voters:
I20260811 16:41:25.741930 22377 leader_election.cc:288] T 00000000000000000000000000000000 P b2b27726d16a44f8a388a17fe20a009b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:41:25.741964 22385 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b2b27726d16a44f8a388a17fe20a009b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:41:25.742192 22377 sys_catalog.cc:564] T 00000000000000000000000000000000 P b2b27726d16a44f8a388a17fe20a009b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:41:25.742177 22385 raft_consensus.cc:686] T 00000000000000000000000000000000 P b2b27726d16a44f8a388a17fe20a009b [term 1 LEADER]: Becoming Leader. State: Replica: b2b27726d16a44f8a388a17fe20a009b, State: Running, Role: LEADER
I20260811 16:41:25.742395 22385 consensus_queue.cc:237] T 00000000000000000000000000000000 P b2b27726d16a44f8a388a17fe20a009b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2b27726d16a44f8a388a17fe20a009b" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 45649 } }
Aug 11 16:41:25 dist-test-slave-zj8q krb5kdc[22240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466485, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:41:25.742730 22385 sys_catalog.cc:455] T 00000000000000000000000000000000 P b2b27726d16a44f8a388a17fe20a009b [sys.catalog]: SysCatalogTable state changed. Reason: New leader b2b27726d16a44f8a388a17fe20a009b. Latest consensus state: current_term: 1 leader_uuid: "b2b27726d16a44f8a388a17fe20a009b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2b27726d16a44f8a388a17fe20a009b" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 45649 } } }
I20260811 16:41:25.742769 22388 sys_catalog.cc:455] T 00000000000000000000000000000000 P b2b27726d16a44f8a388a17fe20a009b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b2b27726d16a44f8a388a17fe20a009b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2b27726d16a44f8a388a17fe20a009b" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 45649 } } }
I20260811 16:41:25.742890 22385 sys_catalog.cc:458] T 00000000000000000000000000000000 P b2b27726d16a44f8a388a17fe20a009b [sys.catalog]: This master's current role is: LEADER
I20260811 16:41:25.742990 22388 sys_catalog.cc:458] T 00000000000000000000000000000000 P b2b27726d16a44f8a388a17fe20a009b [sys.catalog]: This master's current role is: LEADER
I20260811 16:41:25.743749 22408 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:41:25.744280 22408 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:41:25.745718 22408 catalog_manager.cc:1347] Generated new cluster ID: c2ab9faed8354659baec17661db4431a
I20260811 16:41:25.745769 22408 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:41:25.746397 22382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:25.736188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38100 (local address 127.24.175.254:45649)
0811 16:41:25.736352 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:25.736361 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:25.736388 (+ 27us) server_negotiation.cc:407] Connection header received
0811 16:41:25.736819 (+ 431us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:25.736826 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:25.736873 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:25.736985 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:41:25.737748 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:25.738760 (+ 1012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:25.739791 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:25.740188 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:25.740272 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:25.742995 (+ 2723us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:41:25.742999 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:41:25.742999 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:41:25.743011 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:41:25.744804 (+ 1793us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:41:25.745183 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:41:25.745186 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:41:25.745187 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:41:25.745277 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:41:25.745464 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:41:25.745465 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:41:25.745465 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:41:25.745788 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:41:25.745920 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:25.746041 (+ 121us) server_negotiation.cc:299] Negotiation successful
0811 16:41:25.746207 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":75,"threads_started":1}
I20260811 16:41:25.771116 22408 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:41:25.771843 22408 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:41:25.777725 22408 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b2b27726d16a44f8a388a17fe20a009b: Generated new TSK 0
I20260811 16:41:25.777904 22408 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.175.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab.
Entry for principal kudu/127.24.175.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab.
I20260811 16:41:25.808997 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.193:0
--local_ip_for_outbound_sockets=127.24.175.193
--webserver_interface=127.24.175.193
--webserver_port=0
--tserver_master_addrs=127.24.175.254:45649
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab
--principal=kudu/127.24.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:45629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:41:25.890441 22426 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:41:25.890646 22426 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:41:25.890668 22426 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:41:25.891776 22426 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:41:25.891815 22426 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:41:25.891844 22426 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.193
I20260811 16:41:25.893276 22426 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:45629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab
--principal=kudu/127.24.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.175.193
--webserver_port=0
--tserver_master_addrs=127.24.175.254:45649
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22426
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.193
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:41:25.893492 22426 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:41:25.893743 22426 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:41:25.898532 22438 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:41:25.898571 22437 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:25.898763 22426 server_base.cc:1034] running on GCE node
W20260811 16:41:25.898543 22442 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:25.899042 22426 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:41:25.899278 22426 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:41:25.900419 22426 hybrid_clock.cc:648] HybridClock initialized: now 1786466485900402 us; error 33 us; skew 500 ppm
Aug 11 16:41:25 dist-test-slave-zj8q krb5kdc[22240](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466485, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:41:25.902844 22426 init.cc:377] Logged in from keytab as kudu/127.24.175.193@KRBTEST.COM (short username kudu)
I20260811 16:41:25.903244 22426 webserver.cc:460] Webserver started at http://127.24.175.193:35593/ using document root <none> and password file <none>
I20260811 16:41:25.903434 22426 fs_manager.cc:359] Metadata directory not provided
I20260811 16:41:25.903476 22426 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:41:25.903594 22426 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:41:25.904589 22426 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/ts-0/data/instance:
uuid: "42c406988cea44cba8f8a7a7a6bb1066"
format_stamp: "Formatted at 2026-08-11 16:41:25 on dist-test-slave-zj8q"
server_key: "fcee424735be1c2c058b1464253e4ea1"
server_key_iv: "5576c606ef53714da1e11bd82a536656"
server_key_version: "encryptionkey@0"
I20260811 16:41:25.904939 22426 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/ts-0/wal/instance:
uuid: "42c406988cea44cba8f8a7a7a6bb1066"
format_stamp: "Formatted at 2026-08-11 16:41:25 on dist-test-slave-zj8q"
server_key: "fcee424735be1c2c058b1464253e4ea1"
server_key_iv: "5576c606ef53714da1e11bd82a536656"
server_key_version: "encryptionkey@0"
I20260811 16:41:25.906175 22426 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 16:41:25.906873 22454 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:25.907022 22426 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:41:25.907107 22426 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/ts-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/ts-0/wal
uuid: "42c406988cea44cba8f8a7a7a6bb1066"
format_stamp: "Formatted at 2026-08-11 16:41:25 on dist-test-slave-zj8q"
server_key: "fcee424735be1c2c058b1464253e4ea1"
server_key_iv: "5576c606ef53714da1e11bd82a536656"
server_key_version: "encryptionkey@0"
I20260811 16:41:25.907172 22426 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:41:25.915813 22426 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:41:25.917752 22426 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:41:25.917881 22426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:41:25.918066 22426 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:41:25.918383 22426 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:41:25.918417 22426 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:25.918444 22426 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:41:25.918469 22426 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:25.923898 22426 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.193:36965
I20260811 16:41:25.923954 22667 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.193:36965 every 8 connection(s)
I20260811 16:41:25.924219 22426 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
Aug 11 16:41:25 dist-test-slave-zj8q krb5kdc[22240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466485, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.193@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:41:25.932848 22382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:25.924841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:37527 (local address 127.24.175.254:45649)
0811 16:41:25.924890 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:25.924892 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:25.925086 (+ 194us) server_negotiation.cc:407] Connection header received
0811 16:41:25.925545 (+ 459us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:25.925546 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:25.925557 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:25.925610 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:41:25.926533 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:25.927045 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:25.928065 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:25.928276 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:25.928331 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:25.930440 (+ 2109us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:41:25.930441 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:41:25.930442 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:41:25.930449 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:41:25.931666 (+ 1217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:41:25.932055 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:41:25.932056 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:41:25.932057 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:41:25.932104 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:41:25.932352 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:41:25.932352 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:41:25.932352 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:41:25.932455 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:41:25.932502 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:25.932705 (+ 203us) server_negotiation.cc:299] Negotiation successful
0811 16:41:25.932776 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 16:41:25.933000 22671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:25.924814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:45649 (local address 127.24.175.193:37527)
0811 16:41:25.924975 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:25.925009 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 16:41:25.925459 (+ 450us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:41:25.925669 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:41:25.925672 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:41:25.926266 (+ 594us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:41:25.926455 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:25.926461 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:25.927159 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:25.927160 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:25.927972 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:25.927975 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:25.928368 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:25.928370 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:25.928481 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:25.928924 (+ 443us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:41:25.928933 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:41:25.930347 (+ 1414us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:41:25.931759 (+ 1412us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:41:25.931766 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:41:25.931768 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:41:25.931988 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:41:25.932180 (+ 192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:41:25.932181 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:41:25.932182 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:41:25.932295 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:41:25.932501 (+ 206us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:41:25.932504 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:41:25.932617 (+ 113us) client_negotiation.cc:769] Sending connection context
0811 16:41:25.932692 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 16:41:25.932821 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":85,"threads_started":1}
I20260811 16:41:25.933492 22668 heartbeater.cc:347] Connected to a master server at 127.24.175.254:45649
I20260811 16:41:25.933583 22668 heartbeater.cc:464] Registering TS with master...
I20260811 16:41:25.933751 22668 heartbeater.cc:511] Master 127.24.175.254:45649 requested a full tablet report, sending...
I20260811 16:41:25.934305 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 22426
I20260811 16:41:25.934329 22316 ts_manager.cc:194] Registered new tserver with Master: 42c406988cea44cba8f8a7a7a6bb1066 (127.24.175.193:36965)
I20260811 16:41:25.934417 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/ts-0/wal/instance
I20260811 16:41:25.934616 25279 external_mini_cluster.cc:1428] Setting key d6c4686d1f9436062fa13e4e0f14648b
I20260811 16:41:25.935102 22316 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.175.193@KRBTEST.COM'} at 127.24.175.193:37527
WARNING: no policy specified for kudu/127.24.175.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab.
Entry for principal kudu/127.24.175.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab.
I20260811 16:41:25.958757 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.194:0
--local_ip_for_outbound_sockets=127.24.175.194
--webserver_interface=127.24.175.194
--webserver_port=0
--tserver_master_addrs=127.24.175.254:45649
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab
--principal=kudu/127.24.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:45629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:41:26.040882 22675 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:41:26.041080 22675 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:41:26.041110 22675 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:41:26.042292 22675 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:41:26.042333 22675 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:41:26.042359 22675 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.194
I20260811 16:41:26.043908 22675 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:45629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab
--principal=kudu/127.24.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.175.194
--webserver_port=0
--tserver_master_addrs=127.24.175.254:45649
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22675
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.194
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:41:26.044111 22675 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:41:26.044296 22675 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:41:26.049177 22688 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:41:26.049192 22685 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:26.049316 22675 server_base.cc:1034] running on GCE node
W20260811 16:41:26.049188 22686 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:26.049588 22675 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:41:26.049787 22675 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:41:26.050926 22675 hybrid_clock.cc:648] HybridClock initialized: now 1786466486050914 us; error 25 us; skew 500 ppm
Aug 11 16:41:26 dist-test-slave-zj8q krb5kdc[22240](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466486, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:41:26.053346 22675 init.cc:377] Logged in from keytab as kudu/127.24.175.194@KRBTEST.COM (short username kudu)
I20260811 16:41:26.053787 22675 webserver.cc:460] Webserver started at http://127.24.175.194:35457/ using document root <none> and password file <none>
I20260811 16:41:26.054011 22675 fs_manager.cc:359] Metadata directory not provided
I20260811 16:41:26.054068 22675 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:41:26.054225 22675 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:41:26.055302 22675 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/ts-1/data/instance:
uuid: "4720b9e700ae41b486cb1270a418fd83"
format_stamp: "Formatted at 2026-08-11 16:41:26 on dist-test-slave-zj8q"
server_key: "6c5c87880111e36a7960e32e1b84e2c4"
server_key_iv: "6dd92a838a099c26aaee6c966e88777f"
server_key_version: "encryptionkey@0"
I20260811 16:41:26.055625 22675 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/ts-1/wal/instance:
uuid: "4720b9e700ae41b486cb1270a418fd83"
format_stamp: "Formatted at 2026-08-11 16:41:26 on dist-test-slave-zj8q"
server_key: "6c5c87880111e36a7960e32e1b84e2c4"
server_key_iv: "6dd92a838a099c26aaee6c966e88777f"
server_key_version: "encryptionkey@0"
I20260811 16:41:26.056869 22675 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:41:26.057634 22700 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:26.057797 22675 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:41:26.057891 22675 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/ts-1/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/ts-1/wal
uuid: "4720b9e700ae41b486cb1270a418fd83"
format_stamp: "Formatted at 2026-08-11 16:41:26 on dist-test-slave-zj8q"
server_key: "6c5c87880111e36a7960e32e1b84e2c4"
server_key_iv: "6dd92a838a099c26aaee6c966e88777f"
server_key_version: "encryptionkey@0"
I20260811 16:41:26.057953 22675 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:41:26.077201 22675 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:41:26.078970 22675 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:41:26.079118 22675 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:41:26.079341 22675 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:41:26.079648 22675 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:41:26.079684 22675 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:26.079713 22675 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:41:26.079731 22675 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:26.085338 22675 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.194:38669
I20260811 16:41:26.085398 22882 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.194:38669 every 8 connection(s)
I20260811 16:41:26.085711 22675 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
Aug 11 16:41:26 dist-test-slave-zj8q krb5kdc[22240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466486, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.194@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:41:26.093523 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 22675
I20260811 16:41:26.093647 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/ts-1/wal/instance
I20260811 16:41:26.093848 25279 external_mini_cluster.cc:1428] Setting key 4676ada22b3bc940534ac90431aec8ee
I20260811 16:41:26.094811 22382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:26.086404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:45441 (local address 127.24.175.254:45649)
0811 16:41:26.086466 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:26.086468 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:26.086649 (+ 181us) server_negotiation.cc:407] Connection header received
0811 16:41:26.087161 (+ 512us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:26.087162 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:26.087175 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:26.087238 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:41:26.088186 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:26.088694 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:26.089681 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:26.089886 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:26.089943 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:26.092025 (+ 2082us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:41:26.092027 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:41:26.092027 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:41:26.092034 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:41:26.093317 (+ 1283us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:41:26.093738 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:41:26.093738 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:41:26.093739 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:41:26.093795 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:41:26.094056 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:41:26.094057 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:41:26.094057 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:41:26.094235 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:41:26.094297 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:26.094616 (+ 319us) server_negotiation.cc:299] Negotiation successful
0811 16:41:26.094723 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 16:41:26.094887 22885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:26.086370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:45649 (local address 127.24.175.194:45441)
0811 16:41:26.086528 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:26.086564 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 16:41:26.087057 (+ 493us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:41:26.087317 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:41:26.087320 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:41:26.087890 (+ 570us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:41:26.088085 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:26.088090 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:26.088778 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:26.088779 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:26.089588 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:26.089591 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:26.089955 (+ 364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:26.089956 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:26.090079 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:26.090586 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:41:26.090595 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:41:26.091939 (+ 1344us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:41:26.093384 (+ 1445us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:41:26.093389 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:41:26.093392 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:41:26.093672 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:41:26.093854 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:41:26.093855 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:41:26.093855 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:41:26.093988 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:41:26.094299 (+ 311us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:41:26.094306 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:41:26.094449 (+ 143us) client_negotiation.cc:769] Sending connection context
0811 16:41:26.094562 (+ 113us) client_negotiation.cc:240] Negotiation successful
0811 16:41:26.094707 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":78,"threads_started":1}
I20260811 16:41:26.095362 22883 heartbeater.cc:347] Connected to a master server at 127.24.175.254:45649
I20260811 16:41:26.095453 22883 heartbeater.cc:464] Registering TS with master...
I20260811 16:41:26.095626 22883 heartbeater.cc:511] Master 127.24.175.254:45649 requested a full tablet report, sending...
I20260811 16:41:26.095995 22316 ts_manager.cc:194] Registered new tserver with Master: 4720b9e700ae41b486cb1270a418fd83 (127.24.175.194:38669)
I20260811 16:41:26.096448 22316 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.175.194@KRBTEST.COM'} at 127.24.175.194:45441
WARNING: no policy specified for kudu/127.24.175.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab.
Entry for principal kudu/127.24.175.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab.
I20260811 16:41:26.120630 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.195:0
--local_ip_for_outbound_sockets=127.24.175.195
--webserver_interface=127.24.175.195
--webserver_port=0
--tserver_master_addrs=127.24.175.254:45649
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab
--principal=kudu/127.24.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:45629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:41:26.205940 22888 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:41:26.206144 22888 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:41:26.206185 22888 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:41:26.207358 22888 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:41:26.207401 22888 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:41:26.207428 22888 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.195
I20260811 16:41:26.208899 22888 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:45629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab
--principal=kudu/127.24.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.175.195
--webserver_port=0
--tserver_master_addrs=127.24.175.254:45649
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22888
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.195
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:41:26.209126 22888 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:41:26.209334 22888 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:41:26.214316 22902 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:41:26.214306 22899 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:26.214507 22888 server_base.cc:1034] running on GCE node
W20260811 16:41:26.214594 22900 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:26.214797 22888 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:41:26.215022 22888 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:41:26.216162 22888 hybrid_clock.cc:648] HybridClock initialized: now 1786466486216155 us; error 27 us; skew 500 ppm
Aug 11 16:41:26 dist-test-slave-zj8q krb5kdc[22240](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466486, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:41:26.218564 22888 init.cc:377] Logged in from keytab as kudu/127.24.175.195@KRBTEST.COM (short username kudu)
I20260811 16:41:26.218982 22888 webserver.cc:460] Webserver started at http://127.24.175.195:36239/ using document root <none> and password file <none>
I20260811 16:41:26.219180 22888 fs_manager.cc:359] Metadata directory not provided
I20260811 16:41:26.219224 22888 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:41:26.219340 22888 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:41:26.220369 22888 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/ts-2/data/instance:
uuid: "dd3579a0c4d843a1b3e3c62e1c67b58c"
format_stamp: "Formatted at 2026-08-11 16:41:26 on dist-test-slave-zj8q"
server_key: "a937a99554d0771274076ceb883412b2"
server_key_iv: "15e6f362d7a8b123cdfdea20e6facc51"
server_key_version: "encryptionkey@0"
I20260811 16:41:26.220693 22888 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/ts-2/wal/instance:
uuid: "dd3579a0c4d843a1b3e3c62e1c67b58c"
format_stamp: "Formatted at 2026-08-11 16:41:26 on dist-test-slave-zj8q"
server_key: "a937a99554d0771274076ceb883412b2"
server_key_iv: "15e6f362d7a8b123cdfdea20e6facc51"
server_key_version: "encryptionkey@0"
I20260811 16:41:26.221906 22888 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 16:41:26.222646 22919 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:26.222786 22888 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:26.222872 22888 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/ts-2/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/ts-2/wal
uuid: "dd3579a0c4d843a1b3e3c62e1c67b58c"
format_stamp: "Formatted at 2026-08-11 16:41:26 on dist-test-slave-zj8q"
server_key: "a937a99554d0771274076ceb883412b2"
server_key_iv: "15e6f362d7a8b123cdfdea20e6facc51"
server_key_version: "encryptionkey@0"
I20260811 16:41:26.222939 22888 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:41:26.240741 22888 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:41:26.242717 22888 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:41:26.242846 22888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:41:26.243076 22888 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:41:26.243431 22888 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:41:26.243469 22888 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:26.243491 22888 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:41:26.243513 22888 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:26.249393 22888 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.195:42529
I20260811 16:41:26.249449 23110 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.195:42529 every 8 connection(s)
I20260811 16:41:26.249748 22888 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
Aug 11 16:41:26 dist-test-slave-zj8q krb5kdc[22240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466486, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.195@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:41:26.257531 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 22888
I20260811 16:41:26.257607 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/ts-2/wal/instance
I20260811 16:41:26.257808 25279 external_mini_cluster.cc:1428] Setting key 831d83bf7efa5d385e2d46c1a21e3898
I20260811 16:41:26.258670 22382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:26.250401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.195:42745 (local address 127.24.175.254:45649)
0811 16:41:26.250474 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:26.250477 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:26.250675 (+ 198us) server_negotiation.cc:407] Connection header received
0811 16:41:26.251166 (+ 491us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:26.251168 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:26.251178 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:26.251247 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:41:26.252117 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:26.252751 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:26.253726 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:26.253922 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:26.254005 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:26.256011 (+ 2006us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:41:26.256012 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:41:26.256013 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:41:26.256019 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:41:26.257284 (+ 1265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:41:26.257636 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:41:26.257638 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:41:26.257638 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:41:26.257716 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:41:26.257960 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:41:26.257961 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:41:26.257961 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:41:26.258098 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:41:26.258189 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:26.258500 (+ 311us) server_negotiation.cc:299] Negotiation successful
0811 16:41:26.258569 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 16:41:26.258863 23116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:26.250389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:45649 (local address 127.24.175.195:42745)
0811 16:41:26.250555 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:26.250592 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 16:41:26.251065 (+ 473us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:41:26.251298 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:41:26.251302 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:41:26.251850 (+ 548us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:41:26.252042 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:26.252047 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:26.252830 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:26.252831 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:26.253639 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:26.253642 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:26.254006 (+ 364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:26.254006 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:26.254123 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:26.254567 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:41:26.254576 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:41:26.255931 (+ 1355us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:41:26.257352 (+ 1421us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:41:26.257356 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:41:26.257358 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:41:26.257557 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:41:26.257777 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:41:26.257778 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:41:26.257778 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:41:26.257902 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:41:26.258194 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:41:26.258200 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:41:26.258364 (+ 164us) client_negotiation.cc:769] Sending connection context
0811 16:41:26.258479 (+ 115us) client_negotiation.cc:240] Negotiation successful
0811 16:41:26.258650 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":90,"threads_started":1}
I20260811 16:41:26.259277 23113 heartbeater.cc:347] Connected to a master server at 127.24.175.254:45649
I20260811 16:41:26.259371 23113 heartbeater.cc:464] Registering TS with master...
I20260811 16:41:26.259539 23113 heartbeater.cc:511] Master 127.24.175.254:45649 requested a full tablet report, sending...
I20260811 16:41:26.259892 22316 ts_manager.cc:194] Registered new tserver with Master: dd3579a0c4d843a1b3e3c62e1c67b58c (127.24.175.195:42529)
I20260811 16:41:26.260263 22316 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.175.195@KRBTEST.COM'} at 127.24.175.195:42745
I20260811 16:41:26.269428 25279 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 16:41:26.275838 22382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:26.270682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38112 (local address 127.24.175.254:45649)
0811 16:41:26.270754 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:26.270756 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:26.270818 (+ 62us) server_negotiation.cc:407] Connection header received
0811 16:41:26.270879 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:26.270879 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:26.270888 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:26.270922 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:41:26.271427 (+ 505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:26.271904 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:26.272552 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:26.272729 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:26.272769 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:26.273738 (+ 969us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:41:26.273740 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:41:26.273740 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:41:26.273745 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:41:26.274989 (+ 1244us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:41:26.275258 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:41:26.275258 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:41:26.275259 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:41:26.275303 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:41:26.275424 (+ 121us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:41:26.275424 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:41:26.275424 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:41:26.275549 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:41:26.275621 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:26.275692 (+ 71us) server_negotiation.cc:299] Negotiation successful
0811 16:41:26.275762 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 16:41:26.277141 22316 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38112:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:41:26.278782 22316 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:41:26.285281 23133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:26.281054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52008 (local address 127.24.175.193:36965)
0811 16:41:26.281402 (+ 348us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:26.281405 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:26.281415 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:41:26.281453 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:26.281455 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:26.281467 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:26.281552 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:41:26.281738 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:26.282863 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:26.284162 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:26.284913 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:26.284992 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:26.285047 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:26.285183 (+ 136us) server_negotiation.cc:299] Negotiation successful
0811 16:41:26.285218 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":311,"thread_start_us":81,"threads_started":1}
I20260811 16:41:26.285307 23131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:26.280940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.194:38669 (local address 127.0.0.1:38828)
0811 16:41:26.281240 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:26.281281 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 16:41:26.281344 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:41:26.282399 (+ 1055us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:41:26.282399 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:41:26.282401 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:41:26.282437 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:26.282438 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:26.283440 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:26.283441 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:26.284395 (+ 954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:26.284397 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:26.285092 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:26.285093 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:26.285145 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:26.285148 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:41:26.285190 (+ 42us) client_negotiation.cc:240] Negotiation successful
0811 16:41:26.285222 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"mutex_wait_us":1,"thread_start_us":46,"threads_started":1}
I20260811 16:41:26.285439 23135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:26.281123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.195:42529 (local address 127.0.0.1:60554)
0811 16:41:26.281439 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:26.281446 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0811 16:41:26.281489 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:41:26.281633 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:41:26.281634 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:41:26.281635 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:41:26.281739 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:26.281742 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:26.283015 (+ 1273us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:26.283016 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:26.284130 (+ 1114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:26.284133 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:26.285255 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:26.285255 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:26.285307 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:26.285309 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 16:41:26.285353 (+ 44us) client_negotiation.cc:240] Negotiation successful
0811 16:41:26.285385 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":303,"thread_start_us":60,"threads_started":1}
I20260811 16:41:26.285566 23132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:26.280937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.193:36965 (local address 127.0.0.1:52008)
0811 16:41:26.281240 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:26.281281 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 16:41:26.281344 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:41:26.281560 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:41:26.281562 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:41:26.281564 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:41:26.281627 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:26.281628 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:26.282969 (+ 1341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:26.282969 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:26.284088 (+ 1119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:26.284091 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:26.284999 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:26.285000 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:26.285086 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:26.285100 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 16:41:26.285172 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 16:41:26.285222 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":270,"mutex_wait_us":38,"thread_start_us":87,"threads_started":1}
I20260811 16:41:26.285631 23134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:26.281040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38828 (local address 127.24.175.194:38669)
0811 16:41:26.282254 (+ 1214us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:26.282258 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:26.282267 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:41:26.282297 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:26.282299 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:26.282311 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:26.282380 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:41:26.282491 (+ 111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:26.283334 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:26.284463 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:26.284940 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:26.285004 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:26.285059 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:26.285488 (+ 429us) server_negotiation.cc:299] Negotiation successful
0811 16:41:26.285546 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1181,"thread_start_us":106,"threads_started":1}
I20260811 16:41:26.285800 23136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:26.281220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60554 (local address 127.24.175.195:42529)
0811 16:41:26.281368 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:26.281372 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:26.281498 (+ 126us) server_negotiation.cc:407] Connection header received
0811 16:41:26.281538 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:26.281540 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:26.281554 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:26.281625 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:41:26.281871 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:26.282935 (+ 1064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:26.284203 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:26.284919 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:26.284991 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:26.285047 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:26.285602 (+ 555us) server_negotiation.cc:299] Negotiation successful
0811 16:41:26.285724 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":68,"threads_started":1}
I20260811 16:41:26.286305 22767 tablet_service.cc:1467] Processing CreateTablet for tablet 4d527ea4e53a40b2a476201a26611903 (DEFAULT_TABLE table=test-table [id=830402fe16e84eb2b9e14f28f2d7d651]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:41:26.286614 22767 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d527ea4e53a40b2a476201a26611903. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:41:26.286751 22995 tablet_service.cc:1467] Processing CreateTablet for tablet 4d527ea4e53a40b2a476201a26611903 (DEFAULT_TABLE table=test-table [id=830402fe16e84eb2b9e14f28f2d7d651]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:41:26.286769 22539 tablet_service.cc:1467] Processing CreateTablet for tablet 4d527ea4e53a40b2a476201a26611903 (DEFAULT_TABLE table=test-table [id=830402fe16e84eb2b9e14f28f2d7d651]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:41:26.287091 22539 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d527ea4e53a40b2a476201a26611903. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:41:26.287091 22995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d527ea4e53a40b2a476201a26611903. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:41:26.288990 23139 tablet_bootstrap.cc:492] T 4d527ea4e53a40b2a476201a26611903 P 4720b9e700ae41b486cb1270a418fd83: Bootstrap starting.
I20260811 16:41:26.289583 23139 tablet_bootstrap.cc:654] T 4d527ea4e53a40b2a476201a26611903 P 4720b9e700ae41b486cb1270a418fd83: Neither blocks nor log segments found. Creating new log.
I20260811 16:41:26.289994 23139 log.cc:824] T 4d527ea4e53a40b2a476201a26611903 P 4720b9e700ae41b486cb1270a418fd83: Log is configured to *not* fsync() on all Append() calls
I20260811 16:41:26.290661 23139 tablet_bootstrap.cc:492] T 4d527ea4e53a40b2a476201a26611903 P 4720b9e700ae41b486cb1270a418fd83: No bootstrap required, opened a new log
I20260811 16:41:26.290720 23139 ts_tablet_manager.cc:1397] T 4d527ea4e53a40b2a476201a26611903 P 4720b9e700ae41b486cb1270a418fd83: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 16:41:26.290735 23141 tablet_bootstrap.cc:492] T 4d527ea4e53a40b2a476201a26611903 P dd3579a0c4d843a1b3e3c62e1c67b58c: Bootstrap starting.
I20260811 16:41:26.291268 23141 tablet_bootstrap.cc:654] T 4d527ea4e53a40b2a476201a26611903 P dd3579a0c4d843a1b3e3c62e1c67b58c: Neither blocks nor log segments found. Creating new log.
I20260811 16:41:26.291712 23141 log.cc:824] T 4d527ea4e53a40b2a476201a26611903 P dd3579a0c4d843a1b3e3c62e1c67b58c: Log is configured to *not* fsync() on all Append() calls
I20260811 16:41:26.292021 23142 tablet_bootstrap.cc:492] T 4d527ea4e53a40b2a476201a26611903 P 42c406988cea44cba8f8a7a7a6bb1066: Bootstrap starting.
I20260811 16:41:26.292076 23139 raft_consensus.cc:348] T 4d527ea4e53a40b2a476201a26611903 P 4720b9e700ae41b486cb1270a418fd83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4720b9e700ae41b486cb1270a418fd83" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38669 } } peers { permanent_uuid: "42c406988cea44cba8f8a7a7a6bb1066" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 36965 } } peers { permanent_uuid: "dd3579a0c4d843a1b3e3c62e1c67b58c" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42529 } }
I20260811 16:41:26.292236 23139 raft_consensus.cc:374] T 4d527ea4e53a40b2a476201a26611903 P 4720b9e700ae41b486cb1270a418fd83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:41:26.292281 23139 raft_consensus.cc:729] T 4d527ea4e53a40b2a476201a26611903 P 4720b9e700ae41b486cb1270a418fd83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4720b9e700ae41b486cb1270a418fd83, State: Initialized, Role: FOLLOWER
I20260811 16:41:26.292403 23141 tablet_bootstrap.cc:492] T 4d527ea4e53a40b2a476201a26611903 P dd3579a0c4d843a1b3e3c62e1c67b58c: No bootstrap required, opened a new log
I20260811 16:41:26.292394 23139 consensus_queue.cc:260] T 4d527ea4e53a40b2a476201a26611903 P 4720b9e700ae41b486cb1270a418fd83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4720b9e700ae41b486cb1270a418fd83" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38669 } } peers { permanent_uuid: "42c406988cea44cba8f8a7a7a6bb1066" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 36965 } } peers { permanent_uuid: "dd3579a0c4d843a1b3e3c62e1c67b58c" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42529 } }
I20260811 16:41:26.292464 23141 ts_tablet_manager.cc:1397] T 4d527ea4e53a40b2a476201a26611903 P dd3579a0c4d843a1b3e3c62e1c67b58c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 16:41:26.292681 23139 ts_tablet_manager.cc:1428] T 4d527ea4e53a40b2a476201a26611903 P 4720b9e700ae41b486cb1270a418fd83: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 16:41:26.292716 22883 heartbeater.cc:503] Master 127.24.175.254:45649 was elected leader, sending a full tablet report...
I20260811 16:41:26.294052 23141 raft_consensus.cc:348] T 4d527ea4e53a40b2a476201a26611903 P dd3579a0c4d843a1b3e3c62e1c67b58c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4720b9e700ae41b486cb1270a418fd83" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38669 } } peers { permanent_uuid: "42c406988cea44cba8f8a7a7a6bb1066" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 36965 } } peers { permanent_uuid: "dd3579a0c4d843a1b3e3c62e1c67b58c" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42529 } }
I20260811 16:41:26.294229 23141 raft_consensus.cc:374] T 4d527ea4e53a40b2a476201a26611903 P dd3579a0c4d843a1b3e3c62e1c67b58c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:41:26.294266 23141 raft_consensus.cc:729] T 4d527ea4e53a40b2a476201a26611903 P dd3579a0c4d843a1b3e3c62e1c67b58c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd3579a0c4d843a1b3e3c62e1c67b58c, State: Initialized, Role: FOLLOWER
I20260811 16:41:26.294349 23141 consensus_queue.cc:260] T 4d527ea4e53a40b2a476201a26611903 P dd3579a0c4d843a1b3e3c62e1c67b58c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4720b9e700ae41b486cb1270a418fd83" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38669 } } peers { permanent_uuid: "42c406988cea44cba8f8a7a7a6bb1066" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 36965 } } peers { permanent_uuid: "dd3579a0c4d843a1b3e3c62e1c67b58c" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42529 } }
I20260811 16:41:26.294576 23141 ts_tablet_manager.cc:1428] T 4d527ea4e53a40b2a476201a26611903 P dd3579a0c4d843a1b3e3c62e1c67b58c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:41:26.294739 23113 heartbeater.cc:503] Master 127.24.175.254:45649 was elected leader, sending a full tablet report...
I20260811 16:41:26.294754 23142 tablet_bootstrap.cc:654] T 4d527ea4e53a40b2a476201a26611903 P 42c406988cea44cba8f8a7a7a6bb1066: Neither blocks nor log segments found. Creating new log.
I20260811 16:41:26.295230 23142 log.cc:824] T 4d527ea4e53a40b2a476201a26611903 P 42c406988cea44cba8f8a7a7a6bb1066: Log is configured to *not* fsync() on all Append() calls
I20260811 16:41:26.295869 23142 tablet_bootstrap.cc:492] T 4d527ea4e53a40b2a476201a26611903 P 42c406988cea44cba8f8a7a7a6bb1066: No bootstrap required, opened a new log
I20260811 16:41:26.295928 23142 ts_tablet_manager.cc:1397] T 4d527ea4e53a40b2a476201a26611903 P 42c406988cea44cba8f8a7a7a6bb1066: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260811 16:41:26.297237 23142 raft_consensus.cc:348] T 4d527ea4e53a40b2a476201a26611903 P 42c406988cea44cba8f8a7a7a6bb1066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4720b9e700ae41b486cb1270a418fd83" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38669 } } peers { permanent_uuid: "42c406988cea44cba8f8a7a7a6bb1066" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 36965 } } peers { permanent_uuid: "dd3579a0c4d843a1b3e3c62e1c67b58c" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42529 } }
I20260811 16:41:26.297372 23142 raft_consensus.cc:374] T 4d527ea4e53a40b2a476201a26611903 P 42c406988cea44cba8f8a7a7a6bb1066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:41:26.297403 23142 raft_consensus.cc:729] T 4d527ea4e53a40b2a476201a26611903 P 42c406988cea44cba8f8a7a7a6bb1066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c406988cea44cba8f8a7a7a6bb1066, State: Initialized, Role: FOLLOWER
I20260811 16:41:26.297526 23142 consensus_queue.cc:260] T 4d527ea4e53a40b2a476201a26611903 P 42c406988cea44cba8f8a7a7a6bb1066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4720b9e700ae41b486cb1270a418fd83" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38669 } } peers { permanent_uuid: "42c406988cea44cba8f8a7a7a6bb1066" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 36965 } } peers { permanent_uuid: "dd3579a0c4d843a1b3e3c62e1c67b58c" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42529 } }
I20260811 16:41:26.297776 23142 ts_tablet_manager.cc:1428] T 4d527ea4e53a40b2a476201a26611903 P 42c406988cea44cba8f8a7a7a6bb1066: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:41:26.297840 22668 heartbeater.cc:503] Master 127.24.175.254:45649 was elected leader, sending a full tablet report...
W20260811 16:41:26.336303 22884 tablet.cc:2369] T 4d527ea4e53a40b2a476201a26611903 P 4720b9e700ae41b486cb1270a418fd83: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 16:41:26.424928 22670 tablet.cc:2369] T 4d527ea4e53a40b2a476201a26611903 P 42c406988cea44cba8f8a7a7a6bb1066: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:41:26.498308 23150 raft_consensus.cc:482] T 4d527ea4e53a40b2a476201a26611903 P 42c406988cea44cba8f8a7a7a6bb1066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:41:26.498437 23150 raft_consensus.cc:504] T 4d527ea4e53a40b2a476201a26611903 P 42c406988cea44cba8f8a7a7a6bb1066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4720b9e700ae41b486cb1270a418fd83" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38669 } } peers { permanent_uuid: "42c406988cea44cba8f8a7a7a6bb1066" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 36965 } } peers { permanent_uuid: "dd3579a0c4d843a1b3e3c62e1c67b58c" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42529 } }
I20260811 16:41:26.498977 23150 leader_election.cc:288] T 4d527ea4e53a40b2a476201a26611903 P 42c406988cea44cba8f8a7a7a6bb1066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4720b9e700ae41b486cb1270a418fd83 (127.24.175.194:38669), dd3579a0c4d843a1b3e3c62e1c67b58c (127.24.175.195:42529)
W20260811 16:41:26.500288 23115 tablet.cc:2369] T 4d527ea4e53a40b2a476201a26611903 P dd3579a0c4d843a1b3e3c62e1c67b58c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:41:26.502684 23134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:26.499274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:41041 (local address 127.24.175.194:38669)
0811 16:41:26.499327 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:26.499329 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:26.499429 (+ 100us) server_negotiation.cc:407] Connection header received
0811 16:41:26.499485 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:26.499487 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:26.499497 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:26.499544 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:41:26.499722 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:26.500286 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:26.501688 (+ 1402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:26.502296 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:26.502371 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:26.502380 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:26.502574 (+ 194us) server_negotiation.cc:299] Negotiation successful
0811 16:41:26.502612 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 16:41:26.502683 23136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:26.499346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:54321 (local address 127.24.175.195:42529)
0811 16:41:26.499394 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:26.499395 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:26.499407 (+ 12us) server_negotiation.cc:407] Connection header received
0811 16:41:26.499492 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:26.499493 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:26.499501 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:26.499593 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:41:26.499764 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:26.500230 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:26.501688 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:26.502296 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:26.502372 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:26.502380 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:26.502573 (+ 193us) server_negotiation.cc:299] Negotiation successful
0811 16:41:26.502614 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 16:41:26.502739 23152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:26.499183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.195:42529 (local address 127.24.175.193:54321)
0811 16:41:26.499352 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:26.499363 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:41:26.499425 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:41:26.499608 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:41:26.499609 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:41:26.499611 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:41:26.499703 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:26.499705 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:26.500298 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:26.500299 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:26.501599 (+ 1300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:26.501602 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:26.502398 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:26.502399 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:26.502499 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:26.502505 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 16:41:26.502566 (+ 61us) client_negotiation.cc:240] Negotiation successful
0811 16:41:26.502624 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"mutex_wait_us":56,"thread_start_us":84,"threads_started":1}
I20260811 16:41:26.502743 23153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:26.499182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.194:38669 (local address 127.24.175.193:41041)
0811 16:41:26.499359 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:26.499368 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:41:26.499430 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:41:26.499555 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:41:26.499556 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:41:26.499557 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:41:26.499658 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:26.499660 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:26.500358 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:26.500359 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:26.501600 (+ 1241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:26.501602 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:26.502397 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:26.502398 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:26.502494 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:26.502500 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 16:41:26.502566 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 16:41:26.502624 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"mutex_wait_us":40,"thread_start_us":78,"threads_started":1}
I20260811 16:41:26.503088 23027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d527ea4e53a40b2a476201a26611903" candidate_uuid: "42c406988cea44cba8f8a7a7a6bb1066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd3579a0c4d843a1b3e3c62e1c67b58c" is_pre_election: true
I20260811 16:41:26.503181 22806 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d527ea4e53a40b2a476201a26611903" candidate_uuid: "42c406988cea44cba8f8a7a7a6bb1066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4720b9e700ae41b486cb1270a418fd83" is_pre_election: true
I20260811 16:41:26.503252 23027 raft_consensus.cc:2454] T 4d527ea4e53a40b2a476201a26611903 P dd3579a0c4d843a1b3e3c62e1c67b58c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c406988cea44cba8f8a7a7a6bb1066 in term 0.
I20260811 16:41:26.503333 22806 raft_consensus.cc:2454] T 4d527ea4e53a40b2a476201a26611903 P 4720b9e700ae41b486cb1270a418fd83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c406988cea44cba8f8a7a7a6bb1066 in term 0.
I20260811 16:41:26.503479 22460 leader_election.cc:302] T 4d527ea4e53a40b2a476201a26611903 P 42c406988cea44cba8f8a7a7a6bb1066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c406988cea44cba8f8a7a7a6bb1066, dd3579a0c4d843a1b3e3c62e1c67b58c; no voters:
I20260811 16:41:26.503620 23150 raft_consensus.cc:2781] T 4d527ea4e53a40b2a476201a26611903 P 42c406988cea44cba8f8a7a7a6bb1066 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:41:26.503692 23150 raft_consensus.cc:482] T 4d527ea4e53a40b2a476201a26611903 P 42c406988cea44cba8f8a7a7a6bb1066 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:41:26.503710 23150 raft_consensus.cc:3037] T 4d527ea4e53a40b2a476201a26611903 P 42c406988cea44cba8f8a7a7a6bb1066 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:41:26.504432 23150 raft_consensus.cc:504] T 4d527ea4e53a40b2a476201a26611903 P 42c406988cea44cba8f8a7a7a6bb1066 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4720b9e700ae41b486cb1270a418fd83" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38669 } } peers { permanent_uuid: "42c406988cea44cba8f8a7a7a6bb1066" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 36965 } } peers { permanent_uuid: "dd3579a0c4d843a1b3e3c62e1c67b58c" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42529 } }
I20260811 16:41:26.504551 23150 leader_election.cc:288] T 4d527ea4e53a40b2a476201a26611903 P 42c406988cea44cba8f8a7a7a6bb1066 [CANDIDATE]: Term 1 election: Requested vote from peers 4720b9e700ae41b486cb1270a418fd83 (127.24.175.194:38669), dd3579a0c4d843a1b3e3c62e1c67b58c (127.24.175.195:42529)
I20260811 16:41:26.504711 23027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d527ea4e53a40b2a476201a26611903" candidate_uuid: "42c406988cea44cba8f8a7a7a6bb1066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd3579a0c4d843a1b3e3c62e1c67b58c"
I20260811 16:41:26.504763 22806 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d527ea4e53a40b2a476201a26611903" candidate_uuid: "42c406988cea44cba8f8a7a7a6bb1066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4720b9e700ae41b486cb1270a418fd83"
I20260811 16:41:26.504793 23027 raft_consensus.cc:3037] T 4d527ea4e53a40b2a476201a26611903 P dd3579a0c4d843a1b3e3c62e1c67b58c [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:41:26.504843 22806 raft_consensus.cc:3037] T 4d527ea4e53a40b2a476201a26611903 P 4720b9e700ae41b486cb1270a418fd83 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:41:26.505517 23027 raft_consensus.cc:2454] T 4d527ea4e53a40b2a476201a26611903 P dd3579a0c4d843a1b3e3c62e1c67b58c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c406988cea44cba8f8a7a7a6bb1066 in term 1.
I20260811 16:41:26.505584 22806 raft_consensus.cc:2454] T 4d527ea4e53a40b2a476201a26611903 P 4720b9e700ae41b486cb1270a418fd83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c406988cea44cba8f8a7a7a6bb1066 in term 1.
I20260811 16:41:26.505683 22460 leader_election.cc:302] T 4d527ea4e53a40b2a476201a26611903 P 42c406988cea44cba8f8a7a7a6bb1066 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c406988cea44cba8f8a7a7a6bb1066, dd3579a0c4d843a1b3e3c62e1c67b58c; no voters:
I20260811 16:41:26.505779 23150 raft_consensus.cc:2781] T 4d527ea4e53a40b2a476201a26611903 P 42c406988cea44cba8f8a7a7a6bb1066 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:41:26.505946 23150 raft_consensus.cc:686] T 4d527ea4e53a40b2a476201a26611903 P 42c406988cea44cba8f8a7a7a6bb1066 [term 1 LEADER]: Becoming Leader. State: Replica: 42c406988cea44cba8f8a7a7a6bb1066, State: Running, Role: LEADER
I20260811 16:41:26.506044 23150 consensus_queue.cc:237] T 4d527ea4e53a40b2a476201a26611903 P 42c406988cea44cba8f8a7a7a6bb1066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4720b9e700ae41b486cb1270a418fd83" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38669 } } peers { permanent_uuid: "42c406988cea44cba8f8a7a7a6bb1066" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 36965 } } peers { permanent_uuid: "dd3579a0c4d843a1b3e3c62e1c67b58c" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42529 } }
I20260811 16:41:26.506913 22316 catalog_manager.cc:5495] T 4d527ea4e53a40b2a476201a26611903 P 42c406988cea44cba8f8a7a7a6bb1066 reported cstate change: term changed from 0 to 1, leader changed from <none> to 42c406988cea44cba8f8a7a7a6bb1066 (127.24.175.193). New cstate: current_term: 1 leader_uuid: "42c406988cea44cba8f8a7a7a6bb1066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4720b9e700ae41b486cb1270a418fd83" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c406988cea44cba8f8a7a7a6bb1066" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 36965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd3579a0c4d843a1b3e3c62e1c67b58c" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42529 } health_report { overall_health: UNKNOWN } } }
I20260811 16:41:26.567529 23133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:26.565375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52022 (local address 127.24.175.193:36965)
0811 16:41:26.565423 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:26.565425 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:26.565448 (+ 23us) server_negotiation.cc:407] Connection header received
0811 16:41:26.565488 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:26.565488 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:26.565508 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:26.565572 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:41:26.565698 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:26.566190 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:26.566920 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:26.567096 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:26.567137 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:26.567284 (+ 147us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:41:26.567384 (+ 100us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:41:26.567439 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:26.567453 (+ 14us) server_negotiation.cc:299] Negotiation successful
0811 16:41:26.567469 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 16:41:26.569293 23027 raft_consensus.cc:1261] T 4d527ea4e53a40b2a476201a26611903 P dd3579a0c4d843a1b3e3c62e1c67b58c [term 1 FOLLOWER]: Refusing update from remote peer 42c406988cea44cba8f8a7a7a6bb1066: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:41:26.569293 22806 raft_consensus.cc:1261] T 4d527ea4e53a40b2a476201a26611903 P 4720b9e700ae41b486cb1270a418fd83 [term 1 FOLLOWER]: Refusing update from remote peer 42c406988cea44cba8f8a7a7a6bb1066: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:41:26.569664 23154 consensus_queue.cc:1035] T 4d527ea4e53a40b2a476201a26611903 P 42c406988cea44cba8f8a7a7a6bb1066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4720b9e700ae41b486cb1270a418fd83" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:41:26.569792 23150 consensus_queue.cc:1035] T 4d527ea4e53a40b2a476201a26611903 P 42c406988cea44cba8f8a7a7a6bb1066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd3579a0c4d843a1b3e3c62e1c67b58c" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 42529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:41:26.572604 23157 mvcc.cc:205] Tried to move back new op lower bound from 7317366728985264128 to 7317366728729473024. Current Snapshot: MvccSnapshot[applied={T|T < 7317366728985264128 or (T in {7317366728985264128})}]
I20260811 16:41:26.572639 23158 mvcc.cc:205] Tried to move back new op lower bound from 7317366728985264128 to 7317366728729473024. Current Snapshot: MvccSnapshot[applied={T|T < 7317366728985264128}]
I20260811 16:41:26.572713 23159 mvcc.cc:205] Tried to move back new op lower bound from 7317366728985264128 to 7317366728729473024. Current Snapshot: MvccSnapshot[applied={T|T < 7317366728985264128}]
I20260811 16:41:26.574628 22316 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38112:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:41:26.574723 22316 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38112:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:41:26.575420 22316 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b2b27726d16a44f8a388a17fe20a009b: Sending DeleteTablet for 3 replicas of tablet 4d527ea4e53a40b2a476201a26611903
I20260811 16:41:26.575724 22767 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d527ea4e53a40b2a476201a26611903 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:41:26 UTC) from {username='kudu', principal='kudu/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:38828
I20260811 16:41:26.575788 22995 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d527ea4e53a40b2a476201a26611903 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:41:26 UTC) from {username='kudu', principal='kudu/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:60554
I20260811 16:41:26.575992 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 22426
I20260811 16:41:26.576076 23171 tablet_replica.cc:330] T 4d527ea4e53a40b2a476201a26611903 P dd3579a0c4d843a1b3e3c62e1c67b58c: stopping tablet replica
I20260811 16:41:26.576207 23171 raft_consensus.cc:2229] T 4d527ea4e53a40b2a476201a26611903 P dd3579a0c4d843a1b3e3c62e1c67b58c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:41:26.576388 23171 raft_consensus.cc:2258] T 4d527ea4e53a40b2a476201a26611903 P dd3579a0c4d843a1b3e3c62e1c67b58c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:41:26.576685 23170 tablet_replica.cc:330] T 4d527ea4e53a40b2a476201a26611903 P 4720b9e700ae41b486cb1270a418fd83: stopping tablet replica
I20260811 16:41:26.576855 23170 raft_consensus.cc:2229] T 4d527ea4e53a40b2a476201a26611903 P 4720b9e700ae41b486cb1270a418fd83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:41:26.577033 23170 raft_consensus.cc:2258] T 4d527ea4e53a40b2a476201a26611903 P 4720b9e700ae41b486cb1270a418fd83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:41:26.579326 23171 ts_tablet_manager.cc:1905] T 4d527ea4e53a40b2a476201a26611903 P dd3579a0c4d843a1b3e3c62e1c67b58c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:41:26.580884 23171 ts_tablet_manager.cc:1918] T 4d527ea4e53a40b2a476201a26611903 P dd3579a0c4d843a1b3e3c62e1c67b58c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:41:26.580961 23171 log.cc:1196] T 4d527ea4e53a40b2a476201a26611903 P dd3579a0c4d843a1b3e3c62e1c67b58c: Deleting WAL directory at /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/ts-2/wal/wals/4d527ea4e53a40b2a476201a26611903
I20260811 16:41:26.581228 23171 ts_tablet_manager.cc:1939] T 4d527ea4e53a40b2a476201a26611903 P dd3579a0c4d843a1b3e3c62e1c67b58c: Deleting consensus metadata
I20260811 16:41:26.581645 22293 catalog_manager.cc:4841] TS dd3579a0c4d843a1b3e3c62e1c67b58c (127.24.175.195:42529): tablet 4d527ea4e53a40b2a476201a26611903 (table test-table [id=830402fe16e84eb2b9e14f28f2d7d651]) successfully deleted
I20260811 16:41:26.585142 23170 ts_tablet_manager.cc:1905] T 4d527ea4e53a40b2a476201a26611903 P 4720b9e700ae41b486cb1270a418fd83: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:41:26.586694 23170 ts_tablet_manager.cc:1918] T 4d527ea4e53a40b2a476201a26611903 P 4720b9e700ae41b486cb1270a418fd83: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:41:26.586769 23170 log.cc:1196] T 4d527ea4e53a40b2a476201a26611903 P 4720b9e700ae41b486cb1270a418fd83: Deleting WAL directory at /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466249441839-25279-0/minicluster-data/ts-1/wal/wals/4d527ea4e53a40b2a476201a26611903
I20260811 16:41:26.586983 23170 ts_tablet_manager.cc:1939] T 4d527ea4e53a40b2a476201a26611903 P 4720b9e700ae41b486cb1270a418fd83: Deleting consensus metadata
I20260811 16:41:26.587411 22289 catalog_manager.cc:4841] TS 4720b9e700ae41b486cb1270a418fd83 (127.24.175.194:38669): tablet 4d527ea4e53a40b2a476201a26611903 (table test-table [id=830402fe16e84eb2b9e14f28f2d7d651]) successfully deleted
W20260811 16:41:26.589773 22293 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.24.175.193:36965 (error 108)
I20260811 16:41:26.590044 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 22675
I20260811 16:41:26.594902 23135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:26.590203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.193:36965 (local address 127.0.0.1:52024)
0811 16:41:26.594803 (+ 4600us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:26.594866 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.193:36965: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":4574}
W20260811 16:41:26.595075 22293 catalog_manager.cc:4584] TS 42c406988cea44cba8f8a7a7a6bb1066 (127.24.175.193:36965): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4d527ea4e53a40b2a476201a26611903: Network error: Client connection negotiation failed: client connection to 127.24.175.193:36965: connect: Connection refused (error 111)
I20260811 16:41:26.603643 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 22888
I20260811 16:41:26.613858 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 22262
2026-08-11T16:41:26Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2286 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-11T16:41:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:41:26Z Disabled control of system clock
I20260811 16:41:26.647563 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:45275
--webserver_interface=127.24.175.254
--webserver_port=0
--builtin_ntp_servers=127.24.175.212:43573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.175.254:45275
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 16:41:26.727383 23178 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:41:26.727598 23178 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:41:26.727625 23178 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:41:26.728760 23178 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:41:26.728803 23178 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:41:26.728814 23178 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:41:26.728825 23178 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:41:26.728838 23178 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:41:26.730252 23178 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:43573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.175.254:45275
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:45275
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23178
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:41:26.730484 23178 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:41:26.730767 23178 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:41:26.735562 23192 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:26.735603 23178 server_base.cc:1034] running on GCE node
W20260811 16:41:26.735646 23187 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:41:26.735562 23189 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:26.736033 23178 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:41:26.736356 23178 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:41:26.737498 23178 hybrid_clock.cc:648] HybridClock initialized: now 1786466486737480 us; error 30 us; skew 500 ppm
I20260811 16:41:26.738791 23178 webserver.cc:460] Webserver started at http://127.24.175.254:43739/ using document root <none> and password file <none>
I20260811 16:41:26.739038 23178 fs_manager.cc:359] Metadata directory not provided
I20260811 16:41:26.739090 23178 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:41:26.739228 23178 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:41:26.740311 23178 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/master-0/data/instance:
uuid: "a5d491ed28824a54a94dd24debb1b914"
format_stamp: "Formatted at 2026-08-11 16:41:26 on dist-test-slave-zj8q"
server_key: "9994ed8c450d85afef6e5949b0fcc23f"
server_key_iv: "d42989ebce1b9a8af77312f893d0f904"
server_key_version: "encryptionkey@0"
I20260811 16:41:26.740648 23178 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/master-0/wal/instance:
uuid: "a5d491ed28824a54a94dd24debb1b914"
format_stamp: "Formatted at 2026-08-11 16:41:26 on dist-test-slave-zj8q"
server_key: "9994ed8c450d85afef6e5949b0fcc23f"
server_key_iv: "d42989ebce1b9a8af77312f893d0f904"
server_key_version: "encryptionkey@0"
I20260811 16:41:26.741858 23178 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 16:41:26.742571 23200 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:26.742733 23178 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:26.742821 23178 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/master-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/master-0/wal
uuid: "a5d491ed28824a54a94dd24debb1b914"
format_stamp: "Formatted at 2026-08-11 16:41:26 on dist-test-slave-zj8q"
server_key: "9994ed8c450d85afef6e5949b0fcc23f"
server_key_iv: "d42989ebce1b9a8af77312f893d0f904"
server_key_version: "encryptionkey@0"
I20260811 16:41:26.742885 23178 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:41:26.757642 23178 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:41:26.757952 23178 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:41:26.758085 23178 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:41:26.761822 23178 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.254:45275
I20260811 16:41:26.761854 23292 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.254:45275 every 8 connection(s)
I20260811 16:41:26.762185 23178 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
I20260811 16:41:26.763145 23293 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:41:26.765425 23293 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a5d491ed28824a54a94dd24debb1b914: Bootstrap starting.
I20260811 16:41:26.765976 23293 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a5d491ed28824a54a94dd24debb1b914: Neither blocks nor log segments found. Creating new log.
I20260811 16:41:26.766247 23293 log.cc:824] T 00000000000000000000000000000000 P a5d491ed28824a54a94dd24debb1b914: Log is configured to *not* fsync() on all Append() calls
I20260811 16:41:26.766888 23293 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a5d491ed28824a54a94dd24debb1b914: No bootstrap required, opened a new log
I20260811 16:41:26.768419 23293 raft_consensus.cc:348] T 00000000000000000000000000000000 P a5d491ed28824a54a94dd24debb1b914 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5d491ed28824a54a94dd24debb1b914" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 45275 } }
I20260811 16:41:26.768554 23293 raft_consensus.cc:374] T 00000000000000000000000000000000 P a5d491ed28824a54a94dd24debb1b914 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:41:26.768584 23293 raft_consensus.cc:729] T 00000000000000000000000000000000 P a5d491ed28824a54a94dd24debb1b914 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5d491ed28824a54a94dd24debb1b914, State: Initialized, Role: FOLLOWER
I20260811 16:41:26.768697 23293 consensus_queue.cc:260] T 00000000000000000000000000000000 P a5d491ed28824a54a94dd24debb1b914 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5d491ed28824a54a94dd24debb1b914" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 45275 } }
I20260811 16:41:26.768747 23293 raft_consensus.cc:388] T 00000000000000000000000000000000 P a5d491ed28824a54a94dd24debb1b914 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:41:26.768765 23293 raft_consensus.cc:482] T 00000000000000000000000000000000 P a5d491ed28824a54a94dd24debb1b914 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:41:26.768795 23293 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a5d491ed28824a54a94dd24debb1b914 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:41:26.769243 23293 raft_consensus.cc:504] T 00000000000000000000000000000000 P a5d491ed28824a54a94dd24debb1b914 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5d491ed28824a54a94dd24debb1b914" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 45275 } }
I20260811 16:41:26.769325 23293 leader_election.cc:302] T 00000000000000000000000000000000 P a5d491ed28824a54a94dd24debb1b914 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a5d491ed28824a54a94dd24debb1b914; no voters:
I20260811 16:41:26.769454 23293 leader_election.cc:288] T 00000000000000000000000000000000 P a5d491ed28824a54a94dd24debb1b914 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:41:26.769533 23300 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a5d491ed28824a54a94dd24debb1b914 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:41:26.769698 23293 sys_catalog.cc:564] T 00000000000000000000000000000000 P a5d491ed28824a54a94dd24debb1b914 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:41:26.769699 23300 raft_consensus.cc:686] T 00000000000000000000000000000000 P a5d491ed28824a54a94dd24debb1b914 [term 1 LEADER]: Becoming Leader. State: Replica: a5d491ed28824a54a94dd24debb1b914, State: Running, Role: LEADER
I20260811 16:41:26.769866 23300 consensus_queue.cc:237] T 00000000000000000000000000000000 P a5d491ed28824a54a94dd24debb1b914 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5d491ed28824a54a94dd24debb1b914" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 45275 } }
I20260811 16:41:26.770323 23301 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5d491ed28824a54a94dd24debb1b914 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a5d491ed28824a54a94dd24debb1b914" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5d491ed28824a54a94dd24debb1b914" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 45275 } } }
I20260811 16:41:26.770408 23301 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5d491ed28824a54a94dd24debb1b914 [sys.catalog]: This master's current role is: LEADER
I20260811 16:41:26.770606 23316 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:41:26.770814 23303 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5d491ed28824a54a94dd24debb1b914 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a5d491ed28824a54a94dd24debb1b914. Latest consensus state: current_term: 1 leader_uuid: "a5d491ed28824a54a94dd24debb1b914" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5d491ed28824a54a94dd24debb1b914" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 45275 } } }
I20260811 16:41:26.770900 23303 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5d491ed28824a54a94dd24debb1b914 [sys.catalog]: This master's current role is: LEADER
I20260811 16:41:26.771111 23316 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:41:26.771742 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 23178
I20260811 16:41:26.771842 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/master-0/wal/instance
I20260811 16:41:26.772028 25279 external_mini_cluster.cc:1428] Setting key b3bec7a66f27af85c54473639ad6e815
I20260811 16:41:26.772714 23316 catalog_manager.cc:1347] Generated new cluster ID: baf18c3f6a2f4d528438d573766ce5ac
I20260811 16:41:26.772766 23316 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:41:26.777850 23339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:26.772455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36200 (local address 127.24.175.254:45275)
0811 16:41:26.772634 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:26.772644 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:26.772678 (+ 34us) server_negotiation.cc:407] Connection header received
0811 16:41:26.772789 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:26.772796 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:26.772862 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:26.773000 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:41:26.773254 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:26.774615 (+ 1361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:26.775658 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:26.776297 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:26.776431 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:26.777053 (+ 622us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:41:26.777066 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:41:26.777066 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:41:26.777271 (+ 205us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:41:26.777314 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:41:26.777328 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:41:26.777395 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:26.777450 (+ 55us) server_negotiation.cc:299] Negotiation successful
0811 16:41:26.777639 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":108,"thread_start_us":83,"threads_started":1}
I20260811 16:41:26.784685 23316 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:41:26.785198 23316 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:41:26.793252 23316 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a5d491ed28824a54a94dd24debb1b914: Generated new TSK 0
I20260811 16:41:26.793437 23316 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:41:26.796692 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.193:0
--local_ip_for_outbound_sockets=127.24.175.193
--webserver_interface=127.24.175.193
--webserver_port=0
--tserver_master_addrs=127.24.175.254:45275
--builtin_ntp_servers=127.24.175.212:43573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 16:41:26.883451 23343 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:41:26.883648 23343 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:41:26.883669 23343 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:41:26.884799 23343 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:41:26.884841 23343 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:41:26.884866 23343 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.193
I20260811 16:41:26.886255 23343 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:43573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.175.193
--webserver_port=0
--tserver_master_addrs=127.24.175.254:45275
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23343
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.193
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:41:26.886489 23343 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:41:26.886787 23343 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:41:26.891736 23361 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:41:26.891705 23358 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:41:26.891690 23359 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:26.892148 23343 server_base.cc:1034] running on GCE node
I20260811 16:41:26.892369 23343 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:41:26.892601 23343 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:41:26.893750 23343 hybrid_clock.cc:648] HybridClock initialized: now 1786466486893735 us; error 32 us; skew 500 ppm
I20260811 16:41:26.895021 23343 webserver.cc:460] Webserver started at http://127.24.175.193:44221/ using document root <none> and password file <none>
I20260811 16:41:26.895284 23343 fs_manager.cc:359] Metadata directory not provided
I20260811 16:41:26.895330 23343 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:41:26.895449 23343 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:41:26.896482 23343 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/ts-0/data/instance:
uuid: "f55bfad7e0f748a3a448b650b28a8724"
format_stamp: "Formatted at 2026-08-11 16:41:26 on dist-test-slave-zj8q"
server_key: "3f27718f6902ba8e4d4b925cc4d2e816"
server_key_iv: "6737a738533e5c79528203cab1477a0e"
server_key_version: "encryptionkey@0"
I20260811 16:41:26.896806 23343 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/ts-0/wal/instance:
uuid: "f55bfad7e0f748a3a448b650b28a8724"
format_stamp: "Formatted at 2026-08-11 16:41:26 on dist-test-slave-zj8q"
server_key: "3f27718f6902ba8e4d4b925cc4d2e816"
server_key_iv: "6737a738533e5c79528203cab1477a0e"
server_key_version: "encryptionkey@0"
I20260811 16:41:26.898051 23343 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:41:26.898825 23373 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:26.899016 23343 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:41:26.899103 23343 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/ts-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/ts-0/wal
uuid: "f55bfad7e0f748a3a448b650b28a8724"
format_stamp: "Formatted at 2026-08-11 16:41:26 on dist-test-slave-zj8q"
server_key: "3f27718f6902ba8e4d4b925cc4d2e816"
server_key_iv: "6737a738533e5c79528203cab1477a0e"
server_key_version: "encryptionkey@0"
I20260811 16:41:26.899180 23343 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:41:26.914742 23343 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:41:26.915023 23343 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:41:26.915148 23343 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:41:26.915365 23343 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:41:26.915697 23343 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:41:26.915736 23343 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:26.915766 23343 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:41:26.915788 23343 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:26.921298 23343 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.193:37283
I20260811 16:41:26.921339 23555 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.193:37283 every 8 connection(s)
I20260811 16:41:26.921662 23343 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
I20260811 16:41:26.922960 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 23343
I20260811 16:41:26.923060 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/ts-0/wal/instance
I20260811 16:41:26.923265 25279 external_mini_cluster.cc:1428] Setting key 150d5ba5432890a46761b876eef8c23c
I20260811 16:41:26.924248 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.194:0
--local_ip_for_outbound_sockets=127.24.175.194
--webserver_interface=127.24.175.194
--webserver_port=0
--tserver_master_addrs=127.24.175.254:45275
--builtin_ntp_servers=127.24.175.212:43573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 16:41:26.927342 23339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:26.922389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:37339 (local address 127.24.175.254:45275)
0811 16:41:26.922443 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:26.922445 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:26.922701 (+ 256us) server_negotiation.cc:407] Connection header received
0811 16:41:26.923203 (+ 502us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:26.923205 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:26.923223 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:26.923307 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:41:26.924087 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:26.924742 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:26.925745 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:26.926026 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:26.926104 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:26.927054 (+ 950us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:41:26.927055 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:41:26.927055 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:41:26.927062 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:41:26.927076 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:41:26.927081 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:41:26.927123 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:26.927251 (+ 128us) server_negotiation.cc:299] Negotiation successful
0811 16:41:26.927282 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 16:41:26.927536 23564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:26.922372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:45275 (local address 127.24.175.193:37339)
0811 16:41:26.922551 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:26.922591 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 16:41:26.923092 (+ 501us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:41:26.923382 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:41:26.923387 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:41:26.923397 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:41:26.923997 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:26.924004 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:26.924830 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:26.924831 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:26.925638 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:26.925640 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:26.926124 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:26.926125 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:26.926326 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:26.926880 (+ 554us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 16:41:26.926880 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:41:26.926920 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 16:41:26.926949 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:41:26.927140 (+ 191us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:41:26.927145 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:41:26.927148 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:41:26.927225 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 16:41:26.927333 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":67,"threads_started":1}
I20260811 16:41:26.927977 23559 heartbeater.cc:347] Connected to a master server at 127.24.175.254:45275
I20260811 16:41:26.928074 23559 heartbeater.cc:464] Registering TS with master...
I20260811 16:41:26.928256 23559 heartbeater.cc:511] Master 127.24.175.254:45275 requested a full tablet report, sending...
I20260811 16:41:26.928797 23232 ts_manager.cc:194] Registered new tserver with Master: f55bfad7e0f748a3a448b650b28a8724 (127.24.175.193:37283)
I20260811 16:41:26.929430 23232 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.24.175.193:37339
W20260811 16:41:27.006592 23567 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:41:27.006855 23567 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:41:27.006889 23567 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:41:27.008041 23567 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:41:27.008081 23567 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:41:27.008114 23567 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.194
I20260811 16:41:27.009454 23567 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:43573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.175.194
--webserver_port=0
--tserver_master_addrs=127.24.175.254:45275
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23567
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.194
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:41:27.009683 23567 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:41:27.009960 23567 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:41:27.014899 23577 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:27.015074 23567 server_base.cc:1034] running on GCE node
W20260811 16:41:27.014865 23575 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:41:27.014866 23582 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:27.015353 23567 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:41:27.015585 23567 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:41:27.016733 23567 hybrid_clock.cc:648] HybridClock initialized: now 1786466487016722 us; error 29 us; skew 500 ppm
I20260811 16:41:27.017868 23567 webserver.cc:460] Webserver started at http://127.24.175.194:38341/ using document root <none> and password file <none>
I20260811 16:41:27.018107 23567 fs_manager.cc:359] Metadata directory not provided
I20260811 16:41:27.018178 23567 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:41:27.018333 23567 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:41:27.019372 23567 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/ts-1/data/instance:
uuid: "54e271f1da68464db5522e393b174a58"
format_stamp: "Formatted at 2026-08-11 16:41:27 on dist-test-slave-zj8q"
server_key: "69ca9a6db386947fa08de1f4f92131b2"
server_key_iv: "4bbfc2e1a8a4cb360a4db2433fe9d8a0"
server_key_version: "encryptionkey@0"
I20260811 16:41:27.019713 23567 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/ts-1/wal/instance:
uuid: "54e271f1da68464db5522e393b174a58"
format_stamp: "Formatted at 2026-08-11 16:41:27 on dist-test-slave-zj8q"
server_key: "69ca9a6db386947fa08de1f4f92131b2"
server_key_iv: "4bbfc2e1a8a4cb360a4db2433fe9d8a0"
server_key_version: "encryptionkey@0"
I20260811 16:41:27.020924 23567 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:41:27.021567 23591 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:27.021729 23567 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:41:27.021814 23567 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/ts-1/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/ts-1/wal
uuid: "54e271f1da68464db5522e393b174a58"
format_stamp: "Formatted at 2026-08-11 16:41:27 on dist-test-slave-zj8q"
server_key: "69ca9a6db386947fa08de1f4f92131b2"
server_key_iv: "4bbfc2e1a8a4cb360a4db2433fe9d8a0"
server_key_version: "encryptionkey@0"
I20260811 16:41:27.021884 23567 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:41:27.051779 23567 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:41:27.052124 23567 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:41:27.052273 23567 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:41:27.052517 23567 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:41:27.052865 23567 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:41:27.052899 23567 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:27.052930 23567 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:41:27.052948 23567 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:27.058583 23567 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.194:43201
I20260811 16:41:27.058648 23778 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.194:43201 every 8 connection(s)
I20260811 16:41:27.058982 23567 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
I20260811 16:41:27.060653 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 23567
I20260811 16:41:27.060757 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/ts-1/wal/instance
I20260811 16:41:27.060948 25279 external_mini_cluster.cc:1428] Setting key 43e0b04799acbe558aa7cbded30b1b98
I20260811 16:41:27.061913 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.195:0
--local_ip_for_outbound_sockets=127.24.175.195
--webserver_interface=127.24.175.195
--webserver_port=0
--tserver_master_addrs=127.24.175.254:45275
--builtin_ntp_servers=127.24.175.212:43573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 16:41:27.064656 23339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:27.059688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:58193 (local address 127.24.175.254:45275)
0811 16:41:27.059743 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:27.059745 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:27.060004 (+ 259us) server_negotiation.cc:407] Connection header received
0811 16:41:27.060481 (+ 477us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:27.060482 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:27.060496 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:27.060572 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:41:27.061338 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:27.061938 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:27.063296 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:27.063493 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:27.063550 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:27.064394 (+ 844us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:41:27.064395 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:41:27.064395 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:41:27.064400 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:41:27.064416 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:41:27.064420 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:41:27.064465 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:27.064541 (+ 76us) server_negotiation.cc:299] Negotiation successful
0811 16:41:27.064572 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 16:41:27.064886 23781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:27.059663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:45275 (local address 127.24.175.194:58193)
0811 16:41:27.059853 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:27.059895 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 16:41:27.060377 (+ 482us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:41:27.060637 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:41:27.060641 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:41:27.060650 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:41:27.061238 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:27.061246 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:27.062053 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:27.062054 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:27.063210 (+ 1156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:27.063214 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:27.063580 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:27.063581 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:27.063738 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:27.064258 (+ 520us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 16:41:27.064258 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:41:27.064289 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 16:41:27.064313 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:41:27.064473 (+ 160us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:41:27.064478 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:41:27.064481 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:41:27.064540 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 16:41:27.064659 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":74,"threads_started":1}
I20260811 16:41:27.065347 23779 heartbeater.cc:347] Connected to a master server at 127.24.175.254:45275
I20260811 16:41:27.065440 23779 heartbeater.cc:464] Registering TS with master...
I20260811 16:41:27.065639 23779 heartbeater.cc:511] Master 127.24.175.254:45275 requested a full tablet report, sending...
I20260811 16:41:27.066013 23232 ts_manager.cc:194] Registered new tserver with Master: 54e271f1da68464db5522e393b174a58 (127.24.175.194:43201)
I20260811 16:41:27.066521 23232 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.24.175.194:58193
W20260811 16:41:27.147092 23782 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:41:27.147300 23782 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:41:27.147320 23782 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:41:27.148428 23782 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:41:27.148464 23782 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:41:27.148487 23782 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.195
I20260811 16:41:27.149799 23782 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:43573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.175.195
--webserver_port=0
--tserver_master_addrs=127.24.175.254:45275
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23782
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.195
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:41:27.149984 23782 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:41:27.150285 23782 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:41:27.155290 23790 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:27.155378 23782 server_base.cc:1034] running on GCE node
W20260811 16:41:27.155284 23791 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:41:27.155290 23797 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:27.155669 23782 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:41:27.155893 23782 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:41:27.157054 23782 hybrid_clock.cc:648] HybridClock initialized: now 1786466487157043 us; error 30 us; skew 500 ppm
I20260811 16:41:27.158373 23782 webserver.cc:460] Webserver started at http://127.24.175.195:44129/ using document root <none> and password file <none>
I20260811 16:41:27.158608 23782 fs_manager.cc:359] Metadata directory not provided
I20260811 16:41:27.158663 23782 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:41:27.158797 23782 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:41:27.159869 23782 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/ts-2/data/instance:
uuid: "d9f030761982437e849655bafbd4769b"
format_stamp: "Formatted at 2026-08-11 16:41:27 on dist-test-slave-zj8q"
server_key: "c34662fc995980c330fa7157749e7153"
server_key_iv: "1c99e59c9c1d502000de047b65db7e6e"
server_key_version: "encryptionkey@0"
I20260811 16:41:27.160229 23782 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/ts-2/wal/instance:
uuid: "d9f030761982437e849655bafbd4769b"
format_stamp: "Formatted at 2026-08-11 16:41:27 on dist-test-slave-zj8q"
server_key: "c34662fc995980c330fa7157749e7153"
server_key_iv: "1c99e59c9c1d502000de047b65db7e6e"
server_key_version: "encryptionkey@0"
I20260811 16:41:27.161499 23782 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:41:27.162223 23817 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:27.162375 23782 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:41:27.162464 23782 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/ts-2/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/ts-2/wal
uuid: "d9f030761982437e849655bafbd4769b"
format_stamp: "Formatted at 2026-08-11 16:41:27 on dist-test-slave-zj8q"
server_key: "c34662fc995980c330fa7157749e7153"
server_key_iv: "1c99e59c9c1d502000de047b65db7e6e"
server_key_version: "encryptionkey@0"
I20260811 16:41:27.162533 23782 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:41:27.184229 23782 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:41:27.184553 23782 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:41:27.184689 23782 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:41:27.184921 23782 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:41:27.185281 23782 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:41:27.185316 23782 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:27.185346 23782 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:41:27.185384 23782 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:27.191082 23782 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.195:38335
I20260811 16:41:27.191139 24007 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.195:38335 every 8 connection(s)
I20260811 16:41:27.191470 23782 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
I20260811 16:41:27.196285 23339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:27.192161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.195:40621 (local address 127.24.175.254:45275)
0811 16:41:27.192212 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:27.192214 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:27.192456 (+ 242us) server_negotiation.cc:407] Connection header received
0811 16:41:27.192949 (+ 493us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:27.192951 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:27.192962 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:27.193024 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:41:27.193687 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:27.194215 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:27.195141 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:27.195331 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:27.195384 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:27.196076 (+ 692us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:41:27.196078 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:41:27.196078 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:41:27.196082 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:41:27.196098 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:41:27.196103 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:41:27.196141 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:27.196201 (+ 60us) server_negotiation.cc:299] Negotiation successful
0811 16:41:27.196226 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 16:41:27.196480 24012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:27.192132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:45275 (local address 127.24.175.195:40621)
0811 16:41:27.192330 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:27.192372 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 16:41:27.192856 (+ 484us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:41:27.193090 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:41:27.193094 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:41:27.193103 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:41:27.193613 (+ 510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:27.193618 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:27.194281 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:27.194281 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:27.195061 (+ 780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:27.195063 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:27.195393 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:27.195394 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:27.195501 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:27.195952 (+ 451us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 16:41:27.195952 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:41:27.195981 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 16:41:27.196003 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:41:27.196146 (+ 143us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:41:27.196149 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:41:27.196151 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 16:41:27.196195 (+ 44us) client_negotiation.cc:240] Negotiation successful
0811 16:41:27.196280 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":81,"threads_started":1}
I20260811 16:41:27.196900 24008 heartbeater.cc:347] Connected to a master server at 127.24.175.254:45275
I20260811 16:41:27.196986 24008 heartbeater.cc:464] Registering TS with master...
I20260811 16:41:27.197134 24008 heartbeater.cc:511] Master 127.24.175.254:45275 requested a full tablet report, sending...
I20260811 16:41:27.197464 23232 ts_manager.cc:194] Registered new tserver with Master: d9f030761982437e849655bafbd4769b (127.24.175.195:38335)
I20260811 16:41:27.197793 23232 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.24.175.195:40621
I20260811 16:41:27.198581 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 23782
I20260811 16:41:27.198702 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/ts-2/wal/instance
I20260811 16:41:27.198884 25279 external_mini_cluster.cc:1428] Setting key e96c48d6b373aae91ad05b7d5eb45b79
I20260811 16:41:27.199787 25279 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 16:41:27.203821 23339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:27.201070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36206 (local address 127.24.175.254:45275)
0811 16:41:27.201108 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:27.201110 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:27.201239 (+ 129us) server_negotiation.cc:407] Connection header received
0811 16:41:27.201299 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:27.201301 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:27.201312 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:27.201353 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:41:27.201512 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:27.202033 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:27.202788 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:27.202986 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:27.203038 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:27.203588 (+ 550us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:41:27.203590 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:41:27.203590 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:41:27.203602 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:41:27.203615 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:41:27.203619 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:41:27.203664 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:27.203720 (+ 56us) server_negotiation.cc:299] Negotiation successful
0811 16:41:27.203745 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 16:41:27.205142 23232 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36206:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:41:27.206789 23232 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:41:27.212311 24027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:27.208827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.195:38335 (local address 127.0.0.1:38212)
0811 16:41:27.209237 (+ 410us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:27.209247 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:41:27.209291 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:41:27.209452 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:41:27.209452 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:41:27.209454 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:41:27.209522 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:27.209523 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:27.210460 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:27.210462 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:27.211260 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:27.211262 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:27.212026 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:27.212027 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:27.212109 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:27.212123 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 16:41:27.212186 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 16:41:27.212241 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":392,"mutex_wait_us":2,"spinlock_wait_cycles":896,"thread_start_us":115,"threads_started":1}
I20260811 16:41:27.212332 24035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:27.209096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38212 (local address 127.24.175.195:38335)
0811 16:41:27.209268 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:27.209273 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:27.209283 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:41:27.209353 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:27.209355 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:27.209369 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:27.209438 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:41:27.209586 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:27.210381 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:27.211344 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:27.211954 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:27.212015 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:27.212103 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:27.212198 (+ 95us) server_negotiation.cc:299] Negotiation successful
0811 16:41:27.212235 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":92,"threads_started":1}
I20260811 16:41:27.213029 24025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:27.208827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.194:43201 (local address 127.0.0.1:35578)
0811 16:41:27.208964 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:27.209005 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 16:41:27.209069 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:41:27.209447 (+ 378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:41:27.209451 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:41:27.209452 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:41:27.209522 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:27.209525 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:27.210888 (+ 1363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:27.210889 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:27.211949 (+ 1060us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:27.211951 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:27.212834 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:27.212835 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:27.212893 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:27.212897 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:41:27.212925 (+ 28us) client_negotiation.cc:240] Negotiation successful
0811 16:41:27.212961 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"mutex_wait_us":4,"thread_start_us":89,"threads_started":1}
I20260811 16:41:27.212942 23901 tablet_service.cc:1467] Processing CreateTablet for tablet b184961980b84a49b3b373b4cb076139 (DEFAULT_TABLE table=test-table [id=578750dc11ff4c38945a03e442d51952]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:41:27.213301 23901 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b184961980b84a49b3b373b4cb076139. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:41:27.213433 24036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:27.209107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35578 (local address 127.24.175.194:43201)
0811 16:41:27.209287 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:27.209292 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:27.209304 (+ 12us) server_negotiation.cc:407] Connection header received
0811 16:41:27.209343 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:27.209346 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:27.209361 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:27.209436 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:41:27.209636 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:27.210790 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:27.212046 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:27.212742 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:27.213200 (+ 458us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:27.213293 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:27.213316 (+ 23us) server_negotiation.cc:299] Negotiation successful
0811 16:41:27.213354 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":79,"threads_started":1}
I20260811 16:41:27.214035 24029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:27.208833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.193:37283 (local address 127.0.0.1:33520)
0811 16:41:27.209275 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:27.209286 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:41:27.209339 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:41:27.210072 (+ 733us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:41:27.210073 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:41:27.210075 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:41:27.210135 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:27.210136 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:27.211578 (+ 1442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:27.211579 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:27.212895 (+ 1316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:27.212897 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:27.213792 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:27.213794 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:27.213857 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:27.213862 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 16:41:27.213926 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 16:41:27.213969 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":424,"thread_start_us":92,"threads_started":1}
I20260811 16:41:27.214063 24033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:27.209028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33520 (local address 127.24.175.193:37283)
0811 16:41:27.209573 (+ 545us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:27.209577 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:27.209586 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:41:27.209624 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:27.209626 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:27.209640 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:27.209975 (+ 335us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:41:27.210237 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:27.211336 (+ 1099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:27.212981 (+ 1645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:27.213705 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:27.213777 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:27.213854 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:27.213939 (+ 85us) server_negotiation.cc:299] Negotiation successful
0811 16:41:27.213975 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":499,"thread_start_us":97,"threads_started":1}
I20260811 16:41:27.214102 23681 tablet_service.cc:1467] Processing CreateTablet for tablet b184961980b84a49b3b373b4cb076139 (DEFAULT_TABLE table=test-table [id=578750dc11ff4c38945a03e442d51952]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:41:27.214455 23681 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b184961980b84a49b3b373b4cb076139. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:41:27.215013 23454 tablet_service.cc:1467] Processing CreateTablet for tablet b184961980b84a49b3b373b4cb076139 (DEFAULT_TABLE table=test-table [id=578750dc11ff4c38945a03e442d51952]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:41:27.215361 23454 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b184961980b84a49b3b373b4cb076139. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:41:27.216373 24039 tablet_bootstrap.cc:492] T b184961980b84a49b3b373b4cb076139 P d9f030761982437e849655bafbd4769b: Bootstrap starting.
I20260811 16:41:27.217073 24039 tablet_bootstrap.cc:654] T b184961980b84a49b3b373b4cb076139 P d9f030761982437e849655bafbd4769b: Neither blocks nor log segments found. Creating new log.
I20260811 16:41:27.217350 24039 log.cc:824] T b184961980b84a49b3b373b4cb076139 P d9f030761982437e849655bafbd4769b: Log is configured to *not* fsync() on all Append() calls
I20260811 16:41:27.217998 24039 tablet_bootstrap.cc:492] T b184961980b84a49b3b373b4cb076139 P d9f030761982437e849655bafbd4769b: No bootstrap required, opened a new log
I20260811 16:41:27.218060 24039 ts_tablet_manager.cc:1397] T b184961980b84a49b3b373b4cb076139 P d9f030761982437e849655bafbd4769b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 16:41:27.218506 24042 tablet_bootstrap.cc:492] T b184961980b84a49b3b373b4cb076139 P f55bfad7e0f748a3a448b650b28a8724: Bootstrap starting.
I20260811 16:41:27.219058 24042 tablet_bootstrap.cc:654] T b184961980b84a49b3b373b4cb076139 P f55bfad7e0f748a3a448b650b28a8724: Neither blocks nor log segments found. Creating new log.
I20260811 16:41:27.219319 24042 log.cc:824] T b184961980b84a49b3b373b4cb076139 P f55bfad7e0f748a3a448b650b28a8724: Log is configured to *not* fsync() on all Append() calls
I20260811 16:41:27.219944 24042 tablet_bootstrap.cc:492] T b184961980b84a49b3b373b4cb076139 P f55bfad7e0f748a3a448b650b28a8724: No bootstrap required, opened a new log
I20260811 16:41:27.220003 24042 ts_tablet_manager.cc:1397] T b184961980b84a49b3b373b4cb076139 P f55bfad7e0f748a3a448b650b28a8724: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 16:41:27.220058 24039 raft_consensus.cc:348] T b184961980b84a49b3b373b4cb076139 P d9f030761982437e849655bafbd4769b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e271f1da68464db5522e393b174a58" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 43201 } } peers { permanent_uuid: "f55bfad7e0f748a3a448b650b28a8724" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 37283 } } peers { permanent_uuid: "d9f030761982437e849655bafbd4769b" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 38335 } }
I20260811 16:41:27.220199 24039 raft_consensus.cc:374] T b184961980b84a49b3b373b4cb076139 P d9f030761982437e849655bafbd4769b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:41:27.220225 24039 raft_consensus.cc:729] T b184961980b84a49b3b373b4cb076139 P d9f030761982437e849655bafbd4769b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9f030761982437e849655bafbd4769b, State: Initialized, Role: FOLLOWER
I20260811 16:41:27.220340 24039 consensus_queue.cc:260] T b184961980b84a49b3b373b4cb076139 P d9f030761982437e849655bafbd4769b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e271f1da68464db5522e393b174a58" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 43201 } } peers { permanent_uuid: "f55bfad7e0f748a3a448b650b28a8724" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 37283 } } peers { permanent_uuid: "d9f030761982437e849655bafbd4769b" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 38335 } }
I20260811 16:41:27.220583 24039 ts_tablet_manager.cc:1428] T b184961980b84a49b3b373b4cb076139 P d9f030761982437e849655bafbd4769b: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260811 16:41:27.220651 24008 heartbeater.cc:503] Master 127.24.175.254:45275 was elected leader, sending a full tablet report...
I20260811 16:41:27.220669 24041 tablet_bootstrap.cc:492] T b184961980b84a49b3b373b4cb076139 P 54e271f1da68464db5522e393b174a58: Bootstrap starting.
I20260811 16:41:27.221433 24041 tablet_bootstrap.cc:654] T b184961980b84a49b3b373b4cb076139 P 54e271f1da68464db5522e393b174a58: Neither blocks nor log segments found. Creating new log.
I20260811 16:41:27.221729 24041 log.cc:824] T b184961980b84a49b3b373b4cb076139 P 54e271f1da68464db5522e393b174a58: Log is configured to *not* fsync() on all Append() calls
I20260811 16:41:27.222213 24042 raft_consensus.cc:348] T b184961980b84a49b3b373b4cb076139 P f55bfad7e0f748a3a448b650b28a8724 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e271f1da68464db5522e393b174a58" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 43201 } } peers { permanent_uuid: "f55bfad7e0f748a3a448b650b28a8724" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 37283 } } peers { permanent_uuid: "d9f030761982437e849655bafbd4769b" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 38335 } }
I20260811 16:41:27.222340 24042 raft_consensus.cc:374] T b184961980b84a49b3b373b4cb076139 P f55bfad7e0f748a3a448b650b28a8724 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:41:27.222373 24042 raft_consensus.cc:729] T b184961980b84a49b3b373b4cb076139 P f55bfad7e0f748a3a448b650b28a8724 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f55bfad7e0f748a3a448b650b28a8724, State: Initialized, Role: FOLLOWER
I20260811 16:41:27.222440 24041 tablet_bootstrap.cc:492] T b184961980b84a49b3b373b4cb076139 P 54e271f1da68464db5522e393b174a58: No bootstrap required, opened a new log
I20260811 16:41:27.222500 24041 ts_tablet_manager.cc:1397] T b184961980b84a49b3b373b4cb076139 P 54e271f1da68464db5522e393b174a58: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260811 16:41:27.222477 24042 consensus_queue.cc:260] T b184961980b84a49b3b373b4cb076139 P f55bfad7e0f748a3a448b650b28a8724 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e271f1da68464db5522e393b174a58" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 43201 } } peers { permanent_uuid: "f55bfad7e0f748a3a448b650b28a8724" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 37283 } } peers { permanent_uuid: "d9f030761982437e849655bafbd4769b" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 38335 } }
I20260811 16:41:27.222738 24042 ts_tablet_manager.cc:1428] T b184961980b84a49b3b373b4cb076139 P f55bfad7e0f748a3a448b650b28a8724: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 16:41:27.222757 23559 heartbeater.cc:503] Master 127.24.175.254:45275 was elected leader, sending a full tablet report...
I20260811 16:41:27.224515 24041 raft_consensus.cc:348] T b184961980b84a49b3b373b4cb076139 P 54e271f1da68464db5522e393b174a58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e271f1da68464db5522e393b174a58" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 43201 } } peers { permanent_uuid: "f55bfad7e0f748a3a448b650b28a8724" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 37283 } } peers { permanent_uuid: "d9f030761982437e849655bafbd4769b" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 38335 } }
I20260811 16:41:27.224642 24041 raft_consensus.cc:374] T b184961980b84a49b3b373b4cb076139 P 54e271f1da68464db5522e393b174a58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:41:27.224673 24041 raft_consensus.cc:729] T b184961980b84a49b3b373b4cb076139 P 54e271f1da68464db5522e393b174a58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54e271f1da68464db5522e393b174a58, State: Initialized, Role: FOLLOWER
I20260811 16:41:27.224774 24041 consensus_queue.cc:260] T b184961980b84a49b3b373b4cb076139 P 54e271f1da68464db5522e393b174a58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e271f1da68464db5522e393b174a58" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 43201 } } peers { permanent_uuid: "f55bfad7e0f748a3a448b650b28a8724" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 37283 } } peers { permanent_uuid: "d9f030761982437e849655bafbd4769b" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 38335 } }
I20260811 16:41:27.224985 24041 ts_tablet_manager.cc:1428] T b184961980b84a49b3b373b4cb076139 P 54e271f1da68464db5522e393b174a58: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 16:41:27.225070 23779 heartbeater.cc:503] Master 127.24.175.254:45275 was elected leader, sending a full tablet report...
I20260811 16:41:27.268921 24050 raft_consensus.cc:482] T b184961980b84a49b3b373b4cb076139 P f55bfad7e0f748a3a448b650b28a8724 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:41:27.269048 24050 raft_consensus.cc:504] T b184961980b84a49b3b373b4cb076139 P f55bfad7e0f748a3a448b650b28a8724 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e271f1da68464db5522e393b174a58" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 43201 } } peers { permanent_uuid: "f55bfad7e0f748a3a448b650b28a8724" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 37283 } } peers { permanent_uuid: "d9f030761982437e849655bafbd4769b" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 38335 } }
I20260811 16:41:27.269412 24050 leader_election.cc:288] T b184961980b84a49b3b373b4cb076139 P f55bfad7e0f748a3a448b650b28a8724 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54e271f1da68464db5522e393b174a58 (127.24.175.194:43201), d9f030761982437e849655bafbd4769b (127.24.175.195:38335)
I20260811 16:41:27.272259 23564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:27.269556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.194:43201 (local address 127.24.175.193:48349)
0811 16:41:27.269610 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:27.269621 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:41:27.269659 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:41:27.269788 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:41:27.269789 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:41:27.269791 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:41:27.269875 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:27.269877 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:27.270580 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:27.270581 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:27.271518 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:27.271521 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:27.272027 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:27.272028 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:27.272094 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:27.272098 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:41:27.272143 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 16:41:27.272184 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36,"mutex_wait_us":45}
I20260811 16:41:27.272258 24036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:27.269617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:48349 (local address 127.24.175.194:43201)
0811 16:41:27.269664 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:27.269666 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:27.269677 (+ 11us) server_negotiation.cc:407] Connection header received
0811 16:41:27.269708 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:27.269709 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:27.269720 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:27.269778 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:41:27.269944 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:27.270512 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:27.271599 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:27.271952 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:27.272013 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:27.272023 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:27.272155 (+ 132us) server_negotiation.cc:299] Negotiation successful
0811 16:41:27.272193 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 16:41:27.272502 24052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:27.269582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.195:38335 (local address 127.24.175.193:45573)
0811 16:41:27.269766 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:27.269774 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 16:41:27.269819 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:41:27.269964 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:41:27.269966 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:41:27.269968 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:41:27.270040 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:27.270041 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:27.270744 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:27.270745 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:27.271707 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:27.271710 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:27.272237 (+ 527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:27.272239 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:27.272312 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:27.272316 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:41:27.272368 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 16:41:27.272412 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":97,"threads_started":1}
I20260811 16:41:27.272625 23709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b184961980b84a49b3b373b4cb076139" candidate_uuid: "f55bfad7e0f748a3a448b650b28a8724" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e271f1da68464db5522e393b174a58" is_pre_election: true
I20260811 16:41:27.272677 24035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:27.269646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:45573 (local address 127.24.175.195:38335)
0811 16:41:27.269687 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:27.269689 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:27.269830 (+ 141us) server_negotiation.cc:407] Connection header received
0811 16:41:27.269862 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:27.269863 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:27.269870 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:27.269932 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:41:27.270098 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:27.270670 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:27.271794 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:27.272145 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:27.272205 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:27.272212 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:27.272550 (+ 338us) server_negotiation.cc:299] Negotiation successful
0811 16:41:27.272607 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 16:41:27.272799 23709 raft_consensus.cc:2454] T b184961980b84a49b3b373b4cb076139 P 54e271f1da68464db5522e393b174a58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f55bfad7e0f748a3a448b650b28a8724 in term 0.
I20260811 16:41:27.273048 23378 leader_election.cc:302] T b184961980b84a49b3b373b4cb076139 P f55bfad7e0f748a3a448b650b28a8724 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54e271f1da68464db5522e393b174a58, f55bfad7e0f748a3a448b650b28a8724; no voters:
I20260811 16:41:27.273190 23935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b184961980b84a49b3b373b4cb076139" candidate_uuid: "f55bfad7e0f748a3a448b650b28a8724" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9f030761982437e849655bafbd4769b" is_pre_election: true
I20260811 16:41:27.273224 24050 raft_consensus.cc:2781] T b184961980b84a49b3b373b4cb076139 P f55bfad7e0f748a3a448b650b28a8724 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:41:27.273283 24050 raft_consensus.cc:482] T b184961980b84a49b3b373b4cb076139 P f55bfad7e0f748a3a448b650b28a8724 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:41:27.273307 24050 raft_consensus.cc:3037] T b184961980b84a49b3b373b4cb076139 P f55bfad7e0f748a3a448b650b28a8724 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:41:27.273321 23935 raft_consensus.cc:2454] T b184961980b84a49b3b373b4cb076139 P d9f030761982437e849655bafbd4769b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f55bfad7e0f748a3a448b650b28a8724 in term 0.
I20260811 16:41:27.274084 24050 raft_consensus.cc:504] T b184961980b84a49b3b373b4cb076139 P f55bfad7e0f748a3a448b650b28a8724 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e271f1da68464db5522e393b174a58" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 43201 } } peers { permanent_uuid: "f55bfad7e0f748a3a448b650b28a8724" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 37283 } } peers { permanent_uuid: "d9f030761982437e849655bafbd4769b" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 38335 } }
I20260811 16:41:27.274243 24050 leader_election.cc:288] T b184961980b84a49b3b373b4cb076139 P f55bfad7e0f748a3a448b650b28a8724 [CANDIDATE]: Term 1 election: Requested vote from peers 54e271f1da68464db5522e393b174a58 (127.24.175.194:43201), d9f030761982437e849655bafbd4769b (127.24.175.195:38335)
I20260811 16:41:27.274380 23709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b184961980b84a49b3b373b4cb076139" candidate_uuid: "f55bfad7e0f748a3a448b650b28a8724" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54e271f1da68464db5522e393b174a58"
I20260811 16:41:27.274403 23935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b184961980b84a49b3b373b4cb076139" candidate_uuid: "f55bfad7e0f748a3a448b650b28a8724" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9f030761982437e849655bafbd4769b"
I20260811 16:41:27.274477 23935 raft_consensus.cc:3037] T b184961980b84a49b3b373b4cb076139 P d9f030761982437e849655bafbd4769b [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:41:27.274464 23709 raft_consensus.cc:3037] T b184961980b84a49b3b373b4cb076139 P 54e271f1da68464db5522e393b174a58 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:41:27.275197 23935 raft_consensus.cc:2454] T b184961980b84a49b3b373b4cb076139 P d9f030761982437e849655bafbd4769b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f55bfad7e0f748a3a448b650b28a8724 in term 1.
I20260811 16:41:27.275243 23709 raft_consensus.cc:2454] T b184961980b84a49b3b373b4cb076139 P 54e271f1da68464db5522e393b174a58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f55bfad7e0f748a3a448b650b28a8724 in term 1.
I20260811 16:41:27.275375 23376 leader_election.cc:302] T b184961980b84a49b3b373b4cb076139 P f55bfad7e0f748a3a448b650b28a8724 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d9f030761982437e849655bafbd4769b, f55bfad7e0f748a3a448b650b28a8724; no voters:
I20260811 16:41:27.275485 24050 raft_consensus.cc:2781] T b184961980b84a49b3b373b4cb076139 P f55bfad7e0f748a3a448b650b28a8724 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:41:27.275665 24050 raft_consensus.cc:686] T b184961980b84a49b3b373b4cb076139 P f55bfad7e0f748a3a448b650b28a8724 [term 1 LEADER]: Becoming Leader. State: Replica: f55bfad7e0f748a3a448b650b28a8724, State: Running, Role: LEADER
I20260811 16:41:27.275770 24050 consensus_queue.cc:237] T b184961980b84a49b3b373b4cb076139 P f55bfad7e0f748a3a448b650b28a8724 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e271f1da68464db5522e393b174a58" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 43201 } } peers { permanent_uuid: "f55bfad7e0f748a3a448b650b28a8724" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 37283 } } peers { permanent_uuid: "d9f030761982437e849655bafbd4769b" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 38335 } }
I20260811 16:41:27.276546 23232 catalog_manager.cc:5495] T b184961980b84a49b3b373b4cb076139 P f55bfad7e0f748a3a448b650b28a8724 reported cstate change: term changed from 0 to 1, leader changed from <none> to f55bfad7e0f748a3a448b650b28a8724 (127.24.175.193). New cstate: current_term: 1 leader_uuid: "f55bfad7e0f748a3a448b650b28a8724" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54e271f1da68464db5522e393b174a58" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 43201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f55bfad7e0f748a3a448b650b28a8724" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 37283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d9f030761982437e849655bafbd4769b" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 38335 } health_report { overall_health: UNKNOWN } } }
I20260811 16:41:27.287595 24033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:27.285356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33536 (local address 127.24.175.193:37283)
0811 16:41:27.285408 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:27.285410 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:27.285417 (+ 7us) server_negotiation.cc:407] Connection header received
0811 16:41:27.285467 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:27.285467 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:27.285484 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:27.285546 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:41:27.285661 (+ 115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:27.286260 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:27.286992 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:27.287176 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:27.287230 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:27.287326 (+ 96us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:41:27.287423 (+ 97us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:41:27.287476 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:27.287489 (+ 13us) server_negotiation.cc:299] Negotiation successful
0811 16:41:27.287506 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 16:41:27.289434 23935 raft_consensus.cc:1261] T b184961980b84a49b3b373b4cb076139 P d9f030761982437e849655bafbd4769b [term 1 FOLLOWER]: Refusing update from remote peer f55bfad7e0f748a3a448b650b28a8724: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:41:27.289439 23709 raft_consensus.cc:1261] T b184961980b84a49b3b373b4cb076139 P 54e271f1da68464db5522e393b174a58 [term 1 FOLLOWER]: Refusing update from remote peer f55bfad7e0f748a3a448b650b28a8724: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:41:27.289837 24050 consensus_queue.cc:1035] T b184961980b84a49b3b373b4cb076139 P f55bfad7e0f748a3a448b650b28a8724 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54e271f1da68464db5522e393b174a58" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 43201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:41:27.289973 24053 consensus_queue.cc:1035] T b184961980b84a49b3b373b4cb076139 P f55bfad7e0f748a3a448b650b28a8724 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9f030761982437e849655bafbd4769b" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 38335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:41:27.292347 24056 mvcc.cc:205] Tried to move back new op lower bound from 7317366731934724096 to 7317366731882143744. Current Snapshot: MvccSnapshot[applied={T|T < 7317366731934724096}]
I20260811 16:41:27.292785 24058 mvcc.cc:205] Tried to move back new op lower bound from 7317366731934724096 to 7317366731882143744. Current Snapshot: MvccSnapshot[applied={T|T < 7317366731934724096}]
I20260811 16:41:27.293052 24057 mvcc.cc:205] Tried to move back new op lower bound from 7317366731934724096 to 7317366731882143744. Current Snapshot: MvccSnapshot[applied={T|T < 7317366731934724096}]
I20260811 16:41:27.294811 23232 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36206:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:41:27.294894 23232 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:36206:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:41:27.295588 23232 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a5d491ed28824a54a94dd24debb1b914: Sending DeleteTablet for 3 replicas of tablet b184961980b84a49b3b373b4cb076139
I20260811 16:41:27.295899 23454 tablet_service.cc:1514] Processing DeleteTablet for tablet b184961980b84a49b3b373b4cb076139 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:41:27 UTC) from {username='slave'} at 127.0.0.1:33520
I20260811 16:41:27.295907 23681 tablet_service.cc:1514] Processing DeleteTablet for tablet b184961980b84a49b3b373b4cb076139 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:41:27 UTC) from {username='slave'} at 127.0.0.1:35578
I20260811 16:41:27.295969 23901 tablet_service.cc:1514] Processing DeleteTablet for tablet b184961980b84a49b3b373b4cb076139 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:41:27 UTC) from {username='slave'} at 127.0.0.1:38212
I20260811 16:41:27.296136 24070 tablet_replica.cc:330] T b184961980b84a49b3b373b4cb076139 P f55bfad7e0f748a3a448b650b28a8724: stopping tablet replica
I20260811 16:41:27.296238 24070 raft_consensus.cc:2229] T b184961980b84a49b3b373b4cb076139 P f55bfad7e0f748a3a448b650b28a8724 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:41:27.296277 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 23343
I20260811 16:41:27.296329 24070 raft_consensus.cc:2258] T b184961980b84a49b3b373b4cb076139 P f55bfad7e0f748a3a448b650b28a8724 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:41:27.319105 24072 tablet_replica.cc:330] T b184961980b84a49b3b373b4cb076139 P 54e271f1da68464db5522e393b174a58: stopping tablet replica
I20260811 16:41:27.319270 24072 raft_consensus.cc:2229] T b184961980b84a49b3b373b4cb076139 P 54e271f1da68464db5522e393b174a58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:41:27.319388 24072 raft_consensus.cc:2258] T b184961980b84a49b3b373b4cb076139 P 54e271f1da68464db5522e393b174a58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:41:27.319545 24074 tablet_replica.cc:330] T b184961980b84a49b3b373b4cb076139 P d9f030761982437e849655bafbd4769b: stopping tablet replica
I20260811 16:41:27.319662 24074 raft_consensus.cc:2229] T b184961980b84a49b3b373b4cb076139 P d9f030761982437e849655bafbd4769b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:41:27.319773 24074 raft_consensus.cc:2258] T b184961980b84a49b3b373b4cb076139 P d9f030761982437e849655bafbd4769b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:41:27.320284 24074 ts_tablet_manager.cc:1905] T b184961980b84a49b3b373b4cb076139 P d9f030761982437e849655bafbd4769b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:41:27.320308 24072 ts_tablet_manager.cc:1905] T b184961980b84a49b3b373b4cb076139 P 54e271f1da68464db5522e393b174a58: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:41:27.321743 24074 ts_tablet_manager.cc:1918] T b184961980b84a49b3b373b4cb076139 P d9f030761982437e849655bafbd4769b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:41:27.321813 24074 log.cc:1196] T b184961980b84a49b3b373b4cb076139 P d9f030761982437e849655bafbd4769b: Deleting WAL directory at /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/ts-2/wal/wals/b184961980b84a49b3b373b4cb076139
I20260811 16:41:27.321996 24074 ts_tablet_manager.cc:1939] T b184961980b84a49b3b373b4cb076139 P d9f030761982437e849655bafbd4769b: Deleting consensus metadata
I20260811 16:41:27.322292 24072 ts_tablet_manager.cc:1918] T b184961980b84a49b3b373b4cb076139 P 54e271f1da68464db5522e393b174a58: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:41:27.322371 24072 log.cc:1196] T b184961980b84a49b3b373b4cb076139 P 54e271f1da68464db5522e393b174a58: Deleting WAL directory at /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466249441839-25279-0/minicluster-data/ts-1/wal/wals/b184961980b84a49b3b373b4cb076139
I20260811 16:41:27.322451 23202 catalog_manager.cc:4841] TS d9f030761982437e849655bafbd4769b (127.24.175.195:38335): tablet b184961980b84a49b3b373b4cb076139 (table test-table [id=578750dc11ff4c38945a03e442d51952]) successfully deleted
I20260811 16:41:27.322598 24072 ts_tablet_manager.cc:1939] T b184961980b84a49b3b373b4cb076139 P 54e271f1da68464db5522e393b174a58: Deleting consensus metadata
I20260811 16:41:27.323060 23206 catalog_manager.cc:4841] TS 54e271f1da68464db5522e393b174a58 (127.24.175.194:43201): tablet b184961980b84a49b3b373b4cb076139 (table test-table [id=578750dc11ff4c38945a03e442d51952]) successfully deleted
W20260811 16:41:27.325203 23201 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.24.175.193:37283 (error 108)
I20260811 16:41:27.325425 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 23567
I20260811 16:41:27.331362 24029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:27.325590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.193:37283 (local address 127.0.0.1:33540)
0811 16:41:27.331244 (+ 5654us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:27.331319 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.193:37283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":5626}
W20260811 16:41:27.332677 23201 catalog_manager.cc:4584] TS f55bfad7e0f748a3a448b650b28a8724 (127.24.175.193:37283): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b184961980b84a49b3b373b4cb076139: Network error: Client connection negotiation failed: client connection to 127.24.175.193:37283: connect: Connection refused (error 111)
I20260811 16:41:27.347143 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 23782
I20260811 16:41:27.358196 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 23178
2026-08-11T16:41:27Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (745 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:41:27 dist-test-slave-zj8q krb5kdc[24079](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:41:27 dist-test-slave-zj8q krb5kdc[24079](info): set up 2 sockets
Aug 11 16:41:27 dist-test-slave-zj8q krb5kdc[24079](info): commencing operation
krb5kdc: starting...
W20260811 16:41:28.535200 25279 mini_kdc.cc:121] Time spent starting KDC: real 1.150s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Aug 11 16:41:28 dist-test-slave-zj8q krb5kdc[24079](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466488, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:41:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:41:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab.
Entry for principal kudu/127.24.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab.
I20260811 16:41:28.650926 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:38919
--webserver_interface=127.24.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:34095
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.175.254:38919
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:41:28.731719 24098 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:41:28.731921 24098 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:41:28.731942 24098 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:41:28.733016 24098 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:41:28.733048 24098 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:41:28.733062 24098 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:41:28.733072 24098 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:41:28.733083 24098 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:41:28.734527 24098 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:34095
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.175.254:38919
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:38919
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24098
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:41:28.734725 24098 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:41:28.734897 24098 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:41:28.739548 24104 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:41:28.739542 24109 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:41:28.739629 24107 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:28.739822 24098 server_base.cc:1034] running on GCE node
I20260811 16:41:28.740087 24098 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:41:28.740360 24098 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:41:28.741504 24098 hybrid_clock.cc:648] HybridClock initialized: now 1786466488741490 us; error 29 us; skew 500 ppm
Aug 11 16:41:28 dist-test-slave-zj8q krb5kdc[24079](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466488, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:41:28.743994 24098 init.cc:377] Logged in from keytab as kudu/127.24.175.254@KRBTEST.COM (short username kudu)
I20260811 16:41:28.744383 24098 webserver.cc:460] Webserver started at http://127.24.175.254:44111/ using document root <none> and password file <none>
I20260811 16:41:28.744557 24098 fs_manager.cc:359] Metadata directory not provided
I20260811 16:41:28.744597 24098 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:41:28.744692 24098 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:41:28.745749 24098 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/master-0/data/instance:
uuid: "14bcc1b3967b47d6a1c0051a63f8f736"
format_stamp: "Formatted at 2026-08-11 16:41:28 on dist-test-slave-zj8q"
server_key: "496cbfd5bc48ffb29fa7ca0e91a97886"
server_key_iv: "5cba6fc7c144078074cda5a8f5da1617"
server_key_version: "encryptionkey@0"
I20260811 16:41:28.746079 24098 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/master-0/wal/instance:
uuid: "14bcc1b3967b47d6a1c0051a63f8f736"
format_stamp: "Formatted at 2026-08-11 16:41:28 on dist-test-slave-zj8q"
server_key: "496cbfd5bc48ffb29fa7ca0e91a97886"
server_key_iv: "5cba6fc7c144078074cda5a8f5da1617"
server_key_version: "encryptionkey@0"
I20260811 16:41:28.747354 24098 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:41:28.748001 24118 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:28.748143 24098 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 16:41:28.748230 24098 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/master-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/master-0/wal
uuid: "14bcc1b3967b47d6a1c0051a63f8f736"
format_stamp: "Formatted at 2026-08-11 16:41:28 on dist-test-slave-zj8q"
server_key: "496cbfd5bc48ffb29fa7ca0e91a97886"
server_key_iv: "5cba6fc7c144078074cda5a8f5da1617"
server_key_version: "encryptionkey@0"
I20260811 16:41:28.748288 24098 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:41:28.761240 24098 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:41:28.763031 24098 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:41:28.763144 24098 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:41:28.766939 24098 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.254:38919
I20260811 16:41:28.766978 24205 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.254:38919 every 8 connection(s)
I20260811 16:41:28.767314 24098 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
I20260811 16:41:28.768246 24206 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:41:28.770592 24206 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 14bcc1b3967b47d6a1c0051a63f8f736: Bootstrap starting.
I20260811 16:41:28.771191 24206 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 14bcc1b3967b47d6a1c0051a63f8f736: Neither blocks nor log segments found. Creating new log.
I20260811 16:41:28.771453 24206 log.cc:824] T 00000000000000000000000000000000 P 14bcc1b3967b47d6a1c0051a63f8f736: Log is configured to *not* fsync() on all Append() calls
I20260811 16:41:28.772161 24206 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 14bcc1b3967b47d6a1c0051a63f8f736: No bootstrap required, opened a new log
I20260811 16:41:28.773785 24206 raft_consensus.cc:348] T 00000000000000000000000000000000 P 14bcc1b3967b47d6a1c0051a63f8f736 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14bcc1b3967b47d6a1c0051a63f8f736" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 38919 } }
I20260811 16:41:28.773928 24206 raft_consensus.cc:374] T 00000000000000000000000000000000 P 14bcc1b3967b47d6a1c0051a63f8f736 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:41:28.773962 24206 raft_consensus.cc:729] T 00000000000000000000000000000000 P 14bcc1b3967b47d6a1c0051a63f8f736 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14bcc1b3967b47d6a1c0051a63f8f736, State: Initialized, Role: FOLLOWER
I20260811 16:41:28.774096 24206 consensus_queue.cc:260] T 00000000000000000000000000000000 P 14bcc1b3967b47d6a1c0051a63f8f736 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14bcc1b3967b47d6a1c0051a63f8f736" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 38919 } }
I20260811 16:41:28.774210 24206 raft_consensus.cc:388] T 00000000000000000000000000000000 P 14bcc1b3967b47d6a1c0051a63f8f736 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:41:28.774252 24206 raft_consensus.cc:482] T 00000000000000000000000000000000 P 14bcc1b3967b47d6a1c0051a63f8f736 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:41:28.774303 24206 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 14bcc1b3967b47d6a1c0051a63f8f736 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:41:28.774827 24206 raft_consensus.cc:504] T 00000000000000000000000000000000 P 14bcc1b3967b47d6a1c0051a63f8f736 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14bcc1b3967b47d6a1c0051a63f8f736" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 38919 } }
I20260811 16:41:28.774924 24206 leader_election.cc:302] T 00000000000000000000000000000000 P 14bcc1b3967b47d6a1c0051a63f8f736 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 14bcc1b3967b47d6a1c0051a63f8f736; no voters:
I20260811 16:41:28.775097 24206 leader_election.cc:288] T 00000000000000000000000000000000 P 14bcc1b3967b47d6a1c0051a63f8f736 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:41:28.775125 24212 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 14bcc1b3967b47d6a1c0051a63f8f736 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:41:28.775264 24212 raft_consensus.cc:686] T 00000000000000000000000000000000 P 14bcc1b3967b47d6a1c0051a63f8f736 [term 1 LEADER]: Becoming Leader. State: Replica: 14bcc1b3967b47d6a1c0051a63f8f736, State: Running, Role: LEADER
I20260811 16:41:28.775342 24206 sys_catalog.cc:564] T 00000000000000000000000000000000 P 14bcc1b3967b47d6a1c0051a63f8f736 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:41:28.775373 24212 consensus_queue.cc:237] T 00000000000000000000000000000000 P 14bcc1b3967b47d6a1c0051a63f8f736 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14bcc1b3967b47d6a1c0051a63f8f736" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 38919 } }
I20260811 16:41:28.775591 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 24098
I20260811 16:41:28.775707 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/master-0/wal/instance
I20260811 16:41:28.775897 25279 external_mini_cluster.cc:1428] Setting key 634695ff9662d598b58de024bb8352ac
I20260811 16:41:28.775913 24216 sys_catalog.cc:455] T 00000000000000000000000000000000 P 14bcc1b3967b47d6a1c0051a63f8f736 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 14bcc1b3967b47d6a1c0051a63f8f736. Latest consensus state: current_term: 1 leader_uuid: "14bcc1b3967b47d6a1c0051a63f8f736" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14bcc1b3967b47d6a1c0051a63f8f736" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 38919 } } }
I20260811 16:41:28.776000 24216 sys_catalog.cc:458] T 00000000000000000000000000000000 P 14bcc1b3967b47d6a1c0051a63f8f736 [sys.catalog]: This master's current role is: LEADER
I20260811 16:41:28.776150 24214 sys_catalog.cc:455] T 00000000000000000000000000000000 P 14bcc1b3967b47d6a1c0051a63f8f736 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "14bcc1b3967b47d6a1c0051a63f8f736" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14bcc1b3967b47d6a1c0051a63f8f736" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 38919 } } }
I20260811 16:41:28.776235 24214 sys_catalog.cc:458] T 00000000000000000000000000000000 P 14bcc1b3967b47d6a1c0051a63f8f736 [sys.catalog]: This master's current role is: LEADER
I20260811 16:41:28.776355 24227 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:41:28.777035 24227 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:41:28.778505 24227 catalog_manager.cc:1347] Generated new cluster ID: 6d011b17f2294535a22a19d5a2061cfe
I20260811 16:41:28.778551 24227 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 16:41:28 dist-test-slave-zj8q krb5kdc[24079](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466488, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:41:28.787494 24240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:28.776540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45866 (local address 127.24.175.254:38919)
0811 16:41:28.776706 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:28.776716 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:28.776913 (+ 197us) server_negotiation.cc:407] Connection header received
0811 16:41:28.777038 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:28.777046 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:28.777103 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:28.777229 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:41:28.778184 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:28.779507 (+ 1323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:28.780564 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:28.781233 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:28.781344 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:28.784038 (+ 2694us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:41:28.784042 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:41:28.784042 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:41:28.784054 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:41:28.785868 (+ 1814us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:41:28.786273 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:41:28.786275 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:41:28.786276 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:41:28.786390 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:41:28.786583 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:41:28.786584 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:41:28.786584 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:41:28.786879 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:41:28.787032 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:28.787128 (+ 96us) server_negotiation.cc:299] Negotiation successful
0811 16:41:28.787263 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":68,"threads_started":1}
I20260811 16:41:28.793143 24227 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:41:28.793640 24227 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:41:28.797289 24227 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 14bcc1b3967b47d6a1c0051a63f8f736: Generated new TSK 0
I20260811 16:41:28.797449 24227 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.175.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab.
Entry for principal kudu/127.24.175.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab.
I20260811 16:41:28.828802 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.193:0
--local_ip_for_outbound_sockets=127.24.175.193
--webserver_interface=127.24.175.193
--webserver_port=0
--tserver_master_addrs=127.24.175.254:38919
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab
--principal=kudu/127.24.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:34095
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:41:28.927251 24252 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:41:28.927446 24252 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:41:28.927469 24252 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:41:28.928540 24252 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:41:28.928573 24252 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:41:28.928598 24252 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.193
I20260811 16:41:28.930011 24252 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:34095
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab
--principal=kudu/127.24.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.175.193
--webserver_port=0
--tserver_master_addrs=127.24.175.254:38919
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24252
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.193
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:41:28.930224 24252 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:41:28.930410 24252 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:41:28.935163 24261 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:41:28.935170 24259 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:28.935233 24252 server_base.cc:1034] running on GCE node
W20260811 16:41:28.935173 24263 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:28.935495 24252 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:41:28.935701 24252 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:41:28.936848 24252 hybrid_clock.cc:648] HybridClock initialized: now 1786466488936837 us; error 31 us; skew 500 ppm
Aug 11 16:41:28 dist-test-slave-zj8q krb5kdc[24079](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466488, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:41:28.939285 24252 init.cc:377] Logged in from keytab as kudu/127.24.175.193@KRBTEST.COM (short username kudu)
I20260811 16:41:28.939702 24252 webserver.cc:460] Webserver started at http://127.24.175.193:41619/ using document root <none> and password file <none>
I20260811 16:41:28.939927 24252 fs_manager.cc:359] Metadata directory not provided
I20260811 16:41:28.939975 24252 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:41:28.940100 24252 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:41:28.941098 24252 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/ts-0/data/instance:
uuid: "f99fb9bcc482400c86d168bb083f0a15"
format_stamp: "Formatted at 2026-08-11 16:41:28 on dist-test-slave-zj8q"
server_key: "5d0534b7e92322531075d8a72829be11"
server_key_iv: "b8a2a38c53cfe11c55455a28ffba1981"
server_key_version: "encryptionkey@0"
I20260811 16:41:28.941427 24252 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/ts-0/wal/instance:
uuid: "f99fb9bcc482400c86d168bb083f0a15"
format_stamp: "Formatted at 2026-08-11 16:41:28 on dist-test-slave-zj8q"
server_key: "5d0534b7e92322531075d8a72829be11"
server_key_iv: "b8a2a38c53cfe11c55455a28ffba1981"
server_key_version: "encryptionkey@0"
I20260811 16:41:28.942731 24252 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:41:28.943449 24271 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:28.943634 24252 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:41:28.943723 24252 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/ts-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/ts-0/wal
uuid: "f99fb9bcc482400c86d168bb083f0a15"
format_stamp: "Formatted at 2026-08-11 16:41:28 on dist-test-slave-zj8q"
server_key: "5d0534b7e92322531075d8a72829be11"
server_key_iv: "b8a2a38c53cfe11c55455a28ffba1981"
server_key_version: "encryptionkey@0"
I20260811 16:41:28.943783 24252 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:41:29.001781 24252 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:41:29.003754 24252 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:41:29.003899 24252 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:41:29.004148 24252 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:41:29.004488 24252 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:41:29.004523 24252 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:29.004554 24252 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:41:29.004578 24252 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:29.010084 24252 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.193:43107
I20260811 16:41:29.010133 24459 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.193:43107 every 8 connection(s)
I20260811 16:41:29.010499 24252 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
I20260811 16:41:29.015528 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 24252
I20260811 16:41:29.015626 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/ts-0/wal/instance
I20260811 16:41:29.015818 25279 external_mini_cluster.cc:1428] Setting key 772f1e9dc30908793a5ff28d0203943b
Aug 11 16:41:29 dist-test-slave-zj8q krb5kdc[24079](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466488, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.193@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:41:29.019589 24240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:29.011219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:60975 (local address 127.24.175.254:38919)
0811 16:41:29.011272 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:29.011273 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:29.011450 (+ 177us) server_negotiation.cc:407] Connection header received
0811 16:41:29.011921 (+ 471us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:29.011922 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:29.011934 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:29.011984 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:41:29.012933 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:29.013445 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:29.014424 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:29.014627 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:29.014680 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:29.016803 (+ 2123us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:41:29.016805 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:41:29.016805 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:41:29.016812 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:41:29.018246 (+ 1434us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:41:29.018720 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:41:29.018721 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:41:29.018721 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:41:29.018773 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:41:29.019013 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:41:29.019014 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:41:29.019014 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:41:29.019109 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:41:29.019152 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:29.019450 (+ 298us) server_negotiation.cc:299] Negotiation successful
0811 16:41:29.019524 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 16:41:29.019825 24463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:29.011177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:38919 (local address 127.24.175.193:60975)
0811 16:41:29.011336 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:29.011378 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 16:41:29.011847 (+ 469us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:41:29.012046 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:41:29.012050 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:41:29.012627 (+ 577us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:41:29.012853 (+ 226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:29.012858 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:29.013512 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:29.013513 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:29.014363 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:29.014366 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:29.014686 (+ 320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:29.014687 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:29.014780 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:29.015235 (+ 455us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:41:29.015244 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:41:29.016714 (+ 1470us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:41:29.018327 (+ 1613us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:41:29.018336 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:41:29.018338 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:41:29.018647 (+ 309us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:41:29.018825 (+ 178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:41:29.018826 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:41:29.018826 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:41:29.018958 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:41:29.019157 (+ 199us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:41:29.019162 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:41:29.019321 (+ 159us) client_negotiation.cc:769] Sending connection context
0811 16:41:29.019440 (+ 119us) client_negotiation.cc:240] Negotiation successful
0811 16:41:29.019618 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":74,"threads_started":1}
I20260811 16:41:29.020349 24460 heartbeater.cc:347] Connected to a master server at 127.24.175.254:38919
I20260811 16:41:29.020447 24460 heartbeater.cc:464] Registering TS with master...
I20260811 16:41:29.020619 24460 heartbeater.cc:511] Master 127.24.175.254:38919 requested a full tablet report, sending...
I20260811 16:41:29.021189 24152 ts_manager.cc:194] Registered new tserver with Master: f99fb9bcc482400c86d168bb083f0a15 (127.24.175.193:43107)
I20260811 16:41:29.022118 24152 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.175.193@KRBTEST.COM'} at 127.24.175.193:60975
WARNING: no policy specified for kudu/127.24.175.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab.
Entry for principal kudu/127.24.175.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab.
I20260811 16:41:29.041268 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.194:0
--local_ip_for_outbound_sockets=127.24.175.194
--webserver_interface=127.24.175.194
--webserver_port=0
--tserver_master_addrs=127.24.175.254:38919
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab
--principal=kudu/127.24.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:34095
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:41:29.121883 24474 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:41:29.122089 24474 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:41:29.122118 24474 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:41:29.123250 24474 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:41:29.123293 24474 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:41:29.123322 24474 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.194
I20260811 16:41:29.124768 24474 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:34095
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab
--principal=kudu/127.24.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.175.194
--webserver_port=0
--tserver_master_addrs=127.24.175.254:38919
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24474
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.194
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:41:29.124994 24474 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:41:29.125207 24474 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:41:29.130105 24486 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:41:29.130082 24488 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:29.130175 24474 server_base.cc:1034] running on GCE node
W20260811 16:41:29.130128 24485 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:29.130544 24474 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:41:29.130771 24474 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:41:29.131920 24474 hybrid_clock.cc:648] HybridClock initialized: now 1786466489131902 us; error 33 us; skew 500 ppm
Aug 11 16:41:29 dist-test-slave-zj8q krb5kdc[24079](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466489, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:41:29.134291 24474 init.cc:377] Logged in from keytab as kudu/127.24.175.194@KRBTEST.COM (short username kudu)
I20260811 16:41:29.134684 24474 webserver.cc:460] Webserver started at http://127.24.175.194:34603/ using document root <none> and password file <none>
I20260811 16:41:29.134894 24474 fs_manager.cc:359] Metadata directory not provided
I20260811 16:41:29.134943 24474 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:41:29.135063 24474 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:41:29.136096 24474 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/ts-1/data/instance:
uuid: "bc03d9af8c9e40ccabdcf0cf314bd167"
format_stamp: "Formatted at 2026-08-11 16:41:29 on dist-test-slave-zj8q"
server_key: "1007638038629e8331831f6b7438cd7b"
server_key_iv: "ba478325e82c702583878e979c911456"
server_key_version: "encryptionkey@0"
I20260811 16:41:29.136428 24474 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/ts-1/wal/instance:
uuid: "bc03d9af8c9e40ccabdcf0cf314bd167"
format_stamp: "Formatted at 2026-08-11 16:41:29 on dist-test-slave-zj8q"
server_key: "1007638038629e8331831f6b7438cd7b"
server_key_iv: "ba478325e82c702583878e979c911456"
server_key_version: "encryptionkey@0"
I20260811 16:41:29.137645 24474 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:41:29.138381 24496 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:29.138526 24474 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:41:29.138612 24474 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/ts-1/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/ts-1/wal
uuid: "bc03d9af8c9e40ccabdcf0cf314bd167"
format_stamp: "Formatted at 2026-08-11 16:41:29 on dist-test-slave-zj8q"
server_key: "1007638038629e8331831f6b7438cd7b"
server_key_iv: "ba478325e82c702583878e979c911456"
server_key_version: "encryptionkey@0"
I20260811 16:41:29.138669 24474 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:41:29.144774 24474 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:41:29.146587 24474 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:41:29.146715 24474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:41:29.146904 24474 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:41:29.147197 24474 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:41:29.147238 24474 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:29.147258 24474 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:41:29.147274 24474 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:29.152940 24474 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.194:34811
I20260811 16:41:29.152982 24691 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.194:34811 every 8 connection(s)
I20260811 16:41:29.153290 24474 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
I20260811 16:41:29.156105 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 24474
I20260811 16:41:29.156221 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/ts-1/wal/instance
I20260811 16:41:29.156416 25279 external_mini_cluster.cc:1428] Setting key 3a2d49aa1248b4a91ba935415e12e751
Aug 11 16:41:29 dist-test-slave-zj8q krb5kdc[24079](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466489, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.194@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:41:29.162757 24240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:29.153968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:49889 (local address 127.24.175.254:38919)
0811 16:41:29.154038 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:29.154040 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:29.154276 (+ 236us) server_negotiation.cc:407] Connection header received
0811 16:41:29.154796 (+ 520us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:29.154797 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:29.154807 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:29.154857 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:41:29.155817 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:29.156546 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:29.157642 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:29.157926 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:29.157997 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:29.160116 (+ 2119us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:41:29.160118 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:41:29.160118 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:41:29.160126 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:41:29.161432 (+ 1306us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:41:29.161812 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:41:29.161813 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:41:29.161813 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:41:29.161871 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:41:29.162102 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:41:29.162103 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:41:29.162104 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:41:29.162257 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:41:29.162317 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:29.162574 (+ 257us) server_negotiation.cc:299] Negotiation successful
0811 16:41:29.162666 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 16:41:29.162928 24695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:29.153949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:38919 (local address 127.24.175.194:49889)
0811 16:41:29.154115 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:29.154190 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0811 16:41:29.154717 (+ 527us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:41:29.154967 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:41:29.154972 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:41:29.155539 (+ 567us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:41:29.155745 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:29.155750 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:29.156664 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:29.156665 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:29.157550 (+ 885us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:29.157553 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:29.158012 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:29.158013 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:29.158142 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:29.158688 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:41:29.158696 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:41:29.160020 (+ 1324us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:41:29.161510 (+ 1490us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:41:29.161517 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:41:29.161520 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:41:29.161744 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:41:29.161926 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:41:29.161926 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:41:29.161927 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:41:29.162040 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:41:29.162313 (+ 273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:41:29.162321 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:41:29.162457 (+ 136us) client_negotiation.cc:769] Sending connection context
0811 16:41:29.162546 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 16:41:29.162714 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":88,"threads_started":1}
I20260811 16:41:29.163370 24693 heartbeater.cc:347] Connected to a master server at 127.24.175.254:38919
I20260811 16:41:29.163462 24693 heartbeater.cc:464] Registering TS with master...
I20260811 16:41:29.163637 24693 heartbeater.cc:511] Master 127.24.175.254:38919 requested a full tablet report, sending...
I20260811 16:41:29.164008 24152 ts_manager.cc:194] Registered new tserver with Master: bc03d9af8c9e40ccabdcf0cf314bd167 (127.24.175.194:34811)
I20260811 16:41:29.164371 24152 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.175.194@KRBTEST.COM'} at 127.24.175.194:49889
WARNING: no policy specified for kudu/127.24.175.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab.
Entry for principal kudu/127.24.175.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab.
I20260811 16:41:29.182313 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.195:0
--local_ip_for_outbound_sockets=127.24.175.195
--webserver_interface=127.24.175.195
--webserver_port=0
--tserver_master_addrs=127.24.175.254:38919
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab
--principal=kudu/127.24.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:34095
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:41:29.264300 24703 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:41:29.264499 24703 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:41:29.264521 24703 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:41:29.265614 24703 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:41:29.265648 24703 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:41:29.265671 24703 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.195
I20260811 16:41:29.267105 24703 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:34095
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab
--principal=kudu/127.24.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.175.195
--webserver_port=0
--tserver_master_addrs=127.24.175.254:38919
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24703
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.195
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:41:29.267282 24703 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:41:29.267453 24703 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:41:29.272482 24709 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:41:29.272487 24710 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:29.272583 24703 server_base.cc:1034] running on GCE node
W20260811 16:41:29.272490 24715 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:29.272915 24703 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:41:29.273155 24703 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:41:29.274304 24703 hybrid_clock.cc:648] HybridClock initialized: now 1786466489274287 us; error 28 us; skew 500 ppm
Aug 11 16:41:29 dist-test-slave-zj8q krb5kdc[24079](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466489, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:41:29.276901 24703 init.cc:377] Logged in from keytab as kudu/127.24.175.195@KRBTEST.COM (short username kudu)
I20260811 16:41:29.277379 24703 webserver.cc:460] Webserver started at http://127.24.175.195:36681/ using document root <none> and password file <none>
I20260811 16:41:29.277597 24703 fs_manager.cc:359] Metadata directory not provided
I20260811 16:41:29.277640 24703 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:41:29.277729 24703 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:41:29.278781 24703 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/ts-2/data/instance:
uuid: "5c6ace3b4d8b4276beec47ed32df9610"
format_stamp: "Formatted at 2026-08-11 16:41:29 on dist-test-slave-zj8q"
server_key: "3bdd16cb448de8a816341eca1cc53e01"
server_key_iv: "ec187eda8286bb65182b54cb742312ca"
server_key_version: "encryptionkey@0"
I20260811 16:41:29.279076 24703 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/ts-2/wal/instance:
uuid: "5c6ace3b4d8b4276beec47ed32df9610"
format_stamp: "Formatted at 2026-08-11 16:41:29 on dist-test-slave-zj8q"
server_key: "3bdd16cb448de8a816341eca1cc53e01"
server_key_iv: "ec187eda8286bb65182b54cb742312ca"
server_key_version: "encryptionkey@0"
I20260811 16:41:29.280310 24703 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:41:29.280977 24727 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:29.281141 24703 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:41:29.281229 24703 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/ts-2/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/ts-2/wal
uuid: "5c6ace3b4d8b4276beec47ed32df9610"
format_stamp: "Formatted at 2026-08-11 16:41:29 on dist-test-slave-zj8q"
server_key: "3bdd16cb448de8a816341eca1cc53e01"
server_key_iv: "ec187eda8286bb65182b54cb742312ca"
server_key_version: "encryptionkey@0"
I20260811 16:41:29.281292 24703 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:41:29.291229 24703 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:41:29.292832 24703 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:41:29.292935 24703 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:41:29.293109 24703 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:41:29.293352 24703 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:41:29.293381 24703 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:29.293401 24703 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:41:29.293417 24703 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:29.299062 24703 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.195:44631
I20260811 16:41:29.299131 24932 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.195:44631 every 8 connection(s)
I20260811 16:41:29.299387 24703 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
Aug 11 16:41:29 dist-test-slave-zj8q krb5kdc[24079](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466489, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.195@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:41:29.307646 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 24703
I20260811 16:41:29.307747 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/ts-2/wal/instance
I20260811 16:41:29.307941 25279 external_mini_cluster.cc:1428] Setting key 11f73ce16ea7c2823c1e34e036ef142b
I20260811 16:41:29.308409 24240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:29.300051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.195:54747 (local address 127.24.175.254:38919)
0811 16:41:29.300137 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:29.300140 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:29.300350 (+ 210us) server_negotiation.cc:407] Connection header received
0811 16:41:29.300843 (+ 493us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:29.300845 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:29.300857 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:29.300906 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:41:29.301850 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:29.302428 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:29.303404 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:29.303625 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:29.303683 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:29.305826 (+ 2143us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:41:29.305827 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:41:29.305828 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:41:29.305835 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:41:29.307018 (+ 1183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:41:29.307383 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:41:29.307383 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:41:29.307384 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:41:29.307428 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:41:29.307713 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:41:29.307713 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:41:29.307714 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:41:29.307849 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:41:29.307901 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:29.308234 (+ 333us) server_negotiation.cc:299] Negotiation successful
0811 16:41:29.308321 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 16:41:29.308547 24938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:29.300035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:38919 (local address 127.24.175.195:54747)
0811 16:41:29.300229 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:29.300267 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 16:41:29.300751 (+ 484us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:41:29.300985 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:41:29.300988 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:41:29.301563 (+ 575us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:41:29.301755 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:29.301760 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:29.302512 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:29.302513 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:29.303317 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:29.303319 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:29.303696 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:29.303697 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:29.303826 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:29.304294 (+ 468us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:41:29.304303 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:41:29.305739 (+ 1436us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:41:29.307102 (+ 1363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:41:29.307108 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:41:29.307110 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:41:29.307323 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:41:29.307505 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:41:29.307505 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:41:29.307506 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:41:29.307648 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:41:29.307904 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:41:29.307912 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:41:29.308085 (+ 173us) client_negotiation.cc:769] Sending connection context
0811 16:41:29.308184 (+ 99us) client_negotiation.cc:240] Negotiation successful
0811 16:41:29.308339 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":88,"threads_started":1}
I20260811 16:41:29.309067 24934 heartbeater.cc:347] Connected to a master server at 127.24.175.254:38919
I20260811 16:41:29.309149 24934 heartbeater.cc:464] Registering TS with master...
I20260811 16:41:29.309290 24934 heartbeater.cc:511] Master 127.24.175.254:38919 requested a full tablet report, sending...
I20260811 16:41:29.309602 24152 ts_manager.cc:194] Registered new tserver with Master: 5c6ace3b4d8b4276beec47ed32df9610 (127.24.175.195:44631)
I20260811 16:41:29.309955 24152 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.175.195@KRBTEST.COM'} at 127.24.175.195:54747
I20260811 16:41:29.319413 25279 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 16:41:29.326309 24240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:29.320680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45868 (local address 127.24.175.254:38919)
0811 16:41:29.320749 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:29.320751 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:29.320832 (+ 81us) server_negotiation.cc:407] Connection header received
0811 16:41:29.320886 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:29.320887 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:29.320896 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:29.320936 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:41:29.321425 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:29.321943 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:29.322651 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:29.322849 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:29.322904 (+ 55us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:29.324124 (+ 1220us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:41:29.324125 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:41:29.324126 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:41:29.324131 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:41:29.325224 (+ 1093us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:41:29.325650 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:41:29.325651 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:41:29.325652 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:41:29.325710 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:41:29.325870 (+ 160us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:41:29.325870 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:41:29.325871 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:41:29.325993 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:41:29.326073 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:29.326183 (+ 110us) server_negotiation.cc:299] Negotiation successful
0811 16:41:29.326246 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 16:41:29.327661 24152 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45868:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:41:29.329191 24152 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:41:29.336006 24959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:29.331914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54444 (local address 127.24.175.194:34811)
0811 16:41:29.332120 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:29.332188 (+ 68us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:29.332198 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:41:29.332233 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:29.332235 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:29.332248 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:29.332508 (+ 260us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:41:29.332579 (+ 71us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:29.333349 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:29.334847 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:29.335620 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:29.335714 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:29.335764 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:29.335877 (+ 113us) server_negotiation.cc:299] Negotiation successful
0811 16:41:29.335921 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":86,"threads_started":1}
I20260811 16:41:29.336006 24960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:29.331997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54870 (local address 127.24.175.193:43107)
0811 16:41:29.332161 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:29.332166 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:29.332177 (+ 11us) server_negotiation.cc:407] Connection header received
0811 16:41:29.332220 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:29.332223 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:29.332239 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:29.332317 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:41:29.332515 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:29.333660 (+ 1145us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:29.334910 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:29.335597 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:29.335676 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:29.335741 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:29.335877 (+ 136us) server_negotiation.cc:299] Negotiation successful
0811 16:41:29.335921 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":91,"threads_started":1}
I20260811 16:41:29.336012 24954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:29.331612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.194:34811 (local address 127.0.0.1:54444)
0811 16:41:29.331774 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:29.331814 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 16:41:29.331873 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:41:29.332352 (+ 479us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:41:29.332356 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:41:29.332358 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:41:29.332429 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:29.332431 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:29.333459 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:29.333460 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:29.334769 (+ 1309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:29.334772 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:29.335713 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:29.335713 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:29.335776 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:29.335790 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 16:41:29.335859 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 16:41:29.335924 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"mutex_wait_us":28,"thread_start_us":93,"threads_started":1}
I20260811 16:41:29.336189 24958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:29.331790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.193:43107 (local address 127.0.0.1:54870)
0811 16:41:29.332040 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:29.332050 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:41:29.332105 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:41:29.332401 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:41:29.332402 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:41:29.332403 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:41:29.332452 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:29.332453 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:29.333754 (+ 1301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:29.333755 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:29.334839 (+ 1084us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:29.334841 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:29.335692 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:29.335693 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:29.335776 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:29.335791 (+ 15us) client_negotiation.cc:769] Sending connection context
0811 16:41:29.335859 (+ 68us) client_negotiation.cc:240] Negotiation successful
0811 16:41:29.336129 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":227,"mutex_wait_us":227,"thread_start_us":83,"threads_started":1}
I20260811 16:41:29.336838 24577 tablet_service.cc:1467] Processing CreateTablet for tablet 827193221db34c2ea842a8f65f6eff8d (DEFAULT_TABLE table=test-table [id=06a98501d151490c8d5a7a9521425d0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:41:29.336962 24360 tablet_service.cc:1467] Processing CreateTablet for tablet 827193221db34c2ea842a8f65f6eff8d (DEFAULT_TABLE table=test-table [id=06a98501d151490c8d5a7a9521425d0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:41:29.337174 24955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:29.331588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.195:44631 (local address 127.0.0.1:57116)
0811 16:41:29.331772 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:29.331812 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 16:41:29.331873 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:41:29.332409 (+ 536us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:41:29.332410 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:41:29.332412 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:41:29.332467 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:29.332469 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:29.334918 (+ 2449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:29.334919 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:29.335604 (+ 685us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:29.335606 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:29.336946 (+ 1340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:29.336947 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:29.337006 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:29.337011 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 16:41:29.337072 (+ 61us) client_negotiation.cc:240] Negotiation successful
0811 16:41:29.337111 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":63,"threads_started":1}
I20260811 16:41:29.337237 24577 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 827193221db34c2ea842a8f65f6eff8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:41:29.337308 24360 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 827193221db34c2ea842a8f65f6eff8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:41:29.337395 24956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:29.331736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57116 (local address 127.24.175.195:44631)
0811 16:41:29.332210 (+ 474us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:29.332214 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:29.332223 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:41:29.332261 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:29.332263 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:29.332277 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:29.332344 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:41:29.332542 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:29.333645 (+ 1103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:29.335900 (+ 2255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:29.336784 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:29.336856 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:29.336908 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:29.337279 (+ 371us) server_negotiation.cc:299] Negotiation successful
0811 16:41:29.337323 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":440,"thread_start_us":76,"threads_started":1}
I20260811 16:41:29.338943 24817 tablet_service.cc:1467] Processing CreateTablet for tablet 827193221db34c2ea842a8f65f6eff8d (DEFAULT_TABLE table=test-table [id=06a98501d151490c8d5a7a9521425d0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:41:29.339267 24817 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 827193221db34c2ea842a8f65f6eff8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:41:29.340204 24962 tablet_bootstrap.cc:492] T 827193221db34c2ea842a8f65f6eff8d P bc03d9af8c9e40ccabdcf0cf314bd167: Bootstrap starting.
I20260811 16:41:29.340531 24963 tablet_bootstrap.cc:492] T 827193221db34c2ea842a8f65f6eff8d P f99fb9bcc482400c86d168bb083f0a15: Bootstrap starting.
I20260811 16:41:29.340840 24962 tablet_bootstrap.cc:654] T 827193221db34c2ea842a8f65f6eff8d P bc03d9af8c9e40ccabdcf0cf314bd167: Neither blocks nor log segments found. Creating new log.
I20260811 16:41:29.341218 24963 tablet_bootstrap.cc:654] T 827193221db34c2ea842a8f65f6eff8d P f99fb9bcc482400c86d168bb083f0a15: Neither blocks nor log segments found. Creating new log.
I20260811 16:41:29.341531 24962 log.cc:824] T 827193221db34c2ea842a8f65f6eff8d P bc03d9af8c9e40ccabdcf0cf314bd167: Log is configured to *not* fsync() on all Append() calls
I20260811 16:41:29.341763 24963 log.cc:824] T 827193221db34c2ea842a8f65f6eff8d P f99fb9bcc482400c86d168bb083f0a15: Log is configured to *not* fsync() on all Append() calls
I20260811 16:41:29.342314 24962 tablet_bootstrap.cc:492] T 827193221db34c2ea842a8f65f6eff8d P bc03d9af8c9e40ccabdcf0cf314bd167: No bootstrap required, opened a new log
I20260811 16:41:29.342379 24962 ts_tablet_manager.cc:1397] T 827193221db34c2ea842a8f65f6eff8d P bc03d9af8c9e40ccabdcf0cf314bd167: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:41:29.342501 24963 tablet_bootstrap.cc:492] T 827193221db34c2ea842a8f65f6eff8d P f99fb9bcc482400c86d168bb083f0a15: No bootstrap required, opened a new log
I20260811 16:41:29.342566 24963 ts_tablet_manager.cc:1397] T 827193221db34c2ea842a8f65f6eff8d P f99fb9bcc482400c86d168bb083f0a15: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:41:29.343762 24962 raft_consensus.cc:348] T 827193221db34c2ea842a8f65f6eff8d P bc03d9af8c9e40ccabdcf0cf314bd167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c6ace3b4d8b4276beec47ed32df9610" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 44631 } } peers { permanent_uuid: "f99fb9bcc482400c86d168bb083f0a15" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 43107 } } peers { permanent_uuid: "bc03d9af8c9e40ccabdcf0cf314bd167" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 34811 } }
I20260811 16:41:29.343904 24962 raft_consensus.cc:374] T 827193221db34c2ea842a8f65f6eff8d P bc03d9af8c9e40ccabdcf0cf314bd167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:41:29.343940 24962 raft_consensus.cc:729] T 827193221db34c2ea842a8f65f6eff8d P bc03d9af8c9e40ccabdcf0cf314bd167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc03d9af8c9e40ccabdcf0cf314bd167, State: Initialized, Role: FOLLOWER
I20260811 16:41:29.343848 24963 raft_consensus.cc:348] T 827193221db34c2ea842a8f65f6eff8d P f99fb9bcc482400c86d168bb083f0a15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c6ace3b4d8b4276beec47ed32df9610" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 44631 } } peers { permanent_uuid: "f99fb9bcc482400c86d168bb083f0a15" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 43107 } } peers { permanent_uuid: "bc03d9af8c9e40ccabdcf0cf314bd167" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 34811 } }
I20260811 16:41:29.343984 24963 raft_consensus.cc:374] T 827193221db34c2ea842a8f65f6eff8d P f99fb9bcc482400c86d168bb083f0a15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:41:29.344027 24963 raft_consensus.cc:729] T 827193221db34c2ea842a8f65f6eff8d P f99fb9bcc482400c86d168bb083f0a15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f99fb9bcc482400c86d168bb083f0a15, State: Initialized, Role: FOLLOWER
I20260811 16:41:29.344058 24962 consensus_queue.cc:260] T 827193221db34c2ea842a8f65f6eff8d P bc03d9af8c9e40ccabdcf0cf314bd167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c6ace3b4d8b4276beec47ed32df9610" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 44631 } } peers { permanent_uuid: "f99fb9bcc482400c86d168bb083f0a15" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 43107 } } peers { permanent_uuid: "bc03d9af8c9e40ccabdcf0cf314bd167" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 34811 } }
I20260811 16:41:29.344132 24963 consensus_queue.cc:260] T 827193221db34c2ea842a8f65f6eff8d P f99fb9bcc482400c86d168bb083f0a15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c6ace3b4d8b4276beec47ed32df9610" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 44631 } } peers { permanent_uuid: "f99fb9bcc482400c86d168bb083f0a15" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 43107 } } peers { permanent_uuid: "bc03d9af8c9e40ccabdcf0cf314bd167" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 34811 } }
I20260811 16:41:29.344339 24962 ts_tablet_manager.cc:1428] T 827193221db34c2ea842a8f65f6eff8d P bc03d9af8c9e40ccabdcf0cf314bd167: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:41:29.344372 24693 heartbeater.cc:503] Master 127.24.175.254:38919 was elected leader, sending a full tablet report...
I20260811 16:41:29.344399 24963 ts_tablet_manager.cc:1428] T 827193221db34c2ea842a8f65f6eff8d P f99fb9bcc482400c86d168bb083f0a15: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:41:29.344559 24966 tablet_bootstrap.cc:492] T 827193221db34c2ea842a8f65f6eff8d P 5c6ace3b4d8b4276beec47ed32df9610: Bootstrap starting.
I20260811 16:41:29.344676 24460 heartbeater.cc:503] Master 127.24.175.254:38919 was elected leader, sending a full tablet report...
I20260811 16:41:29.345204 24966 tablet_bootstrap.cc:654] T 827193221db34c2ea842a8f65f6eff8d P 5c6ace3b4d8b4276beec47ed32df9610: Neither blocks nor log segments found. Creating new log.
I20260811 16:41:29.345773 24966 log.cc:824] T 827193221db34c2ea842a8f65f6eff8d P 5c6ace3b4d8b4276beec47ed32df9610: Log is configured to *not* fsync() on all Append() calls
I20260811 16:41:29.346441 24966 tablet_bootstrap.cc:492] T 827193221db34c2ea842a8f65f6eff8d P 5c6ace3b4d8b4276beec47ed32df9610: No bootstrap required, opened a new log
I20260811 16:41:29.346499 24966 ts_tablet_manager.cc:1397] T 827193221db34c2ea842a8f65f6eff8d P 5c6ace3b4d8b4276beec47ed32df9610: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 16:41:29.347803 24966 raft_consensus.cc:348] T 827193221db34c2ea842a8f65f6eff8d P 5c6ace3b4d8b4276beec47ed32df9610 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c6ace3b4d8b4276beec47ed32df9610" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 44631 } } peers { permanent_uuid: "f99fb9bcc482400c86d168bb083f0a15" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 43107 } } peers { permanent_uuid: "bc03d9af8c9e40ccabdcf0cf314bd167" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 34811 } }
I20260811 16:41:29.347927 24966 raft_consensus.cc:374] T 827193221db34c2ea842a8f65f6eff8d P 5c6ace3b4d8b4276beec47ed32df9610 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:41:29.347959 24966 raft_consensus.cc:729] T 827193221db34c2ea842a8f65f6eff8d P 5c6ace3b4d8b4276beec47ed32df9610 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c6ace3b4d8b4276beec47ed32df9610, State: Initialized, Role: FOLLOWER
I20260811 16:41:29.348059 24966 consensus_queue.cc:260] T 827193221db34c2ea842a8f65f6eff8d P 5c6ace3b4d8b4276beec47ed32df9610 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c6ace3b4d8b4276beec47ed32df9610" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 44631 } } peers { permanent_uuid: "f99fb9bcc482400c86d168bb083f0a15" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 43107 } } peers { permanent_uuid: "bc03d9af8c9e40ccabdcf0cf314bd167" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 34811 } }
I20260811 16:41:29.348306 24966 ts_tablet_manager.cc:1428] T 827193221db34c2ea842a8f65f6eff8d P 5c6ace3b4d8b4276beec47ed32df9610: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:41:29.348363 24934 heartbeater.cc:503] Master 127.24.175.254:38919 was elected leader, sending a full tablet report...
W20260811 16:41:29.403851 24694 tablet.cc:2369] T 827193221db34c2ea842a8f65f6eff8d P bc03d9af8c9e40ccabdcf0cf314bd167: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:41:29.450790 24973 raft_consensus.cc:482] T 827193221db34c2ea842a8f65f6eff8d P f99fb9bcc482400c86d168bb083f0a15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:41:29.450914 24973 raft_consensus.cc:504] T 827193221db34c2ea842a8f65f6eff8d P f99fb9bcc482400c86d168bb083f0a15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c6ace3b4d8b4276beec47ed32df9610" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 44631 } } peers { permanent_uuid: "f99fb9bcc482400c86d168bb083f0a15" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 43107 } } peers { permanent_uuid: "bc03d9af8c9e40ccabdcf0cf314bd167" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 34811 } }
I20260811 16:41:29.451283 24973 leader_election.cc:288] T 827193221db34c2ea842a8f65f6eff8d P f99fb9bcc482400c86d168bb083f0a15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c6ace3b4d8b4276beec47ed32df9610 (127.24.175.195:44631), bc03d9af8c9e40ccabdcf0cf314bd167 (127.24.175.194:34811)
I20260811 16:41:29.453975 24959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:29.451493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:45895 (local address 127.24.175.194:34811)
0811 16:41:29.451557 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:29.451558 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:29.451713 (+ 155us) server_negotiation.cc:407] Connection header received
0811 16:41:29.451770 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:29.451771 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:29.451780 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:29.451822 (+ 42us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:41:29.451965 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:29.452430 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:29.453321 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:29.453682 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:29.453741 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:29.453750 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:29.453878 (+ 128us) server_negotiation.cc:299] Negotiation successful
0811 16:41:29.453911 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 16:41:29.453984 24956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:29.451576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:38545 (local address 127.24.175.195:44631)
0811 16:41:29.451624 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:29.451626 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:29.451633 (+ 7us) server_negotiation.cc:407] Connection header received
0811 16:41:29.451656 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:29.451657 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:29.451664 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:29.451721 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:41:29.451853 (+ 132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:29.452386 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:29.453282 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:29.453667 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:29.453736 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:29.453746 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:29.453884 (+ 138us) server_negotiation.cc:299] Negotiation successful
0811 16:41:29.453920 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 16:41:29.453991 24463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:29.451447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.195:44631 (local address 127.24.175.193:38545)
0811 16:41:29.451502 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:29.451511 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:41:29.451555 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:41:29.451719 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:41:29.451720 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:41:29.451721 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:41:29.451798 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:29.451800 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:29.452457 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:29.452458 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:29.453189 (+ 731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:29.453191 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:29.453739 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:29.453740 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:29.453823 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:29.453826 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:41:29.453869 (+ 43us) client_negotiation.cc:240] Negotiation successful
0811 16:41:29.453910 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260811 16:41:29.453998 24978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:29.451470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.194:34811 (local address 127.24.175.193:45895)
0811 16:41:29.451639 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:29.451649 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:41:29.451711 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:41:29.451829 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:41:29.451830 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:41:29.451831 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:41:29.451908 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:29.451910 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:29.452496 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:29.452496 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:29.453241 (+ 745us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:29.453243 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:29.453748 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:29.453749 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:29.453817 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:29.453821 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:41:29.453865 (+ 44us) client_negotiation.cc:240] Negotiation successful
0811 16:41:29.453905 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":69,"threads_started":1}
I20260811 16:41:29.454337 24855 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "827193221db34c2ea842a8f65f6eff8d" candidate_uuid: "f99fb9bcc482400c86d168bb083f0a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c6ace3b4d8b4276beec47ed32df9610" is_pre_election: true
I20260811 16:41:29.454489 24855 raft_consensus.cc:2454] T 827193221db34c2ea842a8f65f6eff8d P 5c6ace3b4d8b4276beec47ed32df9610 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f99fb9bcc482400c86d168bb083f0a15 in term 0.
I20260811 16:41:29.454546 24616 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "827193221db34c2ea842a8f65f6eff8d" candidate_uuid: "f99fb9bcc482400c86d168bb083f0a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc03d9af8c9e40ccabdcf0cf314bd167" is_pre_election: true
I20260811 16:41:29.454715 24616 raft_consensus.cc:2454] T 827193221db34c2ea842a8f65f6eff8d P bc03d9af8c9e40ccabdcf0cf314bd167 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f99fb9bcc482400c86d168bb083f0a15 in term 0.
I20260811 16:41:29.454713 24274 leader_election.cc:302] T 827193221db34c2ea842a8f65f6eff8d P f99fb9bcc482400c86d168bb083f0a15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c6ace3b4d8b4276beec47ed32df9610, f99fb9bcc482400c86d168bb083f0a15; no voters:
I20260811 16:41:29.454893 24973 raft_consensus.cc:2781] T 827193221db34c2ea842a8f65f6eff8d P f99fb9bcc482400c86d168bb083f0a15 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:41:29.454962 24973 raft_consensus.cc:482] T 827193221db34c2ea842a8f65f6eff8d P f99fb9bcc482400c86d168bb083f0a15 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:41:29.454986 24973 raft_consensus.cc:3037] T 827193221db34c2ea842a8f65f6eff8d P f99fb9bcc482400c86d168bb083f0a15 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:41:29.455832 24973 raft_consensus.cc:504] T 827193221db34c2ea842a8f65f6eff8d P f99fb9bcc482400c86d168bb083f0a15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c6ace3b4d8b4276beec47ed32df9610" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 44631 } } peers { permanent_uuid: "f99fb9bcc482400c86d168bb083f0a15" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 43107 } } peers { permanent_uuid: "bc03d9af8c9e40ccabdcf0cf314bd167" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 34811 } }
I20260811 16:41:29.456029 24973 leader_election.cc:288] T 827193221db34c2ea842a8f65f6eff8d P f99fb9bcc482400c86d168bb083f0a15 [CANDIDATE]: Term 1 election: Requested vote from peers 5c6ace3b4d8b4276beec47ed32df9610 (127.24.175.195:44631), bc03d9af8c9e40ccabdcf0cf314bd167 (127.24.175.194:34811)
I20260811 16:41:29.456089 24616 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "827193221db34c2ea842a8f65f6eff8d" candidate_uuid: "f99fb9bcc482400c86d168bb083f0a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc03d9af8c9e40ccabdcf0cf314bd167"
I20260811 16:41:29.456163 24616 raft_consensus.cc:3037] T 827193221db34c2ea842a8f65f6eff8d P bc03d9af8c9e40ccabdcf0cf314bd167 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:41:29.456166 24855 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "827193221db34c2ea842a8f65f6eff8d" candidate_uuid: "f99fb9bcc482400c86d168bb083f0a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c6ace3b4d8b4276beec47ed32df9610"
I20260811 16:41:29.456248 24855 raft_consensus.cc:3037] T 827193221db34c2ea842a8f65f6eff8d P 5c6ace3b4d8b4276beec47ed32df9610 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:41:29.456857 24616 raft_consensus.cc:2454] T 827193221db34c2ea842a8f65f6eff8d P bc03d9af8c9e40ccabdcf0cf314bd167 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f99fb9bcc482400c86d168bb083f0a15 in term 1.
I20260811 16:41:29.457027 24275 leader_election.cc:302] T 827193221db34c2ea842a8f65f6eff8d P f99fb9bcc482400c86d168bb083f0a15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc03d9af8c9e40ccabdcf0cf314bd167, f99fb9bcc482400c86d168bb083f0a15; no voters:
I20260811 16:41:29.457028 24855 raft_consensus.cc:2454] T 827193221db34c2ea842a8f65f6eff8d P 5c6ace3b4d8b4276beec47ed32df9610 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f99fb9bcc482400c86d168bb083f0a15 in term 1.
I20260811 16:41:29.457131 24973 raft_consensus.cc:2781] T 827193221db34c2ea842a8f65f6eff8d P f99fb9bcc482400c86d168bb083f0a15 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:41:29.457293 24973 raft_consensus.cc:686] T 827193221db34c2ea842a8f65f6eff8d P f99fb9bcc482400c86d168bb083f0a15 [term 1 LEADER]: Becoming Leader. State: Replica: f99fb9bcc482400c86d168bb083f0a15, State: Running, Role: LEADER
I20260811 16:41:29.457379 24973 consensus_queue.cc:237] T 827193221db34c2ea842a8f65f6eff8d P f99fb9bcc482400c86d168bb083f0a15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c6ace3b4d8b4276beec47ed32df9610" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 44631 } } peers { permanent_uuid: "f99fb9bcc482400c86d168bb083f0a15" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 43107 } } peers { permanent_uuid: "bc03d9af8c9e40ccabdcf0cf314bd167" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 34811 } }
I20260811 16:41:29.458176 24152 catalog_manager.cc:5495] T 827193221db34c2ea842a8f65f6eff8d P f99fb9bcc482400c86d168bb083f0a15 reported cstate change: term changed from 0 to 1, leader changed from <none> to f99fb9bcc482400c86d168bb083f0a15 (127.24.175.193). New cstate: current_term: 1 leader_uuid: "f99fb9bcc482400c86d168bb083f0a15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c6ace3b4d8b4276beec47ed32df9610" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 44631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f99fb9bcc482400c86d168bb083f0a15" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 43107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc03d9af8c9e40ccabdcf0cf314bd167" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 34811 } health_report { overall_health: UNKNOWN } } }
I20260811 16:41:29.479921 24960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:29.477694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54884 (local address 127.24.175.193:43107)
0811 16:41:29.477741 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:29.477743 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:29.477750 (+ 7us) server_negotiation.cc:407] Connection header received
0811 16:41:29.477782 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:29.477783 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:29.477798 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:29.477856 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:41:29.477983 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:29.478468 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:29.479194 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:29.479381 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:29.479435 (+ 54us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:29.479591 (+ 156us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:41:29.479687 (+ 96us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:41:29.479771 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:29.479825 (+ 54us) server_negotiation.cc:299] Negotiation successful
0811 16:41:29.479834 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 16:41:29.481603 24616 raft_consensus.cc:1261] T 827193221db34c2ea842a8f65f6eff8d P bc03d9af8c9e40ccabdcf0cf314bd167 [term 1 FOLLOWER]: Refusing update from remote peer f99fb9bcc482400c86d168bb083f0a15: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:41:29.481614 24855 raft_consensus.cc:1261] T 827193221db34c2ea842a8f65f6eff8d P 5c6ace3b4d8b4276beec47ed32df9610 [term 1 FOLLOWER]: Refusing update from remote peer f99fb9bcc482400c86d168bb083f0a15: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:41:29.481936 24980 consensus_queue.cc:1035] T 827193221db34c2ea842a8f65f6eff8d P f99fb9bcc482400c86d168bb083f0a15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc03d9af8c9e40ccabdcf0cf314bd167" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 34811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:41:29.482057 24973 consensus_queue.cc:1035] T 827193221db34c2ea842a8f65f6eff8d P f99fb9bcc482400c86d168bb083f0a15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c6ace3b4d8b4276beec47ed32df9610" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 44631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:41:29.485342 24993 mvcc.cc:205] Tried to move back new op lower bound from 7317366740914270208 to 7317366740818075648. Current Snapshot: MvccSnapshot[applied={T|T < 7317366740914270208 or (T in {7317366740914270208})}]
I20260811 16:41:29.486258 24992 mvcc.cc:205] Tried to move back new op lower bound from 7317366740914270208 to 7317366740818075648. Current Snapshot: MvccSnapshot[applied={T|T < 7317366740914270208 or (T in {7317366740914270208})}]
I20260811 16:41:29.486646 24147 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45868:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:41:29.486735 24147 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45868:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:41:29.487411 24147 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 14bcc1b3967b47d6a1c0051a63f8f736: Sending DeleteTablet for 3 replicas of tablet 827193221db34c2ea842a8f65f6eff8d
I20260811 16:41:29.487723 24817 tablet_service.cc:1514] Processing DeleteTablet for tablet 827193221db34c2ea842a8f65f6eff8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:41:29 UTC) from {username='kudu', principal='kudu/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:57116
I20260811 16:41:29.487744 24360 tablet_service.cc:1514] Processing DeleteTablet for tablet 827193221db34c2ea842a8f65f6eff8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:41:29 UTC) from {username='kudu', principal='kudu/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:54870
I20260811 16:41:29.487766 24577 tablet_service.cc:1514] Processing DeleteTablet for tablet 827193221db34c2ea842a8f65f6eff8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:41:29 UTC) from {username='kudu', principal='kudu/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:54444
I20260811 16:41:29.487996 25006 tablet_replica.cc:330] T 827193221db34c2ea842a8f65f6eff8d P 5c6ace3b4d8b4276beec47ed32df9610: stopping tablet replica
I20260811 16:41:29.488099 25006 raft_consensus.cc:2229] T 827193221db34c2ea842a8f65f6eff8d P 5c6ace3b4d8b4276beec47ed32df9610 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:41:29.488188 25006 raft_consensus.cc:2258] T 827193221db34c2ea842a8f65f6eff8d P 5c6ace3b4d8b4276beec47ed32df9610 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:41:29.488273 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 24252
I20260811 16:41:29.494000 25007 tablet_replica.cc:330] T 827193221db34c2ea842a8f65f6eff8d P bc03d9af8c9e40ccabdcf0cf314bd167: stopping tablet replica
I20260811 16:41:29.494122 25007 raft_consensus.cc:2229] T 827193221db34c2ea842a8f65f6eff8d P bc03d9af8c9e40ccabdcf0cf314bd167 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:41:29.494240 25007 raft_consensus.cc:2258] T 827193221db34c2ea842a8f65f6eff8d P bc03d9af8c9e40ccabdcf0cf314bd167 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:41:29.496722 25007 ts_tablet_manager.cc:1905] T 827193221db34c2ea842a8f65f6eff8d P bc03d9af8c9e40ccabdcf0cf314bd167: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:41:29.498742 25007 ts_tablet_manager.cc:1918] T 827193221db34c2ea842a8f65f6eff8d P bc03d9af8c9e40ccabdcf0cf314bd167: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:41:29.498842 25007 log.cc:1196] T 827193221db34c2ea842a8f65f6eff8d P bc03d9af8c9e40ccabdcf0cf314bd167: Deleting WAL directory at /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/ts-1/wal/wals/827193221db34c2ea842a8f65f6eff8d
I20260811 16:41:29.499173 25007 ts_tablet_manager.cc:1939] T 827193221db34c2ea842a8f65f6eff8d P bc03d9af8c9e40ccabdcf0cf314bd167: Deleting consensus metadata
I20260811 16:41:29.499908 24126 catalog_manager.cc:4841] TS bc03d9af8c9e40ccabdcf0cf314bd167 (127.24.175.194:34811): tablet 827193221db34c2ea842a8f65f6eff8d (table test-table [id=06a98501d151490c8d5a7a9521425d0a]) successfully deleted
I20260811 16:41:29.500743 25006 ts_tablet_manager.cc:1905] T 827193221db34c2ea842a8f65f6eff8d P 5c6ace3b4d8b4276beec47ed32df9610: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:41:29.502079 25006 ts_tablet_manager.cc:1918] T 827193221db34c2ea842a8f65f6eff8d P 5c6ace3b4d8b4276beec47ed32df9610: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:41:29.502143 25006 log.cc:1196] T 827193221db34c2ea842a8f65f6eff8d P 5c6ace3b4d8b4276beec47ed32df9610: Deleting WAL directory at /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466249441839-25279-0/minicluster-data/ts-2/wal/wals/827193221db34c2ea842a8f65f6eff8d
I20260811 16:41:29.502449 25006 ts_tablet_manager.cc:1939] T 827193221db34c2ea842a8f65f6eff8d P 5c6ace3b4d8b4276beec47ed32df9610: Deleting consensus metadata
I20260811 16:41:29.502890 24125 catalog_manager.cc:4841] TS 5c6ace3b4d8b4276beec47ed32df9610 (127.24.175.195:44631): tablet 827193221db34c2ea842a8f65f6eff8d (table test-table [id=06a98501d151490c8d5a7a9521425d0a]) successfully deleted
W20260811 16:41:29.508404 24125 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.24.175.193:43107 (error 108)
I20260811 16:41:29.508615 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 24474
I20260811 16:41:29.516188 24955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:29.516030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.193:43107 (local address 127.0.0.1:54892)
0811 16:41:29.516093 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:29.516148 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.193:43107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260811 16:41:29.516319 24125 catalog_manager.cc:4584] TS f99fb9bcc482400c86d168bb083f0a15 (127.24.175.193:43107): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 827193221db34c2ea842a8f65f6eff8d: Network error: Client connection negotiation failed: client connection to 127.24.175.193:43107: connect: Connection refused (error 111)
I20260811 16:41:29.519825 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 24703
I20260811 16:41:29.529760 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 24098
2026-08-11T16:41:29Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2168 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-11T16:41:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:41:29Z Disabled control of system clock
I20260811 16:41:29.562047 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:35405
--webserver_interface=127.24.175.254
--webserver_port=0
--builtin_ntp_servers=127.24.175.212:43461
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.175.254:35405
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 16:41:29.642846 25015 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:41:29.643054 25015 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:41:29.643071 25015 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:41:29.644183 25015 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:41:29.644223 25015 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:41:29.644235 25015 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:41:29.644256 25015 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:41:29.644279 25015 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:41:29.645606 25015 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:43461
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.175.254:35405
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:35405
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25015
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:41:29.645845 25015 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:41:29.646123 25015 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:41:29.650674 25022 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:41:29.650718 25024 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:41:29.650763 25026 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:29.650792 25015 server_base.cc:1034] running on GCE node
I20260811 16:41:29.651147 25015 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:41:29.651419 25015 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:41:29.652557 25015 hybrid_clock.cc:648] HybridClock initialized: now 1786466489652540 us; error 30 us; skew 500 ppm
I20260811 16:41:29.656921 25015 webserver.cc:460] Webserver started at http://127.24.175.254:39689/ using document root <none> and password file <none>
I20260811 16:41:29.657135 25015 fs_manager.cc:359] Metadata directory not provided
I20260811 16:41:29.657181 25015 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:41:29.657310 25015 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:41:29.658434 25015 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/master-0/data/instance:
uuid: "52d5bf29cae34986b12025addfe3e0bf"
format_stamp: "Formatted at 2026-08-11 16:41:29 on dist-test-slave-zj8q"
server_key: "4f53ab14838115fc518766757973531d"
server_key_iv: "a95c7e17b4247928eac35435ffd7e6bc"
server_key_version: "encryptionkey@0"
I20260811 16:41:29.658778 25015 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/master-0/wal/instance:
uuid: "52d5bf29cae34986b12025addfe3e0bf"
format_stamp: "Formatted at 2026-08-11 16:41:29 on dist-test-slave-zj8q"
server_key: "4f53ab14838115fc518766757973531d"
server_key_iv: "a95c7e17b4247928eac35435ffd7e6bc"
server_key_version: "encryptionkey@0"
I20260811 16:41:29.659969 25015 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:41:29.660620 25036 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:29.660768 25015 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:41:29.660851 25015 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/master-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/master-0/wal
uuid: "52d5bf29cae34986b12025addfe3e0bf"
format_stamp: "Formatted at 2026-08-11 16:41:29 on dist-test-slave-zj8q"
server_key: "4f53ab14838115fc518766757973531d"
server_key_iv: "a95c7e17b4247928eac35435ffd7e6bc"
server_key_version: "encryptionkey@0"
I20260811 16:41:29.660917 25015 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:41:29.677481 25015 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:41:29.677773 25015 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:41:29.677892 25015 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:41:29.681558 25015 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.254:35405
I20260811 16:41:29.681612 25127 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.254:35405 every 8 connection(s)
I20260811 16:41:29.681907 25015 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
I20260811 16:41:29.682875 25128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:41:29.685124 25128 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 52d5bf29cae34986b12025addfe3e0bf: Bootstrap starting.
I20260811 16:41:29.685705 25128 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 52d5bf29cae34986b12025addfe3e0bf: Neither blocks nor log segments found. Creating new log.
I20260811 16:41:29.685971 25128 log.cc:824] T 00000000000000000000000000000000 P 52d5bf29cae34986b12025addfe3e0bf: Log is configured to *not* fsync() on all Append() calls
I20260811 16:41:29.686448 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 25015
I20260811 16:41:29.686538 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/master-0/wal/instance
I20260811 16:41:29.686674 25128 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 52d5bf29cae34986b12025addfe3e0bf: No bootstrap required, opened a new log
I20260811 16:41:29.686699 25279 external_mini_cluster.cc:1428] Setting key 6579813ea9ab3fd67bad4c5f53597937
I20260811 16:41:29.689524 25128 raft_consensus.cc:348] T 00000000000000000000000000000000 P 52d5bf29cae34986b12025addfe3e0bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52d5bf29cae34986b12025addfe3e0bf" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 35405 } }
I20260811 16:41:29.689694 25128 raft_consensus.cc:374] T 00000000000000000000000000000000 P 52d5bf29cae34986b12025addfe3e0bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:41:29.689746 25128 raft_consensus.cc:729] T 00000000000000000000000000000000 P 52d5bf29cae34986b12025addfe3e0bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52d5bf29cae34986b12025addfe3e0bf, State: Initialized, Role: FOLLOWER
I20260811 16:41:29.689872 25128 consensus_queue.cc:260] T 00000000000000000000000000000000 P 52d5bf29cae34986b12025addfe3e0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52d5bf29cae34986b12025addfe3e0bf" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 35405 } }
I20260811 16:41:29.689945 25128 raft_consensus.cc:388] T 00000000000000000000000000000000 P 52d5bf29cae34986b12025addfe3e0bf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:41:29.689966 25128 raft_consensus.cc:482] T 00000000000000000000000000000000 P 52d5bf29cae34986b12025addfe3e0bf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:41:29.690011 25128 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 52d5bf29cae34986b12025addfe3e0bf [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:41:29.690569 25128 raft_consensus.cc:504] T 00000000000000000000000000000000 P 52d5bf29cae34986b12025addfe3e0bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52d5bf29cae34986b12025addfe3e0bf" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 35405 } }
I20260811 16:41:29.690676 25128 leader_election.cc:302] T 00000000000000000000000000000000 P 52d5bf29cae34986b12025addfe3e0bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 52d5bf29cae34986b12025addfe3e0bf; no voters:
I20260811 16:41:29.690842 25128 leader_election.cc:288] T 00000000000000000000000000000000 P 52d5bf29cae34986b12025addfe3e0bf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:41:29.690883 25137 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 52d5bf29cae34986b12025addfe3e0bf [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:41:29.691025 25137 raft_consensus.cc:686] T 00000000000000000000000000000000 P 52d5bf29cae34986b12025addfe3e0bf [term 1 LEADER]: Becoming Leader. State: Replica: 52d5bf29cae34986b12025addfe3e0bf, State: Running, Role: LEADER
I20260811 16:41:29.691072 25128 sys_catalog.cc:564] T 00000000000000000000000000000000 P 52d5bf29cae34986b12025addfe3e0bf [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:41:29.691111 25137 consensus_queue.cc:237] T 00000000000000000000000000000000 P 52d5bf29cae34986b12025addfe3e0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52d5bf29cae34986b12025addfe3e0bf" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 35405 } }
I20260811 16:41:29.691452 25141 sys_catalog.cc:455] T 00000000000000000000000000000000 P 52d5bf29cae34986b12025addfe3e0bf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "52d5bf29cae34986b12025addfe3e0bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52d5bf29cae34986b12025addfe3e0bf" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 35405 } } }
I20260811 16:41:29.691522 25141 sys_catalog.cc:458] T 00000000000000000000000000000000 P 52d5bf29cae34986b12025addfe3e0bf [sys.catalog]: This master's current role is: LEADER
I20260811 16:41:29.691694 25142 sys_catalog.cc:455] T 00000000000000000000000000000000 P 52d5bf29cae34986b12025addfe3e0bf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 52d5bf29cae34986b12025addfe3e0bf. Latest consensus state: current_term: 1 leader_uuid: "52d5bf29cae34986b12025addfe3e0bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52d5bf29cae34986b12025addfe3e0bf" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 35405 } } }
I20260811 16:41:29.691751 25142 sys_catalog.cc:458] T 00000000000000000000000000000000 P 52d5bf29cae34986b12025addfe3e0bf [sys.catalog]: This master's current role is: LEADER
I20260811 16:41:29.692338 25146 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:41:29.692845 25146 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:41:29.692868 25135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:29.687173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42282 (local address 127.24.175.254:35405)
0811 16:41:29.687390 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:29.687400 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:29.687432 (+ 32us) server_negotiation.cc:407] Connection header received
0811 16:41:29.687994 (+ 562us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:29.688005 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:29.688083 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:29.688241 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:41:29.688384 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:29.689734 (+ 1350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:29.690606 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:29.691207 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:29.691401 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:29.692062 (+ 661us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:41:29.692066 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:41:29.692067 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:41:29.692270 (+ 203us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:41:29.692318 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:41:29.692333 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:41:29.692392 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:29.692590 (+ 198us) server_negotiation.cc:299] Negotiation successful
0811 16:41:29.692671 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":83,"threads_started":1}
I20260811 16:41:29.694190 25146 catalog_manager.cc:1347] Generated new cluster ID: dbd8ba529906416a9cf41ec911a128c4
I20260811 16:41:29.694237 25146 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:41:29.709903 25146 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:41:29.710634 25146 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:41:29.715044 25146 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 52d5bf29cae34986b12025addfe3e0bf: Generated new TSK 0
I20260811 16:41:29.715225 25146 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:41:29.723519 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.193:0
--local_ip_for_outbound_sockets=127.24.175.193
--webserver_interface=127.24.175.193
--webserver_port=0
--tserver_master_addrs=127.24.175.254:35405
--builtin_ntp_servers=127.24.175.212:43461
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 16:41:29.805675 25179 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:41:29.805886 25179 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:41:29.805917 25179 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:41:29.807088 25179 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:41:29.807134 25179 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:41:29.807166 25179 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.193
I20260811 16:41:29.808630 25179 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:43461
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.175.193
--webserver_port=0
--tserver_master_addrs=127.24.175.254:35405
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25179
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.193
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:41:29.808876 25179 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:41:29.809155 25179 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:41:29.814845 25189 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:41:29.814842 25191 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:41:29.814858 25186 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:29.815097 25179 server_base.cc:1034] running on GCE node
I20260811 16:41:29.815301 25179 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:41:29.815516 25179 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:41:29.816663 25179 hybrid_clock.cc:648] HybridClock initialized: now 1786466489816651 us; error 30 us; skew 500 ppm
I20260811 16:41:29.817801 25179 webserver.cc:460] Webserver started at http://127.24.175.193:46557/ using document root <none> and password file <none>
I20260811 16:41:29.818038 25179 fs_manager.cc:359] Metadata directory not provided
I20260811 16:41:29.818089 25179 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:41:29.818262 25179 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:41:29.819288 25179 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/ts-0/data/instance:
uuid: "db34d862996e4ed5aa731cd30e5b0550"
format_stamp: "Formatted at 2026-08-11 16:41:29 on dist-test-slave-zj8q"
server_key: "5ea2ab0eda9507b7c51f8fb52022fda1"
server_key_iv: "564fa13eef2e7670d62ddd3861f8643d"
server_key_version: "encryptionkey@0"
I20260811 16:41:29.819628 25179 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/ts-0/wal/instance:
uuid: "db34d862996e4ed5aa731cd30e5b0550"
format_stamp: "Formatted at 2026-08-11 16:41:29 on dist-test-slave-zj8q"
server_key: "5ea2ab0eda9507b7c51f8fb52022fda1"
server_key_iv: "564fa13eef2e7670d62ddd3861f8643d"
server_key_version: "encryptionkey@0"
I20260811 16:41:29.820873 25179 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:41:29.821627 25201 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:29.821800 25179 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:41:29.821887 25179 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/ts-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/ts-0/wal
uuid: "db34d862996e4ed5aa731cd30e5b0550"
format_stamp: "Formatted at 2026-08-11 16:41:29 on dist-test-slave-zj8q"
server_key: "5ea2ab0eda9507b7c51f8fb52022fda1"
server_key_iv: "564fa13eef2e7670d62ddd3861f8643d"
server_key_version: "encryptionkey@0"
I20260811 16:41:29.821957 25179 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:41:29.833341 25179 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:41:29.833607 25179 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:41:29.833729 25179 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:41:29.833922 25179 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:41:29.834271 25179 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:41:29.834311 25179 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:29.834337 25179 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:41:29.834362 25179 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:29.840126 25179 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.193:46563
I20260811 16:41:29.840163 25411 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.193:46563 every 8 connection(s)
I20260811 16:41:29.840489 25179 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
I20260811 16:41:29.845494 25135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:29.841184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:59073 (local address 127.24.175.254:35405)
0811 16:41:29.841257 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:29.841259 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:29.841448 (+ 189us) server_negotiation.cc:407] Connection header received
0811 16:41:29.841967 (+ 519us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:29.841968 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:29.841986 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:29.842037 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:41:29.842760 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:29.843265 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:29.844228 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:29.844422 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:29.844478 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:29.845243 (+ 765us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:41:29.845245 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:41:29.845245 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:41:29.845250 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:41:29.845264 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:41:29.845267 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:41:29.845309 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:29.845387 (+ 78us) server_negotiation.cc:299] Negotiation successful
0811 16:41:29.845414 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 16:41:29.845706 25415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:29.841147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:35405 (local address 127.24.175.193:59073)
0811 16:41:29.841330 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:29.841366 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 16:41:29.841869 (+ 503us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:41:29.842117 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:41:29.842121 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:41:29.842131 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:41:29.842661 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:29.842667 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:29.843350 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:29.843351 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:29.844138 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:29.844140 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:29.844497 (+ 357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:29.844498 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:29.844636 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:29.845109 (+ 473us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 16:41:29.845110 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:41:29.845139 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 16:41:29.845161 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:41:29.845315 (+ 154us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:41:29.845321 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:41:29.845325 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:41:29.845386 (+ 61us) client_negotiation.cc:240] Negotiation successful
0811 16:41:29.845492 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":79,"threads_started":1}
I20260811 16:41:29.846200 25413 heartbeater.cc:347] Connected to a master server at 127.24.175.254:35405
I20260811 16:41:29.846293 25413 heartbeater.cc:464] Registering TS with master...
I20260811 16:41:29.846462 25413 heartbeater.cc:511] Master 127.24.175.254:35405 requested a full tablet report, sending...
I20260811 16:41:29.846937 25064 ts_manager.cc:194] Registered new tserver with Master: db34d862996e4ed5aa731cd30e5b0550 (127.24.175.193:46563)
I20260811 16:41:29.847640 25064 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.24.175.193:59073
I20260811 16:41:29.848946 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 25179
I20260811 16:41:29.849045 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/ts-0/wal/instance
I20260811 16:41:29.849222 25279 external_mini_cluster.cc:1428] Setting key 74888124f0bf2d9def35a59f0a08d78b
I20260811 16:41:29.850030 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.194:0
--local_ip_for_outbound_sockets=127.24.175.194
--webserver_interface=127.24.175.194
--webserver_port=0
--tserver_master_addrs=127.24.175.254:35405
--builtin_ntp_servers=127.24.175.212:43461
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 16:41:29.930603 25417 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:41:29.930787 25417 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:41:29.930807 25417 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:41:29.931867 25417 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:41:29.931900 25417 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:41:29.931922 25417 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.194
I20260811 16:41:29.933198 25417 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:43461
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.175.194
--webserver_port=0
--tserver_master_addrs=127.24.175.254:35405
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25417
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.194
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:41:29.933391 25417 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:41:29.933633 25417 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:41:29.938407 25427 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:41:29.938414 25426 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:41:29.938432 25429 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:29.938663 25417 server_base.cc:1034] running on GCE node
I20260811 16:41:29.938877 25417 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:41:29.939069 25417 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:41:29.940200 25417 hybrid_clock.cc:648] HybridClock initialized: now 1786466489940185 us; error 32 us; skew 500 ppm
I20260811 16:41:29.941380 25417 webserver.cc:460] Webserver started at http://127.24.175.194:39987/ using document root <none> and password file <none>
I20260811 16:41:29.941609 25417 fs_manager.cc:359] Metadata directory not provided
I20260811 16:41:29.941653 25417 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:41:29.941778 25417 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:41:29.942869 25417 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/ts-1/data/instance:
uuid: "edbd92fdd66b4be398f2f3ed6e80d393"
format_stamp: "Formatted at 2026-08-11 16:41:29 on dist-test-slave-zj8q"
server_key: "3f6211b2c8a5d1c88f7da60c0b50aef2"
server_key_iv: "c613df16f5ab701b5709f5ea907baa06"
server_key_version: "encryptionkey@0"
I20260811 16:41:29.943184 25417 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/ts-1/wal/instance:
uuid: "edbd92fdd66b4be398f2f3ed6e80d393"
format_stamp: "Formatted at 2026-08-11 16:41:29 on dist-test-slave-zj8q"
server_key: "3f6211b2c8a5d1c88f7da60c0b50aef2"
server_key_iv: "c613df16f5ab701b5709f5ea907baa06"
server_key_version: "encryptionkey@0"
I20260811 16:41:29.944348 25417 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:41:29.944983 25436 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:29.945128 25417 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:41:29.945218 25417 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/ts-1/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/ts-1/wal
uuid: "edbd92fdd66b4be398f2f3ed6e80d393"
format_stamp: "Formatted at 2026-08-11 16:41:29 on dist-test-slave-zj8q"
server_key: "3f6211b2c8a5d1c88f7da60c0b50aef2"
server_key_iv: "c613df16f5ab701b5709f5ea907baa06"
server_key_version: "encryptionkey@0"
I20260811 16:41:29.945281 25417 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:41:29.959246 25417 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:41:29.959518 25417 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:41:29.959642 25417 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:41:29.959846 25417 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:41:29.960171 25417 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:41:29.960206 25417 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:29.960243 25417 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:41:29.960268 25417 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:29.965790 25417 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.194:39181
I20260811 16:41:29.965850 25628 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.194:39181 every 8 connection(s)
I20260811 16:41:29.966144 25417 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
I20260811 16:41:29.971123 25135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:29.966921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:43115 (local address 127.24.175.254:35405)
0811 16:41:29.966979 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:29.966981 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:29.967201 (+ 220us) server_negotiation.cc:407] Connection header received
0811 16:41:29.967698 (+ 497us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:29.967699 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:29.967712 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:29.967761 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:41:29.968415 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:29.968911 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:29.969873 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:29.970067 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:29.970124 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:29.970869 (+ 745us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:41:29.970871 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:41:29.970871 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:41:29.970875 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:41:29.970890 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:41:29.970895 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:41:29.970940 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:29.971013 (+ 73us) server_negotiation.cc:299] Negotiation successful
0811 16:41:29.971042 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 16:41:29.971329 25631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:29.966906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:35405 (local address 127.24.175.194:43115)
0811 16:41:29.967088 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:29.967122 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 16:41:29.967602 (+ 480us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:41:29.967832 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:41:29.967836 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:41:29.967846 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:41:29.968327 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:29.968331 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:29.968999 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:29.969000 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:29.969790 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:29.969793 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:29.970142 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:29.970143 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:29.970292 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:29.970741 (+ 449us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 16:41:29.970741 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:41:29.970768 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 16:41:29.970792 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:41:29.970944 (+ 152us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:41:29.970950 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:41:29.970953 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:41:29.971011 (+ 58us) client_negotiation.cc:240] Negotiation successful
0811 16:41:29.971115 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":73,"threads_started":1}
I20260811 16:41:29.971778 25629 heartbeater.cc:347] Connected to a master server at 127.24.175.254:35405
I20260811 16:41:29.971863 25629 heartbeater.cc:464] Registering TS with master...
I20260811 16:41:29.972005 25629 heartbeater.cc:511] Master 127.24.175.254:35405 requested a full tablet report, sending...
I20260811 16:41:29.972338 25064 ts_manager.cc:194] Registered new tserver with Master: edbd92fdd66b4be398f2f3ed6e80d393 (127.24.175.194:39181)
I20260811 16:41:29.972718 25064 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.24.175.194:43115
I20260811 16:41:29.975131 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 25417
I20260811 16:41:29.975217 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/ts-1/wal/instance
I20260811 16:41:29.975381 25279 external_mini_cluster.cc:1428] Setting key 15483b98e28ffbe2a5578c26217a84d8
I20260811 16:41:29.976171 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.195:0
--local_ip_for_outbound_sockets=127.24.175.195
--webserver_interface=127.24.175.195
--webserver_port=0
--tserver_master_addrs=127.24.175.254:35405
--builtin_ntp_servers=127.24.175.212:43461
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 16:41:30.060217 25632 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:41:30.060424 25632 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:41:30.060456 25632 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:41:30.061573 25632 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:41:30.061612 25632 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:41:30.061645 25632 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.195
I20260811 16:41:30.063064 25632 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:43461
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.175.195
--webserver_port=0
--tserver_master_addrs=127.24.175.254:35405
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25632
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.195
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:41:30.063304 25632 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:41:30.063577 25632 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:41:30.068642 25640 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:41:30.068639 25645 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:41:30.068638 25642 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:30.068657 25632 server_base.cc:1034] running on GCE node
I20260811 16:41:30.069001 25632 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:41:30.069248 25632 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:41:30.070389 25632 hybrid_clock.cc:648] HybridClock initialized: now 1786466490070371 us; error 37 us; skew 500 ppm
I20260811 16:41:30.071607 25632 webserver.cc:460] Webserver started at http://127.24.175.195:44007/ using document root <none> and password file <none>
I20260811 16:41:30.071834 25632 fs_manager.cc:359] Metadata directory not provided
I20260811 16:41:30.071885 25632 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:41:30.072012 25632 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:41:30.073107 25632 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/ts-2/data/instance:
uuid: "7f6131c7396a41a1855e03cd855393c3"
format_stamp: "Formatted at 2026-08-11 16:41:30 on dist-test-slave-zj8q"
server_key: "42ee9db3001f2691237f3610f56e6907"
server_key_iv: "9ae2eadf42509ec8c490a436db239c07"
server_key_version: "encryptionkey@0"
I20260811 16:41:30.073441 25632 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/ts-2/wal/instance:
uuid: "7f6131c7396a41a1855e03cd855393c3"
format_stamp: "Formatted at 2026-08-11 16:41:30 on dist-test-slave-zj8q"
server_key: "42ee9db3001f2691237f3610f56e6907"
server_key_iv: "9ae2eadf42509ec8c490a436db239c07"
server_key_version: "encryptionkey@0"
I20260811 16:41:30.074759 25632 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:41:30.075412 25655 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:30.075567 25632 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:41:30.075654 25632 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/ts-2/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/ts-2/wal
uuid: "7f6131c7396a41a1855e03cd855393c3"
format_stamp: "Formatted at 2026-08-11 16:41:30 on dist-test-slave-zj8q"
server_key: "42ee9db3001f2691237f3610f56e6907"
server_key_iv: "9ae2eadf42509ec8c490a436db239c07"
server_key_version: "encryptionkey@0"
I20260811 16:41:30.075724 25632 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:41:30.095000 25632 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:41:30.095330 25632 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:41:30.095461 25632 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:41:30.095690 25632 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:41:30.096025 25632 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:41:30.096060 25632 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:30.096089 25632 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:41:30.096107 25632 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:30.101938 25632 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.195:39581
I20260811 16:41:30.101996 25862 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.195:39581 every 8 connection(s)
I20260811 16:41:30.102330 25632 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
I20260811 16:41:30.107455 25135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:30.103014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.195:60059 (local address 127.24.175.254:35405)
0811 16:41:30.103060 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:30.103062 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:30.103303 (+ 241us) server_negotiation.cc:407] Connection header received
0811 16:41:30.103828 (+ 525us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:30.103830 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:30.103843 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:30.103894 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:41:30.104612 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:30.105105 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:30.106099 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:30.106375 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:30.106435 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:30.107201 (+ 766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:41:30.107202 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:41:30.107203 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:41:30.107208 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:41:30.107223 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:41:30.107227 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:41:30.107272 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:30.107347 (+ 75us) server_negotiation.cc:299] Negotiation successful
0811 16:41:30.107375 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 16:41:30.107649 25866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:30.102985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:35405 (local address 127.24.175.195:60059)
0811 16:41:30.103191 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:30.103223 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0811 16:41:30.103727 (+ 504us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:41:30.103966 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:41:30.103970 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:41:30.103978 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:41:30.104510 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:30.104516 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:30.105193 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:30.105194 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:30.105992 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:30.105995 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:30.106453 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:30.106455 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:30.106580 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:30.107062 (+ 482us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 16:41:30.107063 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:41:30.107092 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 16:41:30.107123 (+ 31us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:41:30.107279 (+ 156us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:41:30.107284 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:41:30.107287 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:41:30.107346 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 16:41:30.107449 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":94,"threads_started":1}
I20260811 16:41:30.108106 25863 heartbeater.cc:347] Connected to a master server at 127.24.175.254:35405
I20260811 16:41:30.108180 25863 heartbeater.cc:464] Registering TS with master...
I20260811 16:41:30.108348 25863 heartbeater.cc:511] Master 127.24.175.254:35405 requested a full tablet report, sending...
I20260811 16:41:30.108693 25064 ts_manager.cc:194] Registered new tserver with Master: 7f6131c7396a41a1855e03cd855393c3 (127.24.175.195:39581)
I20260811 16:41:30.109035 25064 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.24.175.195:60059
I20260811 16:41:30.111614 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 25632
I20260811 16:41:30.111699 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/ts-2/wal/instance
I20260811 16:41:30.111860 25279 external_mini_cluster.cc:1428] Setting key 68c4b7992a350cbb09551c3adf44432d
I20260811 16:41:30.112784 25279 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 16:41:30.116684 25135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:30.114118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42294 (local address 127.24.175.254:35405)
0811 16:41:30.114172 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:30.114174 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:30.114282 (+ 108us) server_negotiation.cc:407] Connection header received
0811 16:41:30.114339 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:30.114339 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:30.114347 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:30.114393 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:41:30.114524 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:30.114971 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:30.115715 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:30.115890 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:30.115934 (+ 44us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:30.116472 (+ 538us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:41:30.116473 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:41:30.116473 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:41:30.116477 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:41:30.116489 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:41:30.116493 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:41:30.116557 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:30.116622 (+ 65us) server_negotiation.cc:299] Negotiation successful
0811 16:41:30.116631 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 16:41:30.118213 25064 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42294:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:41:30.119735 25064 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:41:30.125785 25886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:30.121781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.195:39581 (local address 127.0.0.1:56966)
0811 16:41:30.122046 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:30.122088 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 16:41:30.122170 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:41:30.122433 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:41:30.122436 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:41:30.122438 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:41:30.122509 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:30.122512 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:30.123509 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:30.123510 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:30.124669 (+ 1159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:30.124672 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:30.125517 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:30.125518 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:30.125596 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:30.125605 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 16:41:30.125661 (+ 56us) client_negotiation.cc:240] Negotiation successful
0811 16:41:30.125712 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":74,"threads_started":1}
I20260811 16:41:30.125808 25889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:30.121863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56966 (local address 127.24.175.195:39581)
0811 16:41:30.122261 (+ 398us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:30.122265 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:30.122277 (+ 12us) server_negotiation.cc:407] Connection header received
0811 16:41:30.122319 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:30.122321 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:30.122336 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:30.122411 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:41:30.122596 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:30.123432 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:30.124764 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:30.125361 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:30.125397 (+ 36us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:30.125454 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:30.125696 (+ 242us) server_negotiation.cc:299] Negotiation successful
0811 16:41:30.125735 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":360,"thread_start_us":75,"threads_started":1}
I20260811 16:41:30.126394 25891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:30.121943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57680 (local address 127.24.175.194:39181)
0811 16:41:30.122326 (+ 383us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:30.122330 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:30.122339 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:41:30.122376 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:30.122378 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:30.122392 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:30.122605 (+ 213us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:41:30.122667 (+ 62us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:30.123746 (+ 1079us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:30.125020 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:30.125851 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:30.125945 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:30.126028 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:30.126267 (+ 239us) server_negotiation.cc:299] Negotiation successful
0811 16:41:30.126306 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":335,"thread_start_us":90,"threads_started":1}
I20260811 16:41:30.126394 25893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:30.122006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.193:46563 (local address 127.0.0.1:56576)
0811 16:41:30.122511 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:30.122520 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:41:30.122569 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:41:30.122811 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:41:30.122812 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:41:30.122814 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:41:30.122852 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:30.122854 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:30.124024 (+ 1170us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:30.124025 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:30.124948 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:30.124950 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:30.126131 (+ 1181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:30.126132 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:30.126224 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:30.126229 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 16:41:30.126265 (+ 36us) client_negotiation.cc:240] Negotiation successful
0811 16:41:30.126307 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":489,"mutex_wait_us":1,"thread_start_us":103,"threads_started":1}
I20260811 16:41:30.126541 25739 tablet_service.cc:1467] Processing CreateTablet for tablet 9bd2d07e4c534dce9fa0a4f86cad52eb (DEFAULT_TABLE table=test-table [id=d1e03f037f3e40f48e69a82557885327]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:41:30.126410 25887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:30.121809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.194:39181 (local address 127.0.0.1:57680)
0811 16:41:30.122135 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:30.122145 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:41:30.122215 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:41:30.122493 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:41:30.122494 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:41:30.122495 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:41:30.122523 (+ 28us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:30.122524 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:30.123847 (+ 1323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:30.123848 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:30.124938 (+ 1090us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:30.124940 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:30.126097 (+ 1157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:30.126098 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:30.126194 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:30.126198 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:41:30.126253 (+ 55us) client_negotiation.cc:240] Negotiation successful
0811 16:41:30.126294 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":309,"mutex_wait_us":36,"thread_start_us":110,"threads_started":1}
I20260811 16:41:30.126910 25739 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9bd2d07e4c534dce9fa0a4f86cad52eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:41:30.127161 25897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:30.122140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56576 (local address 127.24.175.193:46563)
0811 16:41:30.122336 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:30.122340 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:30.122621 (+ 281us) server_negotiation.cc:407] Connection header received
0811 16:41:30.122666 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:30.122668 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:30.122682 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:30.122747 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:41:30.122918 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:30.123955 (+ 1037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:30.125029 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:30.125779 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:30.126853 (+ 1074us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:30.127001 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:30.127027 (+ 26us) server_negotiation.cc:299] Negotiation successful
0811 16:41:30.127069 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":115,"threads_started":1}
I20260811 16:41:30.127391 25520 tablet_service.cc:1467] Processing CreateTablet for tablet 9bd2d07e4c534dce9fa0a4f86cad52eb (DEFAULT_TABLE table=test-table [id=d1e03f037f3e40f48e69a82557885327]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:41:30.127779 25520 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9bd2d07e4c534dce9fa0a4f86cad52eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:41:30.127769 25297 tablet_service.cc:1467] Processing CreateTablet for tablet 9bd2d07e4c534dce9fa0a4f86cad52eb (DEFAULT_TABLE table=test-table [id=d1e03f037f3e40f48e69a82557885327]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:41:30.128064 25297 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9bd2d07e4c534dce9fa0a4f86cad52eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:41:30.130340 25899 tablet_bootstrap.cc:492] T 9bd2d07e4c534dce9fa0a4f86cad52eb P 7f6131c7396a41a1855e03cd855393c3: Bootstrap starting.
I20260811 16:41:30.130769 25900 tablet_bootstrap.cc:492] T 9bd2d07e4c534dce9fa0a4f86cad52eb P db34d862996e4ed5aa731cd30e5b0550: Bootstrap starting.
I20260811 16:41:30.130980 25901 tablet_bootstrap.cc:492] T 9bd2d07e4c534dce9fa0a4f86cad52eb P edbd92fdd66b4be398f2f3ed6e80d393: Bootstrap starting.
I20260811 16:41:30.131246 25899 tablet_bootstrap.cc:654] T 9bd2d07e4c534dce9fa0a4f86cad52eb P 7f6131c7396a41a1855e03cd855393c3: Neither blocks nor log segments found. Creating new log.
I20260811 16:41:30.131409 25900 tablet_bootstrap.cc:654] T 9bd2d07e4c534dce9fa0a4f86cad52eb P db34d862996e4ed5aa731cd30e5b0550: Neither blocks nor log segments found. Creating new log.
I20260811 16:41:30.131587 25901 tablet_bootstrap.cc:654] T 9bd2d07e4c534dce9fa0a4f86cad52eb P edbd92fdd66b4be398f2f3ed6e80d393: Neither blocks nor log segments found. Creating new log.
I20260811 16:41:30.131585 25899 log.cc:824] T 9bd2d07e4c534dce9fa0a4f86cad52eb P 7f6131c7396a41a1855e03cd855393c3: Log is configured to *not* fsync() on all Append() calls
I20260811 16:41:30.131717 25900 log.cc:824] T 9bd2d07e4c534dce9fa0a4f86cad52eb P db34d862996e4ed5aa731cd30e5b0550: Log is configured to *not* fsync() on all Append() calls
I20260811 16:41:30.131892 25901 log.cc:824] T 9bd2d07e4c534dce9fa0a4f86cad52eb P edbd92fdd66b4be398f2f3ed6e80d393: Log is configured to *not* fsync() on all Append() calls
I20260811 16:41:30.132334 25899 tablet_bootstrap.cc:492] T 9bd2d07e4c534dce9fa0a4f86cad52eb P 7f6131c7396a41a1855e03cd855393c3: No bootstrap required, opened a new log
I20260811 16:41:30.132403 25899 ts_tablet_manager.cc:1397] T 9bd2d07e4c534dce9fa0a4f86cad52eb P 7f6131c7396a41a1855e03cd855393c3: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 16:41:30.132467 25900 tablet_bootstrap.cc:492] T 9bd2d07e4c534dce9fa0a4f86cad52eb P db34d862996e4ed5aa731cd30e5b0550: No bootstrap required, opened a new log
I20260811 16:41:30.132543 25900 ts_tablet_manager.cc:1397] T 9bd2d07e4c534dce9fa0a4f86cad52eb P db34d862996e4ed5aa731cd30e5b0550: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 16:41:30.132623 25901 tablet_bootstrap.cc:492] T 9bd2d07e4c534dce9fa0a4f86cad52eb P edbd92fdd66b4be398f2f3ed6e80d393: No bootstrap required, opened a new log
I20260811 16:41:30.132684 25901 ts_tablet_manager.cc:1397] T 9bd2d07e4c534dce9fa0a4f86cad52eb P edbd92fdd66b4be398f2f3ed6e80d393: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 16:41:30.134415 25899 raft_consensus.cc:348] T 9bd2d07e4c534dce9fa0a4f86cad52eb P 7f6131c7396a41a1855e03cd855393c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f6131c7396a41a1855e03cd855393c3" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39581 } } peers { permanent_uuid: "db34d862996e4ed5aa731cd30e5b0550" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 46563 } } peers { permanent_uuid: "edbd92fdd66b4be398f2f3ed6e80d393" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 39181 } }
I20260811 16:41:30.134555 25899 raft_consensus.cc:374] T 9bd2d07e4c534dce9fa0a4f86cad52eb P 7f6131c7396a41a1855e03cd855393c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:41:30.134594 25899 raft_consensus.cc:729] T 9bd2d07e4c534dce9fa0a4f86cad52eb P 7f6131c7396a41a1855e03cd855393c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f6131c7396a41a1855e03cd855393c3, State: Initialized, Role: FOLLOWER
I20260811 16:41:30.134698 25899 consensus_queue.cc:260] T 9bd2d07e4c534dce9fa0a4f86cad52eb P 7f6131c7396a41a1855e03cd855393c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f6131c7396a41a1855e03cd855393c3" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39581 } } peers { permanent_uuid: "db34d862996e4ed5aa731cd30e5b0550" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 46563 } } peers { permanent_uuid: "edbd92fdd66b4be398f2f3ed6e80d393" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 39181 } }
I20260811 16:41:30.134953 25899 ts_tablet_manager.cc:1428] T 9bd2d07e4c534dce9fa0a4f86cad52eb P 7f6131c7396a41a1855e03cd855393c3: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 16:41:30.134974 25863 heartbeater.cc:503] Master 127.24.175.254:35405 was elected leader, sending a full tablet report...
I20260811 16:41:30.135007 25900 raft_consensus.cc:348] T 9bd2d07e4c534dce9fa0a4f86cad52eb P db34d862996e4ed5aa731cd30e5b0550 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f6131c7396a41a1855e03cd855393c3" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39581 } } peers { permanent_uuid: "db34d862996e4ed5aa731cd30e5b0550" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 46563 } } peers { permanent_uuid: "edbd92fdd66b4be398f2f3ed6e80d393" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 39181 } }
I20260811 16:41:30.135176 25900 raft_consensus.cc:374] T 9bd2d07e4c534dce9fa0a4f86cad52eb P db34d862996e4ed5aa731cd30e5b0550 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:41:30.135211 25900 raft_consensus.cc:729] T 9bd2d07e4c534dce9fa0a4f86cad52eb P db34d862996e4ed5aa731cd30e5b0550 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db34d862996e4ed5aa731cd30e5b0550, State: Initialized, Role: FOLLOWER
I20260811 16:41:30.135208 25901 raft_consensus.cc:348] T 9bd2d07e4c534dce9fa0a4f86cad52eb P edbd92fdd66b4be398f2f3ed6e80d393 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f6131c7396a41a1855e03cd855393c3" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39581 } } peers { permanent_uuid: "db34d862996e4ed5aa731cd30e5b0550" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 46563 } } peers { permanent_uuid: "edbd92fdd66b4be398f2f3ed6e80d393" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 39181 } }
I20260811 16:41:30.135341 25901 raft_consensus.cc:374] T 9bd2d07e4c534dce9fa0a4f86cad52eb P edbd92fdd66b4be398f2f3ed6e80d393 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:41:30.135327 25900 consensus_queue.cc:260] T 9bd2d07e4c534dce9fa0a4f86cad52eb P db34d862996e4ed5aa731cd30e5b0550 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f6131c7396a41a1855e03cd855393c3" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39581 } } peers { permanent_uuid: "db34d862996e4ed5aa731cd30e5b0550" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 46563 } } peers { permanent_uuid: "edbd92fdd66b4be398f2f3ed6e80d393" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 39181 } }
I20260811 16:41:30.135373 25901 raft_consensus.cc:729] T 9bd2d07e4c534dce9fa0a4f86cad52eb P edbd92fdd66b4be398f2f3ed6e80d393 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edbd92fdd66b4be398f2f3ed6e80d393, State: Initialized, Role: FOLLOWER
I20260811 16:41:30.135476 25901 consensus_queue.cc:260] T 9bd2d07e4c534dce9fa0a4f86cad52eb P edbd92fdd66b4be398f2f3ed6e80d393 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f6131c7396a41a1855e03cd855393c3" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39581 } } peers { permanent_uuid: "db34d862996e4ed5aa731cd30e5b0550" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 46563 } } peers { permanent_uuid: "edbd92fdd66b4be398f2f3ed6e80d393" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 39181 } }
I20260811 16:41:30.135567 25900 ts_tablet_manager.cc:1428] T 9bd2d07e4c534dce9fa0a4f86cad52eb P db34d862996e4ed5aa731cd30e5b0550: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 16:41:30.135679 25413 heartbeater.cc:503] Master 127.24.175.254:35405 was elected leader, sending a full tablet report...
I20260811 16:41:30.135715 25901 ts_tablet_manager.cc:1428] T 9bd2d07e4c534dce9fa0a4f86cad52eb P edbd92fdd66b4be398f2f3ed6e80d393: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 16:41:30.135828 25629 heartbeater.cc:503] Master 127.24.175.254:35405 was elected leader, sending a full tablet report...
W20260811 16:41:30.216791 25630 tablet.cc:2369] T 9bd2d07e4c534dce9fa0a4f86cad52eb P edbd92fdd66b4be398f2f3ed6e80d393: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:41:30.269292 25911 raft_consensus.cc:482] T 9bd2d07e4c534dce9fa0a4f86cad52eb P edbd92fdd66b4be398f2f3ed6e80d393 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:41:30.269459 25911 raft_consensus.cc:504] T 9bd2d07e4c534dce9fa0a4f86cad52eb P edbd92fdd66b4be398f2f3ed6e80d393 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f6131c7396a41a1855e03cd855393c3" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39581 } } peers { permanent_uuid: "db34d862996e4ed5aa731cd30e5b0550" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 46563 } } peers { permanent_uuid: "edbd92fdd66b4be398f2f3ed6e80d393" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 39181 } }
I20260811 16:41:30.269826 25911 leader_election.cc:288] T 9bd2d07e4c534dce9fa0a4f86cad52eb P edbd92fdd66b4be398f2f3ed6e80d393 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f6131c7396a41a1855e03cd855393c3 (127.24.175.195:39581), db34d862996e4ed5aa731cd30e5b0550 (127.24.175.193:46563)
I20260811 16:41:30.272745 25889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:30.270136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:40193 (local address 127.24.175.195:39581)
0811 16:41:30.270204 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:30.270206 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:30.270252 (+ 46us) server_negotiation.cc:407] Connection header received
0811 16:41:30.270301 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:30.270302 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:30.270313 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:30.270371 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:41:30.270545 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:30.271023 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:30.272020 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:30.272402 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:30.272464 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:30.272474 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:30.272616 (+ 142us) server_negotiation.cc:299] Negotiation successful
0811 16:41:30.272665 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 16:41:30.272745 25631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:30.270046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.195:39581 (local address 127.24.175.194:40193)
0811 16:41:30.270105 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:30.270118 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 16:41:30.270193 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:41:30.270382 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:41:30.270383 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:41:30.270386 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:41:30.270475 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:30.270477 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:30.271103 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:30.271105 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:30.271926 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:30.271929 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:30.272482 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:30.272483 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:30.272556 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:30.272559 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:41:30.272604 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 16:41:30.272680 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260811 16:41:30.272909 25915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:30.270265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.193:46563 (local address 127.24.175.194:60831)
0811 16:41:30.270443 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:30.270451 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 16:41:30.270503 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:41:30.270671 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:41:30.270672 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:41:30.270673 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:41:30.270751 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:30.270753 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:30.271354 (+ 601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:30.271355 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:30.272110 (+ 755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:30.272112 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:30.272656 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:30.272657 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:30.272735 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:30.272737 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 16:41:30.272782 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 16:41:30.272823 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":110,"threads_started":1}
I20260811 16:41:30.272902 25897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:30.270309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:60831 (local address 127.24.175.193:46563)
0811 16:41:30.270383 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:30.270385 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:30.270509 (+ 124us) server_negotiation.cc:407] Connection header received
0811 16:41:30.270557 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:30.270558 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:30.270569 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:30.270658 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:41:30.270820 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:30.271282 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:30.272202 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:30.272563 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:30.272632 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:30.272641 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:30.272798 (+ 157us) server_negotiation.cc:299] Negotiation successful
0811 16:41:30.272840 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 16:41:30.273141 25780 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bd2d07e4c534dce9fa0a4f86cad52eb" candidate_uuid: "edbd92fdd66b4be398f2f3ed6e80d393" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f6131c7396a41a1855e03cd855393c3" is_pre_election: true
I20260811 16:41:30.273317 25780 raft_consensus.cc:2454] T 9bd2d07e4c534dce9fa0a4f86cad52eb P 7f6131c7396a41a1855e03cd855393c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edbd92fdd66b4be398f2f3ed6e80d393 in term 0.
I20260811 16:41:30.273563 25445 leader_election.cc:302] T 9bd2d07e4c534dce9fa0a4f86cad52eb P edbd92fdd66b4be398f2f3ed6e80d393 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f6131c7396a41a1855e03cd855393c3, edbd92fdd66b4be398f2f3ed6e80d393; no voters:
I20260811 16:41:30.273708 25327 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bd2d07e4c534dce9fa0a4f86cad52eb" candidate_uuid: "edbd92fdd66b4be398f2f3ed6e80d393" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db34d862996e4ed5aa731cd30e5b0550" is_pre_election: true
I20260811 16:41:30.273720 25911 raft_consensus.cc:2781] T 9bd2d07e4c534dce9fa0a4f86cad52eb P edbd92fdd66b4be398f2f3ed6e80d393 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:41:30.273795 25911 raft_consensus.cc:482] T 9bd2d07e4c534dce9fa0a4f86cad52eb P edbd92fdd66b4be398f2f3ed6e80d393 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:41:30.273811 25911 raft_consensus.cc:3037] T 9bd2d07e4c534dce9fa0a4f86cad52eb P edbd92fdd66b4be398f2f3ed6e80d393 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:41:30.273855 25327 raft_consensus.cc:2454] T 9bd2d07e4c534dce9fa0a4f86cad52eb P db34d862996e4ed5aa731cd30e5b0550 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edbd92fdd66b4be398f2f3ed6e80d393 in term 0.
I20260811 16:41:30.274659 25911 raft_consensus.cc:504] T 9bd2d07e4c534dce9fa0a4f86cad52eb P edbd92fdd66b4be398f2f3ed6e80d393 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f6131c7396a41a1855e03cd855393c3" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39581 } } peers { permanent_uuid: "db34d862996e4ed5aa731cd30e5b0550" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 46563 } } peers { permanent_uuid: "edbd92fdd66b4be398f2f3ed6e80d393" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 39181 } }
I20260811 16:41:30.274782 25911 leader_election.cc:288] T 9bd2d07e4c534dce9fa0a4f86cad52eb P edbd92fdd66b4be398f2f3ed6e80d393 [CANDIDATE]: Term 1 election: Requested vote from peers 7f6131c7396a41a1855e03cd855393c3 (127.24.175.195:39581), db34d862996e4ed5aa731cd30e5b0550 (127.24.175.193:46563)
I20260811 16:41:30.274983 25327 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bd2d07e4c534dce9fa0a4f86cad52eb" candidate_uuid: "edbd92fdd66b4be398f2f3ed6e80d393" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db34d862996e4ed5aa731cd30e5b0550"
I20260811 16:41:30.274981 25780 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bd2d07e4c534dce9fa0a4f86cad52eb" candidate_uuid: "edbd92fdd66b4be398f2f3ed6e80d393" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f6131c7396a41a1855e03cd855393c3"
I20260811 16:41:30.275068 25780 raft_consensus.cc:3037] T 9bd2d07e4c534dce9fa0a4f86cad52eb P 7f6131c7396a41a1855e03cd855393c3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:41:30.275068 25327 raft_consensus.cc:3037] T 9bd2d07e4c534dce9fa0a4f86cad52eb P db34d862996e4ed5aa731cd30e5b0550 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:41:30.275982 25327 raft_consensus.cc:2454] T 9bd2d07e4c534dce9fa0a4f86cad52eb P db34d862996e4ed5aa731cd30e5b0550 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edbd92fdd66b4be398f2f3ed6e80d393 in term 1.
I20260811 16:41:30.275982 25780 raft_consensus.cc:2454] T 9bd2d07e4c534dce9fa0a4f86cad52eb P 7f6131c7396a41a1855e03cd855393c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edbd92fdd66b4be398f2f3ed6e80d393 in term 1.
I20260811 16:41:30.276191 25445 leader_election.cc:302] T 9bd2d07e4c534dce9fa0a4f86cad52eb P edbd92fdd66b4be398f2f3ed6e80d393 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: db34d862996e4ed5aa731cd30e5b0550, edbd92fdd66b4be398f2f3ed6e80d393; no voters:
I20260811 16:41:30.276283 25911 raft_consensus.cc:2781] T 9bd2d07e4c534dce9fa0a4f86cad52eb P edbd92fdd66b4be398f2f3ed6e80d393 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:41:30.276419 25911 raft_consensus.cc:686] T 9bd2d07e4c534dce9fa0a4f86cad52eb P edbd92fdd66b4be398f2f3ed6e80d393 [term 1 LEADER]: Becoming Leader. State: Replica: edbd92fdd66b4be398f2f3ed6e80d393, State: Running, Role: LEADER
I20260811 16:41:30.276625 25911 consensus_queue.cc:237] T 9bd2d07e4c534dce9fa0a4f86cad52eb P edbd92fdd66b4be398f2f3ed6e80d393 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f6131c7396a41a1855e03cd855393c3" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39581 } } peers { permanent_uuid: "db34d862996e4ed5aa731cd30e5b0550" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 46563 } } peers { permanent_uuid: "edbd92fdd66b4be398f2f3ed6e80d393" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 39181 } }
I20260811 16:41:30.277467 25063 catalog_manager.cc:5495] T 9bd2d07e4c534dce9fa0a4f86cad52eb P edbd92fdd66b4be398f2f3ed6e80d393 reported cstate change: term changed from 0 to 1, leader changed from <none> to edbd92fdd66b4be398f2f3ed6e80d393 (127.24.175.194). New cstate: current_term: 1 leader_uuid: "edbd92fdd66b4be398f2f3ed6e80d393" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f6131c7396a41a1855e03cd855393c3" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "db34d862996e4ed5aa731cd30e5b0550" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 46563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edbd92fdd66b4be398f2f3ed6e80d393" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 39181 } health_report { overall_health: HEALTHY } } }
I20260811 16:41:30.307121 25891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:30.304668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57684 (local address 127.24.175.194:39181)
0811 16:41:30.304746 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:30.304748 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:30.304757 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:41:30.304797 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:30.304798 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:30.304819 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:30.304881 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:41:30.305033 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:30.305502 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:30.306298 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:30.306536 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:30.306594 (+ 58us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:30.306761 (+ 167us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:41:30.306858 (+ 97us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:41:30.306948 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:30.307002 (+ 54us) server_negotiation.cc:299] Negotiation successful
0811 16:41:30.307010 (+ 8us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 16:41:30.309072 25780 raft_consensus.cc:1261] T 9bd2d07e4c534dce9fa0a4f86cad52eb P 7f6131c7396a41a1855e03cd855393c3 [term 1 FOLLOWER]: Refusing update from remote peer edbd92fdd66b4be398f2f3ed6e80d393: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:41:30.309072 25327 raft_consensus.cc:1261] T 9bd2d07e4c534dce9fa0a4f86cad52eb P db34d862996e4ed5aa731cd30e5b0550 [term 1 FOLLOWER]: Refusing update from remote peer edbd92fdd66b4be398f2f3ed6e80d393: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:41:30.309464 25911 consensus_queue.cc:1035] T 9bd2d07e4c534dce9fa0a4f86cad52eb P edbd92fdd66b4be398f2f3ed6e80d393 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f6131c7396a41a1855e03cd855393c3" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 39581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:41:30.309625 25917 consensus_queue.cc:1035] T 9bd2d07e4c534dce9fa0a4f86cad52eb P edbd92fdd66b4be398f2f3ed6e80d393 [LEADER]: Connected to new peer: Peer: permanent_uuid: "db34d862996e4ed5aa731cd30e5b0550" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 46563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:41:30.312232 25926 mvcc.cc:205] Tried to move back new op lower bound from 7317366744302833664 to 7317366744173576192. Current Snapshot: MvccSnapshot[applied={T|T < 7317366744302833664}]
I20260811 16:41:30.312479 25927 mvcc.cc:205] Tried to move back new op lower bound from 7317366744302833664 to 7317366744173576192. Current Snapshot: MvccSnapshot[applied={T|T < 7317366744302833664}]
I20260811 16:41:30.313424 25928 mvcc.cc:205] Tried to move back new op lower bound from 7317366744302833664 to 7317366744173576192. Current Snapshot: MvccSnapshot[applied={T|T < 7317366744302833664 or (T in {7317366744302833664})}]
I20260811 16:41:30.314783 25064 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42294:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:41:30.314872 25064 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42294:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:41:30.315608 25064 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 52d5bf29cae34986b12025addfe3e0bf: Sending DeleteTablet for 3 replicas of tablet 9bd2d07e4c534dce9fa0a4f86cad52eb
I20260811 16:41:30.315944 25520 tablet_service.cc:1514] Processing DeleteTablet for tablet 9bd2d07e4c534dce9fa0a4f86cad52eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:41:30 UTC) from {username='slave'} at 127.0.0.1:57680
I20260811 16:41:30.315966 25739 tablet_service.cc:1514] Processing DeleteTablet for tablet 9bd2d07e4c534dce9fa0a4f86cad52eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:41:30 UTC) from {username='slave'} at 127.0.0.1:56966
I20260811 16:41:30.315975 25297 tablet_service.cc:1514] Processing DeleteTablet for tablet 9bd2d07e4c534dce9fa0a4f86cad52eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:41:30 UTC) from {username='slave'} at 127.0.0.1:56576
I20260811 16:41:30.316285 25944 tablet_replica.cc:330] T 9bd2d07e4c534dce9fa0a4f86cad52eb P edbd92fdd66b4be398f2f3ed6e80d393: stopping tablet replica
I20260811 16:41:30.316324 25941 tablet_replica.cc:330] T 9bd2d07e4c534dce9fa0a4f86cad52eb P 7f6131c7396a41a1855e03cd855393c3: stopping tablet replica
I20260811 16:41:30.316422 25941 raft_consensus.cc:2229] T 9bd2d07e4c534dce9fa0a4f86cad52eb P 7f6131c7396a41a1855e03cd855393c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:41:30.316491 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 25179
I20260811 16:41:30.316526 25941 raft_consensus.cc:2258] T 9bd2d07e4c534dce9fa0a4f86cad52eb P 7f6131c7396a41a1855e03cd855393c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:41:30.316663 25944 raft_consensus.cc:2229] T 9bd2d07e4c534dce9fa0a4f86cad52eb P edbd92fdd66b4be398f2f3ed6e80d393 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:41:30.316815 25944 raft_consensus.cc:2258] T 9bd2d07e4c534dce9fa0a4f86cad52eb P edbd92fdd66b4be398f2f3ed6e80d393 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:41:30.324846 25941 ts_tablet_manager.cc:1905] T 9bd2d07e4c534dce9fa0a4f86cad52eb P 7f6131c7396a41a1855e03cd855393c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:41:30.324846 25944 ts_tablet_manager.cc:1905] T 9bd2d07e4c534dce9fa0a4f86cad52eb P edbd92fdd66b4be398f2f3ed6e80d393: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:41:30.326654 25944 ts_tablet_manager.cc:1918] T 9bd2d07e4c534dce9fa0a4f86cad52eb P edbd92fdd66b4be398f2f3ed6e80d393: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:41:30.326676 25941 ts_tablet_manager.cc:1918] T 9bd2d07e4c534dce9fa0a4f86cad52eb P 7f6131c7396a41a1855e03cd855393c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:41:30.326753 25944 log.cc:1196] T 9bd2d07e4c534dce9fa0a4f86cad52eb P edbd92fdd66b4be398f2f3ed6e80d393: Deleting WAL directory at /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/ts-1/wal/wals/9bd2d07e4c534dce9fa0a4f86cad52eb
I20260811 16:41:30.326898 25941 log.cc:1196] T 9bd2d07e4c534dce9fa0a4f86cad52eb P 7f6131c7396a41a1855e03cd855393c3: Deleting WAL directory at /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466249441839-25279-0/minicluster-data/ts-2/wal/wals/9bd2d07e4c534dce9fa0a4f86cad52eb
I20260811 16:41:30.327008 25944 ts_tablet_manager.cc:1939] T 9bd2d07e4c534dce9fa0a4f86cad52eb P edbd92fdd66b4be398f2f3ed6e80d393: Deleting consensus metadata
I20260811 16:41:30.327260 25941 ts_tablet_manager.cc:1939] T 9bd2d07e4c534dce9fa0a4f86cad52eb P 7f6131c7396a41a1855e03cd855393c3: Deleting consensus metadata
I20260811 16:41:30.327507 25037 catalog_manager.cc:4841] TS edbd92fdd66b4be398f2f3ed6e80d393 (127.24.175.194:39181): tablet 9bd2d07e4c534dce9fa0a4f86cad52eb (table test-table [id=d1e03f037f3e40f48e69a82557885327]) successfully deleted
I20260811 16:41:30.327780 25042 catalog_manager.cc:4841] TS 7f6131c7396a41a1855e03cd855393c3 (127.24.175.195:39581): tablet 9bd2d07e4c534dce9fa0a4f86cad52eb (table test-table [id=d1e03f037f3e40f48e69a82557885327]) successfully deleted
W20260811 16:41:30.331507 25042 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.24.175.193:46563 (error 108)
I20260811 16:41:30.331771 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 25417
I20260811 16:41:30.339587 25887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:30.339384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.193:46563 (local address 127.0.0.1:56578)
0811 16:41:30.339461 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:30.339538 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.193:46563: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260811 16:41:30.339753 25042 catalog_manager.cc:4584] TS db34d862996e4ed5aa731cd30e5b0550 (127.24.175.193:46563): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9bd2d07e4c534dce9fa0a4f86cad52eb: Network error: Client connection negotiation failed: client connection to 127.24.175.193:46563: connect: Connection refused (error 111)
I20260811 16:41:30.349351 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 25632
I20260811 16:41:30.361126 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 25015
2026-08-11T16:41:30Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (831 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:41:30 dist-test-slave-zj8q krb5kdc[25951](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:41:30 dist-test-slave-zj8q krb5kdc[25951](info): set up 2 sockets
Aug 11 16:41:30 dist-test-slave-zj8q krb5kdc[25951](info): commencing operation
krb5kdc: starting...
W20260811 16:41:31.536729 25279 mini_kdc.cc:121] Time spent starting KDC: real 1.151s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Aug 11 16:41:31 dist-test-slave-zj8q krb5kdc[25951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466491, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:41:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:41:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab.
Entry for principal kudu/127.24.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab.
I20260811 16:41:31.652073 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:42177
--webserver_interface=127.24.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:36979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.175.254:42177
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:41:31.732252 25969 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:41:31.732465 25969 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:41:31.732494 25969 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:41:31.733628 25969 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:41:31.733669 25969 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:41:31.733687 25969 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:41:31.733704 25969 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:41:31.733718 25969 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:41:31.735224 25969 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:36979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.175.254:42177
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:42177
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25969
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:41:31.735494 25969 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:41:31.735739 25969 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:41:31.740577 25981 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:31.740654 25969 server_base.cc:1034] running on GCE node
W20260811 16:41:31.740615 25975 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:41:31.740577 25978 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:31.741097 25969 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:41:31.741382 25969 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:41:31.742519 25969 hybrid_clock.cc:648] HybridClock initialized: now 1786466491742504 us; error 26 us; skew 500 ppm
Aug 11 16:41:31 dist-test-slave-zj8q krb5kdc[25951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466491, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:41:31.744884 25969 init.cc:377] Logged in from keytab as kudu/127.24.175.254@KRBTEST.COM (short username kudu)
I20260811 16:41:31.745357 25969 webserver.cc:460] Webserver started at http://127.24.175.254:33299/ using document root <none> and password file <none>
I20260811 16:41:31.745568 25969 fs_manager.cc:359] Metadata directory not provided
I20260811 16:41:31.745625 25969 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:41:31.745752 25969 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:41:31.746833 25969 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/master-0/data/instance:
uuid: "ce01558f0664497ba9e0b7ca02f70cb3"
format_stamp: "Formatted at 2026-08-11 16:41:31 on dist-test-slave-zj8q"
server_key: "8a949aa5ba8bfc2f96317ed2cffc13da"
server_key_iv: "31bcfe050e908dd6dc14f9c0def99e5f"
server_key_version: "encryptionkey@0"
I20260811 16:41:31.747166 25969 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/master-0/wal/instance:
uuid: "ce01558f0664497ba9e0b7ca02f70cb3"
format_stamp: "Formatted at 2026-08-11 16:41:31 on dist-test-slave-zj8q"
server_key: "8a949aa5ba8bfc2f96317ed2cffc13da"
server_key_iv: "31bcfe050e908dd6dc14f9c0def99e5f"
server_key_version: "encryptionkey@0"
I20260811 16:41:31.748363 25969 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:41:31.749019 25996 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:31.749169 25969 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:41:31.749254 25969 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/master-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/master-0/wal
uuid: "ce01558f0664497ba9e0b7ca02f70cb3"
format_stamp: "Formatted at 2026-08-11 16:41:31 on dist-test-slave-zj8q"
server_key: "8a949aa5ba8bfc2f96317ed2cffc13da"
server_key_iv: "31bcfe050e908dd6dc14f9c0def99e5f"
server_key_version: "encryptionkey@0"
I20260811 16:41:31.749320 25969 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:41:31.771027 25969 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:41:31.773126 25969 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:41:31.773263 25969 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:41:31.777192 25969 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.254:42177
I20260811 16:41:31.777230 26109 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.254:42177 every 8 connection(s)
I20260811 16:41:31.777547 25969 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
I20260811 16:41:31.778432 26110 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:41:31.780706 26110 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce01558f0664497ba9e0b7ca02f70cb3: Bootstrap starting.
I20260811 16:41:31.781273 26110 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ce01558f0664497ba9e0b7ca02f70cb3: Neither blocks nor log segments found. Creating new log.
I20260811 16:41:31.781570 26110 log.cc:824] T 00000000000000000000000000000000 P ce01558f0664497ba9e0b7ca02f70cb3: Log is configured to *not* fsync() on all Append() calls
I20260811 16:41:31.782233 26110 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce01558f0664497ba9e0b7ca02f70cb3: No bootstrap required, opened a new log
I20260811 16:41:31.783775 26110 raft_consensus.cc:348] T 00000000000000000000000000000000 P ce01558f0664497ba9e0b7ca02f70cb3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce01558f0664497ba9e0b7ca02f70cb3" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 42177 } }
I20260811 16:41:31.783916 26110 raft_consensus.cc:374] T 00000000000000000000000000000000 P ce01558f0664497ba9e0b7ca02f70cb3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:41:31.783937 26110 raft_consensus.cc:729] T 00000000000000000000000000000000 P ce01558f0664497ba9e0b7ca02f70cb3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce01558f0664497ba9e0b7ca02f70cb3, State: Initialized, Role: FOLLOWER
I20260811 16:41:31.784053 26110 consensus_queue.cc:260] T 00000000000000000000000000000000 P ce01558f0664497ba9e0b7ca02f70cb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce01558f0664497ba9e0b7ca02f70cb3" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 42177 } }
I20260811 16:41:31.784125 26110 raft_consensus.cc:388] T 00000000000000000000000000000000 P ce01558f0664497ba9e0b7ca02f70cb3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:41:31.784147 26110 raft_consensus.cc:482] T 00000000000000000000000000000000 P ce01558f0664497ba9e0b7ca02f70cb3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:41:31.784191 26110 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ce01558f0664497ba9e0b7ca02f70cb3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:41:31.784701 26110 raft_consensus.cc:504] T 00000000000000000000000000000000 P ce01558f0664497ba9e0b7ca02f70cb3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce01558f0664497ba9e0b7ca02f70cb3" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 42177 } }
I20260811 16:41:31.784796 26110 leader_election.cc:302] T 00000000000000000000000000000000 P ce01558f0664497ba9e0b7ca02f70cb3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ce01558f0664497ba9e0b7ca02f70cb3; no voters:
I20260811 16:41:31.784951 26110 leader_election.cc:288] T 00000000000000000000000000000000 P ce01558f0664497ba9e0b7ca02f70cb3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:41:31.785013 26114 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ce01558f0664497ba9e0b7ca02f70cb3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:41:31.785173 26114 raft_consensus.cc:686] T 00000000000000000000000000000000 P ce01558f0664497ba9e0b7ca02f70cb3 [term 1 LEADER]: Becoming Leader. State: Replica: ce01558f0664497ba9e0b7ca02f70cb3, State: Running, Role: LEADER
I20260811 16:41:31.785200 26110 sys_catalog.cc:564] T 00000000000000000000000000000000 P ce01558f0664497ba9e0b7ca02f70cb3 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:41:31.785276 26114 consensus_queue.cc:237] T 00000000000000000000000000000000 P ce01558f0664497ba9e0b7ca02f70cb3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce01558f0664497ba9e0b7ca02f70cb3" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 42177 } }
I20260811 16:41:31.785817 26115 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce01558f0664497ba9e0b7ca02f70cb3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ce01558f0664497ba9e0b7ca02f70cb3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce01558f0664497ba9e0b7ca02f70cb3" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 42177 } } }
I20260811 16:41:31.785913 26115 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce01558f0664497ba9e0b7ca02f70cb3 [sys.catalog]: This master's current role is: LEADER
I20260811 16:41:31.786077 26119 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce01558f0664497ba9e0b7ca02f70cb3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ce01558f0664497ba9e0b7ca02f70cb3. Latest consensus state: current_term: 1 leader_uuid: "ce01558f0664497ba9e0b7ca02f70cb3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce01558f0664497ba9e0b7ca02f70cb3" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 42177 } } }
I20260811 16:41:31.786142 26119 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce01558f0664497ba9e0b7ca02f70cb3 [sys.catalog]: This master's current role is: LEADER
I20260811 16:41:31.786306 26127 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:41:31.786449 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 25969
I20260811 16:41:31.786568 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/master-0/wal/instance
I20260811 16:41:31.786798 25279 external_mini_cluster.cc:1428] Setting key a0beb08f90a1d605bc1b54f8e5d639f0
I20260811 16:41:31.786829 26127 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:41:31.789129 26127 catalog_manager.cc:1347] Generated new cluster ID: 0dd35c7927df43da809aef492a3f8958
I20260811 16:41:31.789183 26127 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 16:41:31 dist-test-slave-zj8q krb5kdc[25951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466491, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:41:31.796614 26141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:31.787493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43204 (local address 127.24.175.254:42177)
0811 16:41:31.787677 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:31.787687 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:31.787720 (+ 33us) server_negotiation.cc:407] Connection header received
0811 16:41:31.787832 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:31.787837 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:31.787890 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:31.788042 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:41:31.788799 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:31.789968 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:31.790919 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:31.791369 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:31.791460 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:31.793591 (+ 2131us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:41:31.793595 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:41:31.793596 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:41:31.793607 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:41:31.795156 (+ 1549us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:41:31.795470 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:41:31.795473 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:41:31.795473 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:41:31.795582 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:41:31.795756 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:41:31.795757 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:41:31.795757 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:41:31.796011 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:41:31.796179 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:31.796254 (+ 75us) server_negotiation.cc:299] Negotiation successful
0811 16:41:31.796395 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":80,"threads_started":1}
I20260811 16:41:31.800580 26127 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:41:31.801100 26127 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:41:31.807004 26127 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ce01558f0664497ba9e0b7ca02f70cb3: Generated new TSK 0
I20260811 16:41:31.807168 26127 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.175.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab.
Entry for principal kudu/127.24.175.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab.
I20260811 16:41:31.843132 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.193:0
--local_ip_for_outbound_sockets=127.24.175.193
--webserver_interface=127.24.175.193
--webserver_port=0
--tserver_master_addrs=127.24.175.254:42177
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab
--principal=kudu/127.24.175.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:36979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:41:31.951263 26145 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:41:31.951452 26145 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:41:31.951472 26145 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:41:31.952646 26145 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:41:31.952690 26145 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:41:31.952718 26145 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.193
I20260811 16:41:31.954226 26145 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:36979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.193.keytab
--principal=kudu/127.24.175.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.175.193
--webserver_port=0
--tserver_master_addrs=127.24.175.254:42177
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26145
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.193
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:41:31.954452 26145 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:41:31.954664 26145 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:41:31.959645 26161 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:41:31.959671 26153 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:41:31.959695 26152 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:31.959721 26145 server_base.cc:1034] running on GCE node
I20260811 16:41:31.959990 26145 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:41:31.960211 26145 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:41:31.961376 26145 hybrid_clock.cc:648] HybridClock initialized: now 1786466491961357 us; error 32 us; skew 500 ppm
Aug 11 16:41:31 dist-test-slave-zj8q krb5kdc[25951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466491, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:41:31.963893 26145 init.cc:377] Logged in from keytab as kudu/127.24.175.193@KRBTEST.COM (short username kudu)
I20260811 16:41:31.964289 26145 webserver.cc:460] Webserver started at http://127.24.175.193:41399/ using document root <none> and password file <none>
I20260811 16:41:31.964481 26145 fs_manager.cc:359] Metadata directory not provided
I20260811 16:41:31.964519 26145 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:41:31.964614 26145 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:41:31.965581 26145 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/ts-0/data/instance:
uuid: "4a513aad7c74472ba318747fc285e200"
format_stamp: "Formatted at 2026-08-11 16:41:31 on dist-test-slave-zj8q"
server_key: "37acb044f71fdd9d766f5542f12bff21"
server_key_iv: "4bd14d86da92d93f3e1c5fa4e654fae5"
server_key_version: "encryptionkey@0"
I20260811 16:41:31.965874 26145 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/ts-0/wal/instance:
uuid: "4a513aad7c74472ba318747fc285e200"
format_stamp: "Formatted at 2026-08-11 16:41:31 on dist-test-slave-zj8q"
server_key: "37acb044f71fdd9d766f5542f12bff21"
server_key_iv: "4bd14d86da92d93f3e1c5fa4e654fae5"
server_key_version: "encryptionkey@0"
I20260811 16:41:31.967092 26145 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 16:41:31.967732 26171 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:31.967892 26145 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 16:41:31.967971 26145 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/ts-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/ts-0/wal
uuid: "4a513aad7c74472ba318747fc285e200"
format_stamp: "Formatted at 2026-08-11 16:41:31 on dist-test-slave-zj8q"
server_key: "37acb044f71fdd9d766f5542f12bff21"
server_key_iv: "4bd14d86da92d93f3e1c5fa4e654fae5"
server_key_version: "encryptionkey@0"
I20260811 16:41:31.968024 26145 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:41:31.990272 26145 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:41:31.992007 26145 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:41:31.992133 26145 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:41:31.992316 26145 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:41:31.992566 26145 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:41:31.992596 26145 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:31.992619 26145 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:41:31.992630 26145 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:31.997970 26145 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.193:42797
I20260811 16:41:31.998086 26365 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.193:42797 every 8 connection(s)
I20260811 16:41:31.998364 26145 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
I20260811 16:41:31.999104 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 26145
I20260811 16:41:31.999209 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/ts-0/wal/instance
I20260811 16:41:31.999408 25279 external_mini_cluster.cc:1428] Setting key 1d869a6edd35f7b75c457f68db01d50b
Aug 11 16:41:32 dist-test-slave-zj8q krb5kdc[25951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466491, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.193@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:41:32.008183 26141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:31.999021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:45975 (local address 127.24.175.254:42177)
0811 16:41:31.999087 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:31.999089 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:31.999724 (+ 635us) server_negotiation.cc:407] Connection header received
0811 16:41:32.000204 (+ 480us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:32.000205 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:32.000222 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:32.000271 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:41:32.001168 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:32.001794 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:32.002831 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:32.003124 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:32.003194 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:32.005391 (+ 2197us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:41:32.005393 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:41:32.005393 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:41:32.005402 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:41:32.006907 (+ 1505us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:41:32.007276 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:41:32.007277 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:41:32.007278 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:41:32.007337 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:41:32.007544 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:41:32.007544 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:41:32.007545 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:41:32.007684 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:41:32.007751 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:32.007983 (+ 232us) server_negotiation.cc:299] Negotiation successful
0811 16:41:32.008078 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 16:41:32.008227 26374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:31.998974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:42177 (local address 127.24.175.193:45975)
0811 16:41:31.999599 (+ 625us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:31.999643 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 16:41:32.000113 (+ 470us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:41:32.000340 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:41:32.000344 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:41:32.000889 (+ 545us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:41:32.001073 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:32.001078 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:32.001886 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:32.001887 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:32.002747 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:32.002750 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:32.003198 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:32.003199 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:32.003295 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:32.003738 (+ 443us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:41:32.003746 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:41:32.005298 (+ 1552us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:41:32.006983 (+ 1685us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:41:32.006989 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:41:32.006991 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:41:32.007208 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:41:32.007399 (+ 191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:41:32.007399 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:41:32.007399 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:41:32.007491 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:41:32.007747 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:41:32.007750 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:41:32.007863 (+ 113us) client_negotiation.cc:769] Sending connection context
0811 16:41:32.007936 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 16:41:32.008052 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":586,"thread_start_us":82,"threads_started":1}
WARNING: no policy specified for kudu/127.24.175.194@KRBTEST.COM; defaulting to no policy
I20260811 16:41:32.008745 26367 heartbeater.cc:347] Connected to a master server at 127.24.175.254:42177
I20260811 16:41:32.008833 26367 heartbeater.cc:464] Registering TS with master...
I20260811 16:41:32.008977 26367 heartbeater.cc:511] Master 127.24.175.254:42177 requested a full tablet report, sending...
I20260811 16:41:32.009434 26031 ts_manager.cc:194] Registered new tserver with Master: 4a513aad7c74472ba318747fc285e200 (127.24.175.193:42797)
I20260811 16:41:32.010041 26031 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.175.193@KRBTEST.COM'} at 127.24.175.193:45975
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab.
Entry for principal kudu/127.24.175.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab.
I20260811 16:41:32.028385 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.194:0
--local_ip_for_outbound_sockets=127.24.175.194
--webserver_interface=127.24.175.194
--webserver_port=0
--tserver_master_addrs=127.24.175.254:42177
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab
--principal=kudu/127.24.175.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:36979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:41:32.109881 26381 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:41:32.110085 26381 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:41:32.110116 26381 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:41:32.111310 26381 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:41:32.111356 26381 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:41:32.111392 26381 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.194
I20260811 16:41:32.112843 26381 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:36979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.194.keytab
--principal=kudu/127.24.175.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.175.194
--webserver_port=0
--tserver_master_addrs=127.24.175.254:42177
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26381
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.194
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:41:32.113073 26381 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:41:32.113296 26381 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:41:32.118196 26401 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:32.118335 26381 server_base.cc:1034] running on GCE node
W20260811 16:41:32.118256 26395 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:41:32.118196 26396 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:32.118598 26381 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:41:32.118831 26381 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:41:32.120002 26381 hybrid_clock.cc:648] HybridClock initialized: now 1786466492119983 us; error 32 us; skew 500 ppm
Aug 11 16:41:32 dist-test-slave-zj8q krb5kdc[25951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466492, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:41:32.122500 26381 init.cc:377] Logged in from keytab as kudu/127.24.175.194@KRBTEST.COM (short username kudu)
I20260811 16:41:32.122910 26381 webserver.cc:460] Webserver started at http://127.24.175.194:36333/ using document root <none> and password file <none>
I20260811 16:41:32.123113 26381 fs_manager.cc:359] Metadata directory not provided
I20260811 16:41:32.123162 26381 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:41:32.123284 26381 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:41:32.124341 26381 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/ts-1/data/instance:
uuid: "a9fb512677b24324bded88ec60edc421"
format_stamp: "Formatted at 2026-08-11 16:41:32 on dist-test-slave-zj8q"
server_key: "d44c8d2a6aa7fb4a8a2d30824a9ee7b0"
server_key_iv: "d05cc1f83bca19a8e30adab6bea9d154"
server_key_version: "encryptionkey@0"
I20260811 16:41:32.124671 26381 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/ts-1/wal/instance:
uuid: "a9fb512677b24324bded88ec60edc421"
format_stamp: "Formatted at 2026-08-11 16:41:32 on dist-test-slave-zj8q"
server_key: "d44c8d2a6aa7fb4a8a2d30824a9ee7b0"
server_key_iv: "d05cc1f83bca19a8e30adab6bea9d154"
server_key_version: "encryptionkey@0"
I20260811 16:41:32.125934 26381 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 16:41:32.126700 26412 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:32.126843 26381 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:32.126931 26381 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/ts-1/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/ts-1/wal
uuid: "a9fb512677b24324bded88ec60edc421"
format_stamp: "Formatted at 2026-08-11 16:41:32 on dist-test-slave-zj8q"
server_key: "d44c8d2a6aa7fb4a8a2d30824a9ee7b0"
server_key_iv: "d05cc1f83bca19a8e30adab6bea9d154"
server_key_version: "encryptionkey@0"
I20260811 16:41:32.126996 26381 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:41:32.140291 26381 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:41:32.142096 26381 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:41:32.142247 26381 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:41:32.142467 26381 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:41:32.142751 26381 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:41:32.142786 26381 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:32.142814 26381 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:41:32.142838 26381 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:32.148474 26381 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.194:39297
I20260811 16:41:32.148533 26637 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.194:39297 every 8 connection(s)
I20260811 16:41:32.148813 26381 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
I20260811 16:41:32.155799 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 26381
I20260811 16:41:32.155920 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/ts-1/wal/instance
I20260811 16:41:32.156124 25279 external_mini_cluster.cc:1428] Setting key fe66a700408dd160a0071aa860b4cd9a
Aug 11 16:41:32 dist-test-slave-zj8q krb5kdc[25951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466492, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.194@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:41:32.164124 26141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:32.149576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:49047 (local address 127.24.175.254:42177)
0811 16:41:32.149645 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:32.149647 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:32.149834 (+ 187us) server_negotiation.cc:407] Connection header received
0811 16:41:32.150391 (+ 557us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:32.150393 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:32.150405 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:32.150464 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:41:32.156366 (+ 5902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:32.156990 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:32.158403 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:32.158680 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:32.158754 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:32.161300 (+ 2546us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:41:32.161302 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:41:32.161302 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:41:32.161310 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:41:32.162718 (+ 1408us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:41:32.163207 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:41:32.163208 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:41:32.163208 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:41:32.163262 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:41:32.163528 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:41:32.163529 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:41:32.163529 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:41:32.163625 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:41:32.163676 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:32.163991 (+ 315us) server_negotiation.cc:299] Negotiation successful
0811 16:41:32.164059 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 16:41:32.164378 26642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:32.149529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:42177 (local address 127.24.175.194:49047)
0811 16:41:32.149720 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:32.149756 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 16:41:32.150295 (+ 539us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:41:32.150541 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:41:32.150545 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:41:32.155905 (+ 5360us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:41:32.156220 (+ 315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:32.156228 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:32.157099 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:32.157100 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:32.158320 (+ 1220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:32.158323 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:32.158771 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:32.158772 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:32.158919 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:32.159425 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:41:32.159435 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:41:32.161185 (+ 1750us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:41:32.162806 (+ 1621us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:41:32.162814 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:41:32.162817 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:41:32.163122 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:41:32.163328 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:41:32.163329 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:41:32.163329 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:41:32.163468 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:41:32.163678 (+ 210us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:41:32.163683 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:41:32.163865 (+ 182us) client_negotiation.cc:769] Sending connection context
0811 16:41:32.163970 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 16:41:32.164148 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":101,"threads_started":1}
I20260811 16:41:32.164873 26638 heartbeater.cc:347] Connected to a master server at 127.24.175.254:42177
I20260811 16:41:32.164960 26638 heartbeater.cc:464] Registering TS with master...
I20260811 16:41:32.165131 26638 heartbeater.cc:511] Master 127.24.175.254:42177 requested a full tablet report, sending...
I20260811 16:41:32.165549 26031 ts_manager.cc:194] Registered new tserver with Master: a9fb512677b24324bded88ec60edc421 (127.24.175.194:39297)
I20260811 16:41:32.165915 26031 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.175.194@KRBTEST.COM'} at 127.24.175.194:49047
WARNING: no policy specified for kudu/127.24.175.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab.
Entry for principal kudu/127.24.175.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab.
I20260811 16:41:32.183229 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.195:0
--local_ip_for_outbound_sockets=127.24.175.195
--webserver_interface=127.24.175.195
--webserver_port=0
--tserver_master_addrs=127.24.175.254:42177
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab
--principal=kudu/127.24.175.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:36979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:41:32.264461 26645 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:41:32.264652 26645 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:41:32.264683 26645 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:41:32.265815 26645 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:41:32.265854 26645 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:41:32.265888 26645 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.195
I20260811 16:41:32.267355 26645 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:36979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.195.keytab
--principal=kudu/127.24.175.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.175.195
--webserver_port=0
--tserver_master_addrs=127.24.175.254:42177
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26645
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.195
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:41:32.267587 26645 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:41:32.267805 26645 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:41:32.272683 26652 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:41:32.272718 26651 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:41:32.272858 26657 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:32.272862 26645 server_base.cc:1034] running on GCE node
I20260811 16:41:32.273149 26645 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:41:32.273347 26645 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:41:32.274477 26645 hybrid_clock.cc:648] HybridClock initialized: now 1786466492274462 us; error 29 us; skew 500 ppm
Aug 11 16:41:32 dist-test-slave-zj8q krb5kdc[25951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466492, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:41:32.276801 26645 init.cc:377] Logged in from keytab as kudu/127.24.175.195@KRBTEST.COM (short username kudu)
I20260811 16:41:32.277197 26645 webserver.cc:460] Webserver started at http://127.24.175.195:39667/ using document root <none> and password file <none>
I20260811 16:41:32.277417 26645 fs_manager.cc:359] Metadata directory not provided
I20260811 16:41:32.277467 26645 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:41:32.277591 26645 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:41:32.278661 26645 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/ts-2/data/instance:
uuid: "004c2a6403584c6b8e93f342f0b555ef"
format_stamp: "Formatted at 2026-08-11 16:41:32 on dist-test-slave-zj8q"
server_key: "319c77ddef09cefc63b4a64b36e087b7"
server_key_iv: "7fb338738345e2a882de36701a7200fc"
server_key_version: "encryptionkey@0"
I20260811 16:41:32.278995 26645 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/ts-2/wal/instance:
uuid: "004c2a6403584c6b8e93f342f0b555ef"
format_stamp: "Formatted at 2026-08-11 16:41:32 on dist-test-slave-zj8q"
server_key: "319c77ddef09cefc63b4a64b36e087b7"
server_key_iv: "7fb338738345e2a882de36701a7200fc"
server_key_version: "encryptionkey@0"
I20260811 16:41:32.280220 26645 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:41:32.280862 26670 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:32.281015 26645 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:41:32.281103 26645 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/ts-2/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/ts-2/wal
uuid: "004c2a6403584c6b8e93f342f0b555ef"
format_stamp: "Formatted at 2026-08-11 16:41:32 on dist-test-slave-zj8q"
server_key: "319c77ddef09cefc63b4a64b36e087b7"
server_key_iv: "7fb338738345e2a882de36701a7200fc"
server_key_version: "encryptionkey@0"
I20260811 16:41:32.281160 26645 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:41:32.302672 26645 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:41:32.304631 26645 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:41:32.304787 26645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:41:32.305022 26645 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:41:32.305346 26645 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:41:32.305382 26645 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:32.305413 26645 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:41:32.305430 26645 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:32.311409 26645 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.195:36397
I20260811 16:41:32.311465 26868 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.195:36397 every 8 connection(s)
I20260811 16:41:32.311796 26645 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
Aug 11 16:41:32 dist-test-slave-zj8q krb5kdc[25951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466492, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.195@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:41:32.318378 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 26645
I20260811 16:41:32.318449 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/ts-2/wal/instance
I20260811 16:41:32.318621 25279 external_mini_cluster.cc:1428] Setting key 1bb65df7c523e4d6499e8c611ccaad9d
I20260811 16:41:32.320701 26141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:32.312543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.195:46491 (local address 127.24.175.254:42177)
0811 16:41:32.312593 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:32.312595 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:32.312794 (+ 199us) server_negotiation.cc:407] Connection header received
0811 16:41:32.313330 (+ 536us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:32.313331 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:32.313342 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:32.313400 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:41:32.314378 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:32.314896 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:32.315861 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:32.316035 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:32.316079 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:32.318142 (+ 2063us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:41:32.318143 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:41:32.318144 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:41:32.318168 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:41:32.319648 (+ 1480us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:41:32.320014 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:41:32.320015 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:41:32.320015 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:41:32.320067 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:41:32.320229 (+ 162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:41:32.320230 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:41:32.320230 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:41:32.320328 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:41:32.320372 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:32.320576 (+ 204us) server_negotiation.cc:299] Negotiation successful
0811 16:41:32.320636 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 16:41:32.320874 26873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:32.312513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:42177 (local address 127.24.175.195:46491)
0811 16:41:32.312674 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:32.312717 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 16:41:32.313247 (+ 530us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:41:32.313466 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:41:32.313470 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:41:32.314041 (+ 571us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:41:32.314305 (+ 264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:32.314311 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:32.314968 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:32.314969 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:32.315801 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:32.315803 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:32.316089 (+ 286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:32.316089 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:32.316207 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:32.316745 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:41:32.316754 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:41:32.318065 (+ 1311us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:41:32.319724 (+ 1659us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:41:32.319730 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:41:32.319732 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:41:32.319954 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:41:32.320102 (+ 148us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:41:32.320102 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:41:32.320103 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:41:32.320188 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:41:32.320363 (+ 175us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:41:32.320367 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:41:32.320480 (+ 113us) client_negotiation.cc:769] Sending connection context
0811 16:41:32.320556 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 16:41:32.320679 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":73,"threads_started":1}
I20260811 16:41:32.321308 26870 heartbeater.cc:347] Connected to a master server at 127.24.175.254:42177
I20260811 16:41:32.321404 26870 heartbeater.cc:464] Registering TS with master...
I20260811 16:41:32.321580 26870 heartbeater.cc:511] Master 127.24.175.254:42177 requested a full tablet report, sending...
I20260811 16:41:32.321946 26031 ts_manager.cc:194] Registered new tserver with Master: 004c2a6403584c6b8e93f342f0b555ef (127.24.175.195:36397)
I20260811 16:41:32.322351 26031 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.175.195@KRBTEST.COM'} at 127.24.175.195:46491
I20260811 16:41:32.330360 25279 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 16:41:32.337010 26141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:32.331695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43210 (local address 127.24.175.254:42177)
0811 16:41:32.331763 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:32.331766 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:32.331840 (+ 74us) server_negotiation.cc:407] Connection header received
0811 16:41:32.331894 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:32.331894 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:32.331904 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:32.331945 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:41:32.332464 (+ 519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:32.332958 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:32.333640 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:32.333834 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:32.333882 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:32.334980 (+ 1098us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:41:32.334981 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:41:32.334981 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:41:32.334988 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:41:32.336101 (+ 1113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:41:32.336399 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:41:32.336400 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:41:32.336400 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:41:32.336451 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:41:32.336580 (+ 129us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:41:32.336581 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:41:32.336581 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:41:32.336717 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:41:32.336791 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:32.336867 (+ 76us) server_negotiation.cc:299] Negotiation successful
0811 16:41:32.336932 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 16:41:32.338671 26031 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43210:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:41:32.340283 26031 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:41:32.346944 26885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:32.342594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.195:36397 (local address 127.0.0.1:45364)
0811 16:41:32.342903 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:32.342940 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 16:41:32.343020 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:41:32.343556 (+ 536us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:41:32.343557 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:41:32.343560 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:41:32.343624 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:32.343626 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:32.344503 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:32.344504 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:32.345775 (+ 1271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:32.345778 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:32.346603 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:32.346604 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:32.346717 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:32.346730 (+ 13us) client_negotiation.cc:769] Sending connection context
0811 16:41:32.346794 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 16:41:32.346852 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"mutex_wait_us":28,"thread_start_us":68,"threads_started":1}
I20260811 16:41:32.347056 26889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:32.342756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38020 (local address 127.24.175.194:39297)
0811 16:41:32.342965 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:32.342970 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:32.343080 (+ 110us) server_negotiation.cc:407] Connection header received
0811 16:41:32.343193 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:32.343197 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:32.343214 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:32.343295 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:41:32.343534 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:32.344683 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:32.345944 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:32.346705 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:32.346775 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:32.346834 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:32.346924 (+ 90us) server_negotiation.cc:299] Negotiation successful
0811 16:41:32.346964 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":177,"thread_start_us":88,"threads_started":1}
I20260811 16:41:32.347262 26886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:32.342706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45364 (local address 127.24.175.195:36397)
0811 16:41:32.342879 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:32.342885 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:32.343261 (+ 376us) server_negotiation.cc:407] Connection header received
0811 16:41:32.343310 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:32.343313 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:32.343399 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:32.343466 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:41:32.343710 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:32.344413 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:32.345871 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:32.346525 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:32.346596 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:32.346658 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:32.347138 (+ 480us) server_negotiation.cc:299] Negotiation successful
0811 16:41:32.347183 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":91,"threads_started":1}
I20260811 16:41:32.347462 26883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:32.342627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.194:39297 (local address 127.0.0.1:38020)
0811 16:41:32.343015 (+ 388us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:32.343025 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:41:32.343103 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:41:32.343370 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:41:32.343373 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:41:32.343375 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:41:32.343450 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:32.343453 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:32.344797 (+ 1344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:32.344798 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:32.345875 (+ 1077us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:32.345877 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:32.346796 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:32.346797 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:32.346853 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:32.346857 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:41:32.346907 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 16:41:32.346941 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":374,"thread_start_us":95,"threads_started":1}
I20260811 16:41:32.348129 26891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:32.342828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.193:42797 (local address 127.0.0.1:36824)
0811 16:41:32.343034 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:32.343043 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:41:32.343085 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:41:32.343499 (+ 414us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:41:32.343500 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:41:32.343502 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:41:32.343541 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:32.343542 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:32.345951 (+ 2409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:32.345952 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:32.347038 (+ 1086us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:32.347042 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:32.347897 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:32.347898 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:32.347960 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:32.347965 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 16:41:32.348013 (+ 48us) client_negotiation.cc:240] Negotiation successful
0811 16:41:32.348061 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":62,"threads_started":1}
I20260811 16:41:32.348011 26751 tablet_service.cc:1467] Processing CreateTablet for tablet f67711bc9fb645f6aa470ed8c367181d (DEFAULT_TABLE table=test-table [id=9737c96b200f4ec88826acfde1b57275]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:41:32.348150 26892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:32.343082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36824 (local address 127.24.175.193:42797)
0811 16:41:32.343266 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:32.343271 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:32.343280 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:41:32.343322 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:32.343325 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:32.343341 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:32.343416 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:41:32.343615 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:32.344696 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:32.347146 (+ 2450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:32.347823 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:32.347889 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:32.347940 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:32.348027 (+ 87us) server_negotiation.cc:299] Negotiation successful
0811 16:41:32.348068 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":101,"threads_started":1}
I20260811 16:41:32.348155 26520 tablet_service.cc:1467] Processing CreateTablet for tablet f67711bc9fb645f6aa470ed8c367181d (DEFAULT_TABLE table=test-table [id=9737c96b200f4ec88826acfde1b57275]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:41:32.348412 26751 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f67711bc9fb645f6aa470ed8c367181d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:41:32.348428 26520 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f67711bc9fb645f6aa470ed8c367181d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:41:32.348701 26248 tablet_service.cc:1467] Processing CreateTablet for tablet f67711bc9fb645f6aa470ed8c367181d (DEFAULT_TABLE table=test-table [id=9737c96b200f4ec88826acfde1b57275]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:41:32.348956 26248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f67711bc9fb645f6aa470ed8c367181d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:41:32.351585 26893 tablet_bootstrap.cc:492] T f67711bc9fb645f6aa470ed8c367181d P 4a513aad7c74472ba318747fc285e200: Bootstrap starting.
I20260811 16:41:32.352279 26893 tablet_bootstrap.cc:654] T f67711bc9fb645f6aa470ed8c367181d P 4a513aad7c74472ba318747fc285e200: Neither blocks nor log segments found. Creating new log.
I20260811 16:41:32.352799 26893 log.cc:824] T f67711bc9fb645f6aa470ed8c367181d P 4a513aad7c74472ba318747fc285e200: Log is configured to *not* fsync() on all Append() calls
I20260811 16:41:32.353127 26895 tablet_bootstrap.cc:492] T f67711bc9fb645f6aa470ed8c367181d P 004c2a6403584c6b8e93f342f0b555ef: Bootstrap starting.
I20260811 16:41:32.353469 26893 tablet_bootstrap.cc:492] T f67711bc9fb645f6aa470ed8c367181d P 4a513aad7c74472ba318747fc285e200: No bootstrap required, opened a new log
I20260811 16:41:32.353528 26893 ts_tablet_manager.cc:1397] T f67711bc9fb645f6aa470ed8c367181d P 4a513aad7c74472ba318747fc285e200: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 16:41:32.353695 26895 tablet_bootstrap.cc:654] T f67711bc9fb645f6aa470ed8c367181d P 004c2a6403584c6b8e93f342f0b555ef: Neither blocks nor log segments found. Creating new log.
I20260811 16:41:32.354131 26895 log.cc:824] T f67711bc9fb645f6aa470ed8c367181d P 004c2a6403584c6b8e93f342f0b555ef: Log is configured to *not* fsync() on all Append() calls
I20260811 16:41:32.354322 26901 tablet_bootstrap.cc:492] T f67711bc9fb645f6aa470ed8c367181d P a9fb512677b24324bded88ec60edc421: Bootstrap starting.
I20260811 16:41:32.354851 26895 tablet_bootstrap.cc:492] T f67711bc9fb645f6aa470ed8c367181d P 004c2a6403584c6b8e93f342f0b555ef: No bootstrap required, opened a new log
I20260811 16:41:32.354919 26895 ts_tablet_manager.cc:1397] T f67711bc9fb645f6aa470ed8c367181d P 004c2a6403584c6b8e93f342f0b555ef: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 16:41:32.354951 26901 tablet_bootstrap.cc:654] T f67711bc9fb645f6aa470ed8c367181d P a9fb512677b24324bded88ec60edc421: Neither blocks nor log segments found. Creating new log.
I20260811 16:41:32.355507 26901 log.cc:824] T f67711bc9fb645f6aa470ed8c367181d P a9fb512677b24324bded88ec60edc421: Log is configured to *not* fsync() on all Append() calls
I20260811 16:41:32.355391 26893 raft_consensus.cc:348] T f67711bc9fb645f6aa470ed8c367181d P 4a513aad7c74472ba318747fc285e200 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004c2a6403584c6b8e93f342f0b555ef" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 36397 } } peers { permanent_uuid: "4a513aad7c74472ba318747fc285e200" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 42797 } } peers { permanent_uuid: "a9fb512677b24324bded88ec60edc421" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 39297 } }
I20260811 16:41:32.355572 26893 raft_consensus.cc:374] T f67711bc9fb645f6aa470ed8c367181d P 4a513aad7c74472ba318747fc285e200 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:41:32.355607 26893 raft_consensus.cc:729] T f67711bc9fb645f6aa470ed8c367181d P 4a513aad7c74472ba318747fc285e200 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a513aad7c74472ba318747fc285e200, State: Initialized, Role: FOLLOWER
I20260811 16:41:32.355744 26893 consensus_queue.cc:260] T f67711bc9fb645f6aa470ed8c367181d P 4a513aad7c74472ba318747fc285e200 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004c2a6403584c6b8e93f342f0b555ef" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 36397 } } peers { permanent_uuid: "4a513aad7c74472ba318747fc285e200" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 42797 } } peers { permanent_uuid: "a9fb512677b24324bded88ec60edc421" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 39297 } }
I20260811 16:41:32.356021 26893 ts_tablet_manager.cc:1428] T f67711bc9fb645f6aa470ed8c367181d P 4a513aad7c74472ba318747fc285e200: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 16:41:32.356164 26367 heartbeater.cc:503] Master 127.24.175.254:42177 was elected leader, sending a full tablet report...
I20260811 16:41:32.356372 26901 tablet_bootstrap.cc:492] T f67711bc9fb645f6aa470ed8c367181d P a9fb512677b24324bded88ec60edc421: No bootstrap required, opened a new log
I20260811 16:41:32.356441 26901 ts_tablet_manager.cc:1397] T f67711bc9fb645f6aa470ed8c367181d P a9fb512677b24324bded88ec60edc421: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 16:41:32.356853 26895 raft_consensus.cc:348] T f67711bc9fb645f6aa470ed8c367181d P 004c2a6403584c6b8e93f342f0b555ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004c2a6403584c6b8e93f342f0b555ef" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 36397 } } peers { permanent_uuid: "4a513aad7c74472ba318747fc285e200" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 42797 } } peers { permanent_uuid: "a9fb512677b24324bded88ec60edc421" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 39297 } }
I20260811 16:41:32.357030 26895 raft_consensus.cc:374] T f67711bc9fb645f6aa470ed8c367181d P 004c2a6403584c6b8e93f342f0b555ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:41:32.357088 26895 raft_consensus.cc:729] T f67711bc9fb645f6aa470ed8c367181d P 004c2a6403584c6b8e93f342f0b555ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 004c2a6403584c6b8e93f342f0b555ef, State: Initialized, Role: FOLLOWER
I20260811 16:41:32.357196 26895 consensus_queue.cc:260] T f67711bc9fb645f6aa470ed8c367181d P 004c2a6403584c6b8e93f342f0b555ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004c2a6403584c6b8e93f342f0b555ef" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 36397 } } peers { permanent_uuid: "4a513aad7c74472ba318747fc285e200" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 42797 } } peers { permanent_uuid: "a9fb512677b24324bded88ec60edc421" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 39297 } }
I20260811 16:41:32.357443 26895 ts_tablet_manager.cc:1428] T f67711bc9fb645f6aa470ed8c367181d P 004c2a6403584c6b8e93f342f0b555ef: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:41:32.357479 26870 heartbeater.cc:503] Master 127.24.175.254:42177 was elected leader, sending a full tablet report...
I20260811 16:41:32.358310 26901 raft_consensus.cc:348] T f67711bc9fb645f6aa470ed8c367181d P a9fb512677b24324bded88ec60edc421 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004c2a6403584c6b8e93f342f0b555ef" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 36397 } } peers { permanent_uuid: "4a513aad7c74472ba318747fc285e200" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 42797 } } peers { permanent_uuid: "a9fb512677b24324bded88ec60edc421" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 39297 } }
I20260811 16:41:32.358482 26901 raft_consensus.cc:374] T f67711bc9fb645f6aa470ed8c367181d P a9fb512677b24324bded88ec60edc421 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:41:32.358529 26901 raft_consensus.cc:729] T f67711bc9fb645f6aa470ed8c367181d P a9fb512677b24324bded88ec60edc421 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9fb512677b24324bded88ec60edc421, State: Initialized, Role: FOLLOWER
I20260811 16:41:32.358632 26901 consensus_queue.cc:260] T f67711bc9fb645f6aa470ed8c367181d P a9fb512677b24324bded88ec60edc421 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004c2a6403584c6b8e93f342f0b555ef" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 36397 } } peers { permanent_uuid: "4a513aad7c74472ba318747fc285e200" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 42797 } } peers { permanent_uuid: "a9fb512677b24324bded88ec60edc421" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 39297 } }
I20260811 16:41:32.358870 26901 ts_tablet_manager.cc:1428] T f67711bc9fb645f6aa470ed8c367181d P a9fb512677b24324bded88ec60edc421: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260811 16:41:32.358929 26638 heartbeater.cc:503] Master 127.24.175.254:42177 was elected leader, sending a full tablet report...
I20260811 16:41:32.374907 26913 raft_consensus.cc:482] T f67711bc9fb645f6aa470ed8c367181d P a9fb512677b24324bded88ec60edc421 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:41:32.375044 26913 raft_consensus.cc:504] T f67711bc9fb645f6aa470ed8c367181d P a9fb512677b24324bded88ec60edc421 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004c2a6403584c6b8e93f342f0b555ef" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 36397 } } peers { permanent_uuid: "4a513aad7c74472ba318747fc285e200" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 42797 } } peers { permanent_uuid: "a9fb512677b24324bded88ec60edc421" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 39297 } }
I20260811 16:41:32.375393 26913 leader_election.cc:288] T f67711bc9fb645f6aa470ed8c367181d P a9fb512677b24324bded88ec60edc421 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 004c2a6403584c6b8e93f342f0b555ef (127.24.175.195:36397), 4a513aad7c74472ba318747fc285e200 (127.24.175.193:42797)
I20260811 16:41:32.378041 26642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:32.375526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.195:36397 (local address 127.24.175.194:34059)
0811 16:41:32.375577 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:32.375589 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:41:32.375633 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:41:32.375840 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:41:32.375841 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:41:32.375843 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:41:32.375912 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:32.375913 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:32.376521 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:32.376522 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:32.377267 (+ 745us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:32.377269 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:32.377806 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:32.377807 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:32.377883 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:32.377886 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:41:32.377930 (+ 44us) client_negotiation.cc:240] Negotiation successful
0811 16:41:32.377971 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260811 16:41:32.378041 26886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:32.375652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:34059 (local address 127.24.175.195:36397)
0811 16:41:32.375713 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:32.375715 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:32.375724 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:41:32.375752 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:32.375753 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:32.375763 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:32.375822 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:41:32.375971 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:32.376454 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:32.377351 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:32.377739 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:32.377798 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:32.377808 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:32.377941 (+ 133us) server_negotiation.cc:299] Negotiation successful
0811 16:41:32.377977 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 16:41:32.378190 26892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:32.375708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:34791 (local address 127.24.175.193:42797)
0811 16:41:32.375774 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:32.375776 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:32.375882 (+ 106us) server_negotiation.cc:407] Connection header received
0811 16:41:32.375937 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:32.375938 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:32.375946 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:32.375998 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:41:32.376127 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:32.376593 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:32.377468 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:32.377853 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:32.377914 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:32.377923 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:32.378054 (+ 131us) server_negotiation.cc:299] Negotiation successful
0811 16:41:32.378090 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 16:41:32.378273 26914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:32.375619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.193:42797 (local address 127.24.175.194:34791)
0811 16:41:32.375827 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:32.375834 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0811 16:41:32.375884 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:41:32.376002 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:41:32.376003 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:41:32.376005 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:41:32.376077 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:32.376079 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:32.376661 (+ 582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:32.376662 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:32.377387 (+ 725us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:32.377389 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:32.377924 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:32.377925 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:32.377994 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:32.377998 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:41:32.378041 (+ 43us) client_negotiation.cc:240] Negotiation successful
0811 16:41:32.378078 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":123,"threads_started":1}
I20260811 16:41:32.378598 26788 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f67711bc9fb645f6aa470ed8c367181d" candidate_uuid: "a9fb512677b24324bded88ec60edc421" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "004c2a6403584c6b8e93f342f0b555ef" is_pre_election: true
I20260811 16:41:32.378597 26286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f67711bc9fb645f6aa470ed8c367181d" candidate_uuid: "a9fb512677b24324bded88ec60edc421" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a513aad7c74472ba318747fc285e200" is_pre_election: true
I20260811 16:41:32.378778 26788 raft_consensus.cc:2454] T f67711bc9fb645f6aa470ed8c367181d P 004c2a6403584c6b8e93f342f0b555ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9fb512677b24324bded88ec60edc421 in term 0.
I20260811 16:41:32.378778 26286 raft_consensus.cc:2454] T f67711bc9fb645f6aa470ed8c367181d P 4a513aad7c74472ba318747fc285e200 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9fb512677b24324bded88ec60edc421 in term 0.
I20260811 16:41:32.379010 26418 leader_election.cc:302] T f67711bc9fb645f6aa470ed8c367181d P a9fb512677b24324bded88ec60edc421 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 004c2a6403584c6b8e93f342f0b555ef, a9fb512677b24324bded88ec60edc421; no voters:
I20260811 16:41:32.379154 26913 raft_consensus.cc:2781] T f67711bc9fb645f6aa470ed8c367181d P a9fb512677b24324bded88ec60edc421 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:41:32.379217 26913 raft_consensus.cc:482] T f67711bc9fb645f6aa470ed8c367181d P a9fb512677b24324bded88ec60edc421 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:41:32.379241 26913 raft_consensus.cc:3037] T f67711bc9fb645f6aa470ed8c367181d P a9fb512677b24324bded88ec60edc421 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:41:32.379951 26913 raft_consensus.cc:504] T f67711bc9fb645f6aa470ed8c367181d P a9fb512677b24324bded88ec60edc421 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004c2a6403584c6b8e93f342f0b555ef" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 36397 } } peers { permanent_uuid: "4a513aad7c74472ba318747fc285e200" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 42797 } } peers { permanent_uuid: "a9fb512677b24324bded88ec60edc421" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 39297 } }
I20260811 16:41:32.380070 26913 leader_election.cc:288] T f67711bc9fb645f6aa470ed8c367181d P a9fb512677b24324bded88ec60edc421 [CANDIDATE]: Term 1 election: Requested vote from peers 004c2a6403584c6b8e93f342f0b555ef (127.24.175.195:36397), 4a513aad7c74472ba318747fc285e200 (127.24.175.193:42797)
I20260811 16:41:32.380240 26788 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f67711bc9fb645f6aa470ed8c367181d" candidate_uuid: "a9fb512677b24324bded88ec60edc421" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "004c2a6403584c6b8e93f342f0b555ef"
I20260811 16:41:32.380301 26286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f67711bc9fb645f6aa470ed8c367181d" candidate_uuid: "a9fb512677b24324bded88ec60edc421" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a513aad7c74472ba318747fc285e200"
I20260811 16:41:32.380337 26788 raft_consensus.cc:3037] T f67711bc9fb645f6aa470ed8c367181d P 004c2a6403584c6b8e93f342f0b555ef [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:41:32.380380 26286 raft_consensus.cc:3037] T f67711bc9fb645f6aa470ed8c367181d P 4a513aad7c74472ba318747fc285e200 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:41:32.381263 26788 raft_consensus.cc:2454] T f67711bc9fb645f6aa470ed8c367181d P 004c2a6403584c6b8e93f342f0b555ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9fb512677b24324bded88ec60edc421 in term 1.
I20260811 16:41:32.381261 26286 raft_consensus.cc:2454] T f67711bc9fb645f6aa470ed8c367181d P 4a513aad7c74472ba318747fc285e200 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9fb512677b24324bded88ec60edc421 in term 1.
I20260811 16:41:32.381424 26418 leader_election.cc:302] T f67711bc9fb645f6aa470ed8c367181d P a9fb512677b24324bded88ec60edc421 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 004c2a6403584c6b8e93f342f0b555ef, a9fb512677b24324bded88ec60edc421; no voters:
I20260811 16:41:32.381513 26913 raft_consensus.cc:2781] T f67711bc9fb645f6aa470ed8c367181d P a9fb512677b24324bded88ec60edc421 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:41:32.381666 26913 raft_consensus.cc:686] T f67711bc9fb645f6aa470ed8c367181d P a9fb512677b24324bded88ec60edc421 [term 1 LEADER]: Becoming Leader. State: Replica: a9fb512677b24324bded88ec60edc421, State: Running, Role: LEADER
I20260811 16:41:32.381803 26913 consensus_queue.cc:237] T f67711bc9fb645f6aa470ed8c367181d P a9fb512677b24324bded88ec60edc421 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004c2a6403584c6b8e93f342f0b555ef" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 36397 } } peers { permanent_uuid: "4a513aad7c74472ba318747fc285e200" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 42797 } } peers { permanent_uuid: "a9fb512677b24324bded88ec60edc421" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 39297 } }
I20260811 16:41:32.382699 26030 catalog_manager.cc:5495] T f67711bc9fb645f6aa470ed8c367181d P a9fb512677b24324bded88ec60edc421 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9fb512677b24324bded88ec60edc421 (127.24.175.194). New cstate: current_term: 1 leader_uuid: "a9fb512677b24324bded88ec60edc421" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004c2a6403584c6b8e93f342f0b555ef" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 36397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a513aad7c74472ba318747fc285e200" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 42797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9fb512677b24324bded88ec60edc421" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 39297 } health_report { overall_health: HEALTHY } } }
I20260811 16:41:32.395707 26889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:32.393368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38026 (local address 127.24.175.194:39297)
0811 16:41:32.393407 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:32.393409 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:32.393417 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:41:32.393469 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:32.393470 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:32.393487 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:32.393548 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:41:32.393713 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:32.394232 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:32.394952 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:32.395169 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:32.395222 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:32.395373 (+ 151us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:41:32.395475 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:41:32.395542 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:32.395600 (+ 58us) server_negotiation.cc:299] Negotiation successful
0811 16:41:32.395619 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 16:41:32.397321 26286 raft_consensus.cc:1261] T f67711bc9fb645f6aa470ed8c367181d P 4a513aad7c74472ba318747fc285e200 [term 1 FOLLOWER]: Refusing update from remote peer a9fb512677b24324bded88ec60edc421: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:41:32.397346 26788 raft_consensus.cc:1261] T f67711bc9fb645f6aa470ed8c367181d P 004c2a6403584c6b8e93f342f0b555ef [term 1 FOLLOWER]: Refusing update from remote peer a9fb512677b24324bded88ec60edc421: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:41:32.397629 26913 consensus_queue.cc:1035] T f67711bc9fb645f6aa470ed8c367181d P a9fb512677b24324bded88ec60edc421 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a513aad7c74472ba318747fc285e200" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 42797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:41:32.397780 26919 consensus_queue.cc:1035] T f67711bc9fb645f6aa470ed8c367181d P a9fb512677b24324bded88ec60edc421 [LEADER]: Connected to new peer: Peer: permanent_uuid: "004c2a6403584c6b8e93f342f0b555ef" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 36397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 16:41:32.399305 26641 tablet.cc:2369] T f67711bc9fb645f6aa470ed8c367181d P a9fb512677b24324bded88ec60edc421: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:41:32.400382 26924 mvcc.cc:205] Tried to move back new op lower bound from 7317366752857161728 to 7317366752796545024. Current Snapshot: MvccSnapshot[applied={T|T < 7317366752857161728}]
I20260811 16:41:32.402878 26031 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43210:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:41:32.402964 26031 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43210:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:41:32.403688 26031 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ce01558f0664497ba9e0b7ca02f70cb3: Sending DeleteTablet for 3 replicas of tablet f67711bc9fb645f6aa470ed8c367181d
I20260811 16:41:32.404008 26520 tablet_service.cc:1514] Processing DeleteTablet for tablet f67711bc9fb645f6aa470ed8c367181d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:41:32 UTC) from {username='kudu', principal='kudu/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:38020
I20260811 16:41:32.404073 26751 tablet_service.cc:1514] Processing DeleteTablet for tablet f67711bc9fb645f6aa470ed8c367181d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:41:32 UTC) from {username='kudu', principal='kudu/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:45364
I20260811 16:41:32.404069 26248 tablet_service.cc:1514] Processing DeleteTablet for tablet f67711bc9fb645f6aa470ed8c367181d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:41:32 UTC) from {username='kudu', principal='kudu/127.24.175.254@KRBTEST.COM'} at 127.0.0.1:36824
I20260811 16:41:32.404238 26934 tablet_replica.cc:330] T f67711bc9fb645f6aa470ed8c367181d P a9fb512677b24324bded88ec60edc421: stopping tablet replica
I20260811 16:41:32.404335 26934 raft_consensus.cc:2229] T f67711bc9fb645f6aa470ed8c367181d P a9fb512677b24324bded88ec60edc421 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:41:32.404428 26934 raft_consensus.cc:2258] T f67711bc9fb645f6aa470ed8c367181d P a9fb512677b24324bded88ec60edc421 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:41:32.404733 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 26145
I20260811 16:41:32.404856 26934 ts_tablet_manager.cc:1905] T f67711bc9fb645f6aa470ed8c367181d P a9fb512677b24324bded88ec60edc421: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:41:32.406840 26934 ts_tablet_manager.cc:1918] T f67711bc9fb645f6aa470ed8c367181d P a9fb512677b24324bded88ec60edc421: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:41:32.406920 26934 log.cc:1196] T f67711bc9fb645f6aa470ed8c367181d P a9fb512677b24324bded88ec60edc421: Deleting WAL directory at /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/ts-1/wal/wals/f67711bc9fb645f6aa470ed8c367181d
I20260811 16:41:32.407227 26934 ts_tablet_manager.cc:1939] T f67711bc9fb645f6aa470ed8c367181d P a9fb512677b24324bded88ec60edc421: Deleting consensus metadata
I20260811 16:41:32.407640 26937 tablet_replica.cc:330] T f67711bc9fb645f6aa470ed8c367181d P 004c2a6403584c6b8e93f342f0b555ef: stopping tablet replica
I20260811 16:41:32.407768 26937 raft_consensus.cc:2229] T f67711bc9fb645f6aa470ed8c367181d P 004c2a6403584c6b8e93f342f0b555ef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:41:32.407883 26937 raft_consensus.cc:2258] T f67711bc9fb645f6aa470ed8c367181d P 004c2a6403584c6b8e93f342f0b555ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:41:32.408862 26937 ts_tablet_manager.cc:1905] T f67711bc9fb645f6aa470ed8c367181d P 004c2a6403584c6b8e93f342f0b555ef: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:41:32.410622 26937 ts_tablet_manager.cc:1918] T f67711bc9fb645f6aa470ed8c367181d P 004c2a6403584c6b8e93f342f0b555ef: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:41:32.410698 26937 log.cc:1196] T f67711bc9fb645f6aa470ed8c367181d P 004c2a6403584c6b8e93f342f0b555ef: Deleting WAL directory at /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466249441839-25279-0/minicluster-data/ts-2/wal/wals/f67711bc9fb645f6aa470ed8c367181d
I20260811 16:41:32.411019 26937 ts_tablet_manager.cc:1939] T f67711bc9fb645f6aa470ed8c367181d P 004c2a6403584c6b8e93f342f0b555ef: Deleting consensus metadata
I20260811 16:41:32.411545 26009 catalog_manager.cc:4841] TS a9fb512677b24324bded88ec60edc421 (127.24.175.194:39297): tablet f67711bc9fb645f6aa470ed8c367181d (table test-table [id=9737c96b200f4ec88826acfde1b57275]) successfully deleted
I20260811 16:41:32.413636 26001 catalog_manager.cc:4841] TS 004c2a6403584c6b8e93f342f0b555ef (127.24.175.195:36397): tablet f67711bc9fb645f6aa470ed8c367181d (table test-table [id=9737c96b200f4ec88826acfde1b57275]) successfully deleted
W20260811 16:41:32.420409 26001 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.24.175.193:42797 (error 108)
I20260811 16:41:32.420696 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 26381
I20260811 16:41:32.427249 26891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:32.427066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.193:42797 (local address 127.0.0.1:36836)
0811 16:41:32.427136 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:32.427202 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.193:42797: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260811 16:41:32.427426 26001 catalog_manager.cc:4584] TS 4a513aad7c74472ba318747fc285e200 (127.24.175.193:42797): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f67711bc9fb645f6aa470ed8c367181d: Network error: Client connection negotiation failed: client connection to 127.24.175.193:42797: connect: Connection refused (error 111)
I20260811 16:41:32.438403 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 26645
I20260811 16:41:32.453939 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 25969
2026-08-11T16:41:32Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2090 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-11T16:41:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:41:32Z Disabled control of system clock
I20260811 16:41:32.484619 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:38047
--webserver_interface=127.24.175.254
--webserver_port=0
--builtin_ntp_servers=127.24.175.212:39077
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.175.254:38047
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 16:41:32.565361 26948 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:41:32.565598 26948 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:41:32.565619 26948 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:41:32.566776 26948 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:41:32.566816 26948 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:41:32.566828 26948 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:41:32.566838 26948 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:41:32.566851 26948 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:41:32.568161 26948 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:39077
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.175.254:38047
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:38047
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26948
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:41:32.568374 26948 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:41:32.568621 26948 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:41:32.573336 26968 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:41:32.573367 26960 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:32.573397 26948 server_base.cc:1034] running on GCE node
W20260811 16:41:32.573367 26961 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:32.573769 26948 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:41:32.574054 26948 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:41:32.575196 26948 hybrid_clock.cc:648] HybridClock initialized: now 1786466492575183 us; error 32 us; skew 500 ppm
I20260811 16:41:32.576385 26948 webserver.cc:460] Webserver started at http://127.24.175.254:37305/ using document root <none> and password file <none>
I20260811 16:41:32.576609 26948 fs_manager.cc:359] Metadata directory not provided
I20260811 16:41:32.576656 26948 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:41:32.576788 26948 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:41:32.577855 26948 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/master-0/data/instance:
uuid: "e734911205b645348db35815fbc4f3ef"
format_stamp: "Formatted at 2026-08-11 16:41:32 on dist-test-slave-zj8q"
server_key: "f383175326a91ce2c3466269bb49c681"
server_key_iv: "8b8f8ac37e017ac90b6fef9707babcc7"
server_key_version: "encryptionkey@0"
I20260811 16:41:32.578233 26948 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/master-0/wal/instance:
uuid: "e734911205b645348db35815fbc4f3ef"
format_stamp: "Formatted at 2026-08-11 16:41:32 on dist-test-slave-zj8q"
server_key: "f383175326a91ce2c3466269bb49c681"
server_key_iv: "8b8f8ac37e017ac90b6fef9707babcc7"
server_key_version: "encryptionkey@0"
I20260811 16:41:32.579475 26948 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:41:32.580142 26976 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:32.580279 26948 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 16:41:32.580360 26948 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/master-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/master-0/wal
uuid: "e734911205b645348db35815fbc4f3ef"
format_stamp: "Formatted at 2026-08-11 16:41:32 on dist-test-slave-zj8q"
server_key: "f383175326a91ce2c3466269bb49c681"
server_key_iv: "8b8f8ac37e017ac90b6fef9707babcc7"
server_key_version: "encryptionkey@0"
I20260811 16:41:32.580428 26948 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:41:32.598544 26948 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:41:32.598819 26948 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:41:32.598933 26948 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:41:32.602767 26948 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.254:38047
I20260811 16:41:32.602804 27067 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.254:38047 every 8 connection(s)
I20260811 16:41:32.603111 26948 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
I20260811 16:41:32.604059 27068 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:41:32.606369 27068 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e734911205b645348db35815fbc4f3ef: Bootstrap starting.
I20260811 16:41:32.606896 27068 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e734911205b645348db35815fbc4f3ef: Neither blocks nor log segments found. Creating new log.
I20260811 16:41:32.607163 27068 log.cc:824] T 00000000000000000000000000000000 P e734911205b645348db35815fbc4f3ef: Log is configured to *not* fsync() on all Append() calls
I20260811 16:41:32.607770 27068 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e734911205b645348db35815fbc4f3ef: No bootstrap required, opened a new log
I20260811 16:41:32.608830 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 26948
I20260811 16:41:32.608947 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/master-0/wal/instance
I20260811 16:41:32.609125 25279 external_mini_cluster.cc:1428] Setting key d9a93d790c8336c8e96c48439163ecab
I20260811 16:41:32.609598 27068 raft_consensus.cc:348] T 00000000000000000000000000000000 P e734911205b645348db35815fbc4f3ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e734911205b645348db35815fbc4f3ef" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 38047 } }
I20260811 16:41:32.609777 27068 raft_consensus.cc:374] T 00000000000000000000000000000000 P e734911205b645348db35815fbc4f3ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:41:32.609822 27068 raft_consensus.cc:729] T 00000000000000000000000000000000 P e734911205b645348db35815fbc4f3ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e734911205b645348db35815fbc4f3ef, State: Initialized, Role: FOLLOWER
I20260811 16:41:32.609944 27068 consensus_queue.cc:260] T 00000000000000000000000000000000 P e734911205b645348db35815fbc4f3ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e734911205b645348db35815fbc4f3ef" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 38047 } }
I20260811 16:41:32.610006 27068 raft_consensus.cc:388] T 00000000000000000000000000000000 P e734911205b645348db35815fbc4f3ef [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:41:32.610026 27068 raft_consensus.cc:482] T 00000000000000000000000000000000 P e734911205b645348db35815fbc4f3ef [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:41:32.610070 27068 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e734911205b645348db35815fbc4f3ef [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:41:32.610692 27068 raft_consensus.cc:504] T 00000000000000000000000000000000 P e734911205b645348db35815fbc4f3ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e734911205b645348db35815fbc4f3ef" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 38047 } }
I20260811 16:41:32.610780 27068 leader_election.cc:302] T 00000000000000000000000000000000 P e734911205b645348db35815fbc4f3ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e734911205b645348db35815fbc4f3ef; no voters:
I20260811 16:41:32.610927 27068 leader_election.cc:288] T 00000000000000000000000000000000 P e734911205b645348db35815fbc4f3ef [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:41:32.610986 27075 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e734911205b645348db35815fbc4f3ef [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:41:32.611099 27075 raft_consensus.cc:686] T 00000000000000000000000000000000 P e734911205b645348db35815fbc4f3ef [term 1 LEADER]: Becoming Leader. State: Replica: e734911205b645348db35815fbc4f3ef, State: Running, Role: LEADER
I20260811 16:41:32.611193 27068 sys_catalog.cc:564] T 00000000000000000000000000000000 P e734911205b645348db35815fbc4f3ef [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:41:32.611182 27075 consensus_queue.cc:237] T 00000000000000000000000000000000 P e734911205b645348db35815fbc4f3ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e734911205b645348db35815fbc4f3ef" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 38047 } }
I20260811 16:41:32.611487 27075 sys_catalog.cc:455] T 00000000000000000000000000000000 P e734911205b645348db35815fbc4f3ef [sys.catalog]: SysCatalogTable state changed. Reason: New leader e734911205b645348db35815fbc4f3ef. Latest consensus state: current_term: 1 leader_uuid: "e734911205b645348db35815fbc4f3ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e734911205b645348db35815fbc4f3ef" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 38047 } } }
I20260811 16:41:32.611563 27075 sys_catalog.cc:458] T 00000000000000000000000000000000 P e734911205b645348db35815fbc4f3ef [sys.catalog]: This master's current role is: LEADER
I20260811 16:41:32.611500 27077 sys_catalog.cc:455] T 00000000000000000000000000000000 P e734911205b645348db35815fbc4f3ef [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e734911205b645348db35815fbc4f3ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e734911205b645348db35815fbc4f3ef" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 38047 } } }
I20260811 16:41:32.611706 27077 sys_catalog.cc:458] T 00000000000000000000000000000000 P e734911205b645348db35815fbc4f3ef [sys.catalog]: This master's current role is: LEADER
I20260811 16:41:32.612458 27082 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:41:32.612933 27082 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:41:32.614444 27082 catalog_manager.cc:1347] Generated new cluster ID: c2042048fda348f5acb3cfe6fa112581
I20260811 16:41:32.614500 27082 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:41:32.615149 27072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:32.609625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42292 (local address 127.24.175.254:38047)
0811 16:41:32.609837 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:32.609845 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:32.609877 (+ 32us) server_negotiation.cc:407] Connection header received
0811 16:41:32.609991 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:32.609997 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:32.610067 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:32.610234 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:41:32.610439 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:32.611985 (+ 1546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:32.613048 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:32.613632 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:32.613744 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:32.614449 (+ 705us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:41:32.614452 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:41:32.614453 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:41:32.614653 (+ 200us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:41:32.614697 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:41:32.614711 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:41:32.614772 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:32.614875 (+ 103us) server_negotiation.cc:299] Negotiation successful
0811 16:41:32.614948 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":82,"threads_started":1}
I20260811 16:41:32.625641 27082 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:41:32.626102 27082 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:41:32.633090 27082 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e734911205b645348db35815fbc4f3ef: Generated new TSK 0
I20260811 16:41:32.633247 27082 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:41:32.637732 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.193:0
--local_ip_for_outbound_sockets=127.24.175.193
--webserver_interface=127.24.175.193
--webserver_port=0
--tserver_master_addrs=127.24.175.254:38047
--builtin_ntp_servers=127.24.175.212:39077
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 16:41:32.719815 27101 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:41:32.720012 27101 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:41:32.720032 27101 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:41:32.721159 27101 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:41:32.721199 27101 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:41:32.721230 27101 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.193
I20260811 16:41:32.722635 27101 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:39077
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.175.193
--webserver_port=0
--tserver_master_addrs=127.24.175.254:38047
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27101
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.193
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:41:32.722849 27101 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:41:32.723135 27101 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:41:32.728976 27114 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:32.729080 27101 server_base.cc:1034] running on GCE node
W20260811 16:41:32.728982 27110 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:41:32.729255 27118 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:32.729460 27101 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:41:32.729692 27101 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:41:32.730839 27101 hybrid_clock.cc:648] HybridClock initialized: now 1786466492730827 us; error 28 us; skew 500 ppm
I20260811 16:41:32.732139 27101 webserver.cc:460] Webserver started at http://127.24.175.193:35403/ using document root <none> and password file <none>
I20260811 16:41:32.732386 27101 fs_manager.cc:359] Metadata directory not provided
I20260811 16:41:32.732432 27101 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:41:32.732554 27101 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:41:32.733620 27101 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/ts-0/data/instance:
uuid: "326059a64833452393d4072b47484170"
format_stamp: "Formatted at 2026-08-11 16:41:32 on dist-test-slave-zj8q"
server_key: "3143a241a342237af3d74fef1da7c4ce"
server_key_iv: "677156285ab39454bc518c05631e802a"
server_key_version: "encryptionkey@0"
I20260811 16:41:32.733961 27101 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/ts-0/wal/instance:
uuid: "326059a64833452393d4072b47484170"
format_stamp: "Formatted at 2026-08-11 16:41:32 on dist-test-slave-zj8q"
server_key: "3143a241a342237af3d74fef1da7c4ce"
server_key_iv: "677156285ab39454bc518c05631e802a"
server_key_version: "encryptionkey@0"
I20260811 16:41:32.735282 27101 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:41:32.735939 27129 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:32.736075 27101 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:41:32.736163 27101 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/ts-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/ts-0/wal
uuid: "326059a64833452393d4072b47484170"
format_stamp: "Formatted at 2026-08-11 16:41:32 on dist-test-slave-zj8q"
server_key: "3143a241a342237af3d74fef1da7c4ce"
server_key_iv: "677156285ab39454bc518c05631e802a"
server_key_version: "encryptionkey@0"
I20260811 16:41:32.736244 27101 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:41:32.757444 27101 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:41:32.757721 27101 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:41:32.757848 27101 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:41:32.758052 27101 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:41:32.758404 27101 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:41:32.758440 27101 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:32.758469 27101 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:41:32.758495 27101 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:32.764019 27101 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.193:40155
I20260811 16:41:32.764073 27324 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.193:40155 every 8 connection(s)
I20260811 16:41:32.764380 27101 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/ts-0/data/info.pb
I20260811 16:41:32.769124 27072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:32.765036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.193:39767 (local address 127.24.175.254:38047)
0811 16:41:32.765091 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:32.765093 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:32.765329 (+ 236us) server_negotiation.cc:407] Connection header received
0811 16:41:32.765853 (+ 524us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:32.765855 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:32.765868 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:32.765927 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:41:32.766614 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:32.767112 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:32.768027 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:32.768206 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:32.768248 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:32.768940 (+ 692us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:41:32.768940 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:41:32.768941 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:41:32.768945 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:41:32.768954 (+ 9us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:41:32.768957 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:41:32.768988 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:32.769046 (+ 58us) server_negotiation.cc:299] Negotiation successful
0811 16:41:32.769067 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 16:41:32.769323 27327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:32.765005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:38047 (local address 127.24.175.193:39767)
0811 16:41:32.765199 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:32.765240 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 16:41:32.765741 (+ 501us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:41:32.765989 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:41:32.765992 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:41:32.766001 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:41:32.766522 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:32.766528 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:32.767176 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:32.767177 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:32.767966 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:32.767968 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:32.768256 (+ 288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:32.768257 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:32.768359 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:32.768831 (+ 472us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 16:41:32.768831 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:41:32.768858 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 16:41:32.768882 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:41:32.768995 (+ 113us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:41:32.768997 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:41:32.769000 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:41:32.769044 (+ 44us) client_negotiation.cc:240] Negotiation successful
0811 16:41:32.769123 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":87,"threads_started":1}
I20260811 16:41:32.769827 27325 heartbeater.cc:347] Connected to a master server at 127.24.175.254:38047
I20260811 16:41:32.769912 27325 heartbeater.cc:464] Registering TS with master...
I20260811 16:41:32.770057 27325 heartbeater.cc:511] Master 127.24.175.254:38047 requested a full tablet report, sending...
I20260811 16:41:32.770566 27003 ts_manager.cc:194] Registered new tserver with Master: 326059a64833452393d4072b47484170 (127.24.175.193:40155)
I20260811 16:41:32.771154 27003 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.24.175.193:39767
I20260811 16:41:32.773201 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 27101
I20260811 16:41:32.773304 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/ts-0/wal/instance
I20260811 16:41:32.773463 25279 external_mini_cluster.cc:1428] Setting key 1b69886b89680950d9fd65c5378deee4
I20260811 16:41:32.774286 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.194:0
--local_ip_for_outbound_sockets=127.24.175.194
--webserver_interface=127.24.175.194
--webserver_port=0
--tserver_master_addrs=127.24.175.254:38047
--builtin_ntp_servers=127.24.175.212:39077
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 16:41:32.856432 27328 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:41:32.856616 27328 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:41:32.856637 27328 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:41:32.857920 27328 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:41:32.857968 27328 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:41:32.857999 27328 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.194
I20260811 16:41:32.859444 27328 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:39077
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.175.194
--webserver_port=0
--tserver_master_addrs=127.24.175.254:38047
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27328
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.194
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:41:32.859668 27328 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:41:32.859944 27328 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:41:32.864707 27342 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:41:32.864718 27338 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:32.864816 27328 server_base.cc:1034] running on GCE node
W20260811 16:41:32.864722 27340 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:32.865126 27328 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:41:32.865366 27328 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:41:32.866496 27328 hybrid_clock.cc:648] HybridClock initialized: now 1786466492866483 us; error 28 us; skew 500 ppm
I20260811 16:41:32.867630 27328 webserver.cc:460] Webserver started at http://127.24.175.194:41689/ using document root <none> and password file <none>
I20260811 16:41:32.867870 27328 fs_manager.cc:359] Metadata directory not provided
I20260811 16:41:32.867919 27328 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:41:32.868050 27328 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:41:32.869050 27328 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/ts-1/data/instance:
uuid: "d1cd2c1471fa43d59530e88252f0fb2e"
format_stamp: "Formatted at 2026-08-11 16:41:32 on dist-test-slave-zj8q"
server_key: "7ab17fdfd986c6f5fb67874466d9924f"
server_key_iv: "0685c5aefda29a0d2ad8b4434bcfb843"
server_key_version: "encryptionkey@0"
I20260811 16:41:32.869371 27328 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/ts-1/wal/instance:
uuid: "d1cd2c1471fa43d59530e88252f0fb2e"
format_stamp: "Formatted at 2026-08-11 16:41:32 on dist-test-slave-zj8q"
server_key: "7ab17fdfd986c6f5fb67874466d9924f"
server_key_iv: "0685c5aefda29a0d2ad8b4434bcfb843"
server_key_version: "encryptionkey@0"
I20260811 16:41:32.870591 27328 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 16:41:32.871234 27351 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:32.871383 27328 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 16:41:32.871467 27328 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/ts-1/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/ts-1/wal
uuid: "d1cd2c1471fa43d59530e88252f0fb2e"
format_stamp: "Formatted at 2026-08-11 16:41:32 on dist-test-slave-zj8q"
server_key: "7ab17fdfd986c6f5fb67874466d9924f"
server_key_iv: "0685c5aefda29a0d2ad8b4434bcfb843"
server_key_version: "encryptionkey@0"
I20260811 16:41:32.871531 27328 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:41:32.888438 27328 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:41:32.888691 27328 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:41:32.888821 27328 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:41:32.889012 27328 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:41:32.889309 27328 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:41:32.889343 27328 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:32.889371 27328 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:41:32.889389 27328 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:32.894747 27328 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.194:38071
I20260811 16:41:32.894783 27538 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.194:38071 every 8 connection(s)
I20260811 16:41:32.895072 27328 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/ts-1/data/info.pb
I20260811 16:41:32.899430 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 27328
I20260811 16:41:32.899535 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/ts-1/wal/instance
I20260811 16:41:32.899719 25279 external_mini_cluster.cc:1428] Setting key 509b55f5f3acecdfd14dad6e4cf3b865
I20260811 16:41:32.900099 27072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:32.895753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:57133 (local address 127.24.175.254:38047)
0811 16:41:32.895803 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:32.895805 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:32.896018 (+ 213us) server_negotiation.cc:407] Connection header received
0811 16:41:32.896508 (+ 490us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:32.896509 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:32.896521 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:32.896573 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:41:32.897280 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:32.897770 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:32.898748 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:32.898939 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:32.898993 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:32.899812 (+ 819us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:41:32.899814 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:41:32.899814 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:41:32.899819 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:41:32.899837 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:41:32.899842 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:41:32.899888 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:32.899988 (+ 100us) server_negotiation.cc:299] Negotiation successful
0811 16:41:32.900019 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 16:41:32.900311 27542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:32.895721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:38047 (local address 127.24.175.194:57133)
0811 16:41:32.895911 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:32.895942 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0811 16:41:32.896413 (+ 471us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:41:32.896663 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:41:32.896666 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:41:32.896674 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:41:32.897161 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:32.897166 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:32.897852 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:32.897853 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:32.898672 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:32.898675 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:32.899011 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:32.899012 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:32.899131 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:32.899638 (+ 507us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 16:41:32.899638 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:41:32.899678 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 16:41:32.899706 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:41:32.899901 (+ 195us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:41:32.899908 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:41:32.899911 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:41:32.899986 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 16:41:32.900089 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":84,"threads_started":1}
I20260811 16:41:32.900633 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.175.195:0
--local_ip_for_outbound_sockets=127.24.175.195
--webserver_interface=127.24.175.195
--webserver_port=0
--tserver_master_addrs=127.24.175.254:38047
--builtin_ntp_servers=127.24.175.212:39077
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 16:41:32.900712 27540 heartbeater.cc:347] Connected to a master server at 127.24.175.254:38047
I20260811 16:41:32.900790 27540 heartbeater.cc:464] Registering TS with master...
I20260811 16:41:32.900949 27540 heartbeater.cc:511] Master 127.24.175.254:38047 requested a full tablet report, sending...
I20260811 16:41:32.901264 27003 ts_manager.cc:194] Registered new tserver with Master: d1cd2c1471fa43d59530e88252f0fb2e (127.24.175.194:38071)
I20260811 16:41:32.901614 27003 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.24.175.194:57133
W20260811 16:41:32.982180 27543 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:41:32.982399 27543 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:41:32.982429 27543 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:41:32.983556 27543 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:41:32.983600 27543 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:41:32.983632 27543 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.175.195
I20260811 16:41:32.984959 27543 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:39077
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.175.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.175.195
--webserver_port=0
--tserver_master_addrs=127.24.175.254:38047
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27543
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.175.195
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:41:32.985189 27543 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:41:32.985448 27543 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 16:41:32.990296 27543 server_base.cc:1034] running on GCE node
W20260811 16:41:32.990281 27566 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:41:32.990281 27560 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:41:32.990373 27559 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:32.990715 27543 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:41:32.990950 27543 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:41:32.992087 27543 hybrid_clock.cc:648] HybridClock initialized: now 1786466492992071 us; error 28 us; skew 500 ppm
I20260811 16:41:32.993229 27543 webserver.cc:460] Webserver started at http://127.24.175.195:39203/ using document root <none> and password file <none>
I20260811 16:41:32.993443 27543 fs_manager.cc:359] Metadata directory not provided
I20260811 16:41:32.993490 27543 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:41:32.993620 27543 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:41:32.994678 27543 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/ts-2/data/instance:
uuid: "045a3c29944c4080bbd1d36baafbba13"
format_stamp: "Formatted at 2026-08-11 16:41:32 on dist-test-slave-zj8q"
server_key: "4f3316cd760bf011c79cc4acdd6be684"
server_key_iv: "3a596d30e7f4ba5b7e7689d62c8d51ed"
server_key_version: "encryptionkey@0"
I20260811 16:41:32.995005 27543 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/ts-2/wal/instance:
uuid: "045a3c29944c4080bbd1d36baafbba13"
format_stamp: "Formatted at 2026-08-11 16:41:32 on dist-test-slave-zj8q"
server_key: "4f3316cd760bf011c79cc4acdd6be684"
server_key_iv: "3a596d30e7f4ba5b7e7689d62c8d51ed"
server_key_version: "encryptionkey@0"
I20260811 16:41:32.996229 27543 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:41:32.996886 27578 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:32.997031 27543 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:41:32.997116 27543 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/ts-2/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/ts-2/wal
uuid: "045a3c29944c4080bbd1d36baafbba13"
format_stamp: "Formatted at 2026-08-11 16:41:32 on dist-test-slave-zj8q"
server_key: "4f3316cd760bf011c79cc4acdd6be684"
server_key_iv: "3a596d30e7f4ba5b7e7689d62c8d51ed"
server_key_version: "encryptionkey@0"
I20260811 16:41:32.997179 27543 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:41:33.010317 27543 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:41:33.010623 27543 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:41:33.010773 27543 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:41:33.010983 27543 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:41:33.011308 27543 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:41:33.011343 27543 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:33.011371 27543 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:41:33.011392 27543 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:33.017727 27543 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.195:46023
I20260811 16:41:33.017797 27754 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.195:46023 every 8 connection(s)
I20260811 16:41:33.018146 27543 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/ts-2/data/info.pb
I20260811 16:41:33.022989 27072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:33.018826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.195:52535 (local address 127.24.175.254:38047)
0811 16:41:33.018869 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:33.018871 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:33.019075 (+ 204us) server_negotiation.cc:407] Connection header received
0811 16:41:33.019572 (+ 497us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:33.019574 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:33.019589 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:33.019639 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:41:33.020285 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:33.020795 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:33.021742 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:33.021948 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:33.022004 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:33.022729 (+ 725us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:41:33.022731 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:41:33.022731 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:41:33.022736 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:41:33.022752 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:41:33.022757 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:41:33.022802 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:33.022875 (+ 73us) server_negotiation.cc:299] Negotiation successful
0811 16:41:33.022909 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 16:41:33.023160 27761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:33.018805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:38047 (local address 127.24.175.195:52535)
0811 16:41:33.018964 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:33.018997 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0811 16:41:33.019475 (+ 478us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:41:33.019706 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:41:33.019709 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:41:33.019718 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:41:33.020191 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:33.020195 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:33.020878 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:33.020879 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:33.021654 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:33.021656 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:33.022018 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:33.022019 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:33.022141 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:33.022595 (+ 454us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 16:41:33.022595 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:41:33.022623 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 16:41:33.022646 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:41:33.022808 (+ 162us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:41:33.022813 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:41:33.022816 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:41:33.022873 (+ 57us) client_negotiation.cc:240] Negotiation successful
0811 16:41:33.022975 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":73,"threads_started":1}
I20260811 16:41:33.023653 27755 heartbeater.cc:347] Connected to a master server at 127.24.175.254:38047
I20260811 16:41:33.023751 27755 heartbeater.cc:464] Registering TS with master...
I20260811 16:41:33.023921 27755 heartbeater.cc:511] Master 127.24.175.254:38047 requested a full tablet report, sending...
I20260811 16:41:33.024269 27003 ts_manager.cc:194] Registered new tserver with Master: 045a3c29944c4080bbd1d36baafbba13 (127.24.175.195:46023)
I20260811 16:41:33.024626 27003 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.24.175.195:52535
I20260811 16:41:33.026081 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 27543
I20260811 16:41:33.026227 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/ts-2/wal/instance
I20260811 16:41:33.026398 25279 external_mini_cluster.cc:1428] Setting key 65193ce75c21da3bedb6ee86f741ccae
I20260811 16:41:33.027240 25279 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 16:41:33.030937 27072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:33.028479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46568 (local address 127.24.175.254:38047)
0811 16:41:33.028528 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:33.028529 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:33.028641 (+ 112us) server_negotiation.cc:407] Connection header received
0811 16:41:33.028678 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:33.028679 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:33.028691 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:33.028735 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:41:33.028860 (+ 125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:33.029320 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:33.029981 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:33.030197 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:33.030242 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:33.030774 (+ 532us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:41:33.030776 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:41:33.030776 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:41:33.030780 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:41:33.030793 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:41:33.030796 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:41:33.030835 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:33.030865 (+ 30us) server_negotiation.cc:299] Negotiation successful
0811 16:41:33.030887 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 16:41:33.032225 27003 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46568:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:41:33.033771 27003 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:41:33.040098 27786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:33.036085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51764 (local address 127.24.175.193:40155)
0811 16:41:33.036290 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:33.036294 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:33.036303 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:41:33.036337 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:33.036338 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:33.036350 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:33.036637 (+ 287us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:41:33.036707 (+ 70us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:33.037794 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:33.038927 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:33.039685 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:33.039772 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:33.039863 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:33.039974 (+ 111us) server_negotiation.cc:299] Negotiation successful
0811 16:41:33.040015 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":92,"threads_started":1}
I20260811 16:41:33.040285 27785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:33.036072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40226 (local address 127.24.175.194:38071)
0811 16:41:33.036257 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:33.036261 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:33.036270 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:41:33.036304 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:33.036305 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:33.036318 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:33.036389 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:41:33.036562 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:33.037672 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:33.039130 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:33.039808 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:33.039868 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:33.039938 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:33.040170 (+ 232us) server_negotiation.cc:299] Negotiation successful
0811 16:41:33.040220 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":86,"threads_started":1}
I20260811 16:41:33.040290 27784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:33.035994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39020 (local address 127.24.175.195:46023)
0811 16:41:33.036194 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:33.036199 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:33.036579 (+ 380us) server_negotiation.cc:407] Connection header received
0811 16:41:33.036626 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:33.036628 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:33.036643 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:33.036714 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:41:33.036877 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:33.037552 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:33.039127 (+ 1575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:33.039679 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:33.039720 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:33.039795 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:33.040170 (+ 375us) server_negotiation.cc:299] Negotiation successful
0811 16:41:33.040216 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":103,"threads_started":1}
I20260811 16:41:33.040122 27783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:33.035794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.193:40155 (local address 127.0.0.1:51764)
0811 16:41:33.036160 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:33.036168 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 16:41:33.036203 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:41:33.036444 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:41:33.036445 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:41:33.036448 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:41:33.036496 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:33.036498 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:33.037867 (+ 1369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:33.037868 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:33.038854 (+ 986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:33.038857 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:33.039784 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:33.039785 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:33.039866 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:33.039879 (+ 13us) client_negotiation.cc:769] Sending connection context
0811 16:41:33.039955 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 16:41:33.040009 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":350,"mutex_wait_us":21,"thread_start_us":100,"threads_started":1}
I20260811 16:41:33.040131 27778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:33.035794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.195:46023 (local address 127.0.0.1:39020)
0811 16:41:33.036515 (+ 721us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:33.036524 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:41:33.036572 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:41:33.036773 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:41:33.036773 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:41:33.036775 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:41:33.036811 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:33.036812 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:33.037632 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:33.037633 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:33.039001 (+ 1368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:33.039004 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:33.039854 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:33.039855 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:33.039905 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:33.039907 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 16:41:33.039947 (+ 40us) client_negotiation.cc:240] Negotiation successful
0811 16:41:33.040007 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":709,"mutex_wait_us":41,"thread_start_us":51,"threads_started":1}
I20260811 16:41:33.040594 27779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:33.035792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.194:38071 (local address 127.0.0.1:40226)
0811 16:41:33.035951 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:33.035993 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 16:41:33.036059 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:41:33.036406 (+ 347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:41:33.036409 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:41:33.036412 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:41:33.036478 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:33.036480 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:33.037753 (+ 1273us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:33.037754 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:33.039001 (+ 1247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:33.039004 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:33.039973 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:33.039974 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:33.040036 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:33.040039 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:41:33.040085 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 16:41:33.040126 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"mutex_wait_us":47,"thread_start_us":121,"threads_started":1}
I20260811 16:41:33.041325 27441 tablet_service.cc:1467] Processing CreateTablet for tablet 219aa59bdad140a5bc8f134c3089b543 (DEFAULT_TABLE table=test-table [id=2f44c1d86b3a41fe922b1fd1d1c50f9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:41:33.041329 27210 tablet_service.cc:1467] Processing CreateTablet for tablet 219aa59bdad140a5bc8f134c3089b543 (DEFAULT_TABLE table=test-table [id=2f44c1d86b3a41fe922b1fd1d1c50f9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:41:33.041648 27210 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 219aa59bdad140a5bc8f134c3089b543. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:41:33.041659 27441 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 219aa59bdad140a5bc8f134c3089b543. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:41:33.044178 27787 tablet_bootstrap.cc:492] T 219aa59bdad140a5bc8f134c3089b543 P d1cd2c1471fa43d59530e88252f0fb2e: Bootstrap starting.
I20260811 16:41:33.044345 27788 tablet_bootstrap.cc:492] T 219aa59bdad140a5bc8f134c3089b543 P 326059a64833452393d4072b47484170: Bootstrap starting.
I20260811 16:41:33.044883 27787 tablet_bootstrap.cc:654] T 219aa59bdad140a5bc8f134c3089b543 P d1cd2c1471fa43d59530e88252f0fb2e: Neither blocks nor log segments found. Creating new log.
I20260811 16:41:33.044842 27654 tablet_service.cc:1467] Processing CreateTablet for tablet 219aa59bdad140a5bc8f134c3089b543 (DEFAULT_TABLE table=test-table [id=2f44c1d86b3a41fe922b1fd1d1c50f9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:41:33.045100 27788 tablet_bootstrap.cc:654] T 219aa59bdad140a5bc8f134c3089b543 P 326059a64833452393d4072b47484170: Neither blocks nor log segments found. Creating new log.
I20260811 16:41:33.045218 27654 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 219aa59bdad140a5bc8f134c3089b543. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:41:33.045218 27787 log.cc:824] T 219aa59bdad140a5bc8f134c3089b543 P d1cd2c1471fa43d59530e88252f0fb2e: Log is configured to *not* fsync() on all Append() calls
I20260811 16:41:33.045517 27788 log.cc:824] T 219aa59bdad140a5bc8f134c3089b543 P 326059a64833452393d4072b47484170: Log is configured to *not* fsync() on all Append() calls
I20260811 16:41:33.045982 27787 tablet_bootstrap.cc:492] T 219aa59bdad140a5bc8f134c3089b543 P d1cd2c1471fa43d59530e88252f0fb2e: No bootstrap required, opened a new log
I20260811 16:41:33.046060 27787 ts_tablet_manager.cc:1397] T 219aa59bdad140a5bc8f134c3089b543 P d1cd2c1471fa43d59530e88252f0fb2e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 16:41:33.046267 27788 tablet_bootstrap.cc:492] T 219aa59bdad140a5bc8f134c3089b543 P 326059a64833452393d4072b47484170: No bootstrap required, opened a new log
I20260811 16:41:33.046329 27788 ts_tablet_manager.cc:1397] T 219aa59bdad140a5bc8f134c3089b543 P 326059a64833452393d4072b47484170: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 16:41:33.048030 27788 raft_consensus.cc:348] T 219aa59bdad140a5bc8f134c3089b543 P 326059a64833452393d4072b47484170 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "326059a64833452393d4072b47484170" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40155 } } peers { permanent_uuid: "d1cd2c1471fa43d59530e88252f0fb2e" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38071 } } peers { permanent_uuid: "045a3c29944c4080bbd1d36baafbba13" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 46023 } }
I20260811 16:41:33.048169 27788 raft_consensus.cc:374] T 219aa59bdad140a5bc8f134c3089b543 P 326059a64833452393d4072b47484170 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:41:33.048213 27788 raft_consensus.cc:729] T 219aa59bdad140a5bc8f134c3089b543 P 326059a64833452393d4072b47484170 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 326059a64833452393d4072b47484170, State: Initialized, Role: FOLLOWER
I20260811 16:41:33.048344 27788 consensus_queue.cc:260] T 219aa59bdad140a5bc8f134c3089b543 P 326059a64833452393d4072b47484170 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "326059a64833452393d4072b47484170" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40155 } } peers { permanent_uuid: "d1cd2c1471fa43d59530e88252f0fb2e" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38071 } } peers { permanent_uuid: "045a3c29944c4080bbd1d36baafbba13" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 46023 } }
I20260811 16:41:33.048609 27788 ts_tablet_manager.cc:1428] T 219aa59bdad140a5bc8f134c3089b543 P 326059a64833452393d4072b47484170: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 16:41:33.048527 27787 raft_consensus.cc:348] T 219aa59bdad140a5bc8f134c3089b543 P d1cd2c1471fa43d59530e88252f0fb2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "326059a64833452393d4072b47484170" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40155 } } peers { permanent_uuid: "d1cd2c1471fa43d59530e88252f0fb2e" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38071 } } peers { permanent_uuid: "045a3c29944c4080bbd1d36baafbba13" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 46023 } }
I20260811 16:41:33.048712 27787 raft_consensus.cc:374] T 219aa59bdad140a5bc8f134c3089b543 P d1cd2c1471fa43d59530e88252f0fb2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:41:33.048758 27787 raft_consensus.cc:729] T 219aa59bdad140a5bc8f134c3089b543 P d1cd2c1471fa43d59530e88252f0fb2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1cd2c1471fa43d59530e88252f0fb2e, State: Initialized, Role: FOLLOWER
I20260811 16:41:33.048862 27787 consensus_queue.cc:260] T 219aa59bdad140a5bc8f134c3089b543 P d1cd2c1471fa43d59530e88252f0fb2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "326059a64833452393d4072b47484170" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40155 } } peers { permanent_uuid: "d1cd2c1471fa43d59530e88252f0fb2e" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38071 } } peers { permanent_uuid: "045a3c29944c4080bbd1d36baafbba13" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 46023 } }
I20260811 16:41:33.048915 27325 heartbeater.cc:503] Master 127.24.175.254:38047 was elected leader, sending a full tablet report...
I20260811 16:41:33.049108 27787 ts_tablet_manager.cc:1428] T 219aa59bdad140a5bc8f134c3089b543 P d1cd2c1471fa43d59530e88252f0fb2e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 16:41:33.049158 27540 heartbeater.cc:503] Master 127.24.175.254:38047 was elected leader, sending a full tablet report...
I20260811 16:41:33.049307 27794 tablet_bootstrap.cc:492] T 219aa59bdad140a5bc8f134c3089b543 P 045a3c29944c4080bbd1d36baafbba13: Bootstrap starting.
I20260811 16:41:33.049947 27794 tablet_bootstrap.cc:654] T 219aa59bdad140a5bc8f134c3089b543 P 045a3c29944c4080bbd1d36baafbba13: Neither blocks nor log segments found. Creating new log.
I20260811 16:41:33.050277 27794 log.cc:824] T 219aa59bdad140a5bc8f134c3089b543 P 045a3c29944c4080bbd1d36baafbba13: Log is configured to *not* fsync() on all Append() calls
I20260811 16:41:33.050897 27794 tablet_bootstrap.cc:492] T 219aa59bdad140a5bc8f134c3089b543 P 045a3c29944c4080bbd1d36baafbba13: No bootstrap required, opened a new log
I20260811 16:41:33.050951 27794 ts_tablet_manager.cc:1397] T 219aa59bdad140a5bc8f134c3089b543 P 045a3c29944c4080bbd1d36baafbba13: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 16:41:33.052810 27794 raft_consensus.cc:348] T 219aa59bdad140a5bc8f134c3089b543 P 045a3c29944c4080bbd1d36baafbba13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "326059a64833452393d4072b47484170" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40155 } } peers { permanent_uuid: "d1cd2c1471fa43d59530e88252f0fb2e" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38071 } } peers { permanent_uuid: "045a3c29944c4080bbd1d36baafbba13" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 46023 } }
I20260811 16:41:33.052932 27794 raft_consensus.cc:374] T 219aa59bdad140a5bc8f134c3089b543 P 045a3c29944c4080bbd1d36baafbba13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:41:33.052951 27794 raft_consensus.cc:729] T 219aa59bdad140a5bc8f134c3089b543 P 045a3c29944c4080bbd1d36baafbba13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 045a3c29944c4080bbd1d36baafbba13, State: Initialized, Role: FOLLOWER
I20260811 16:41:33.053045 27794 consensus_queue.cc:260] T 219aa59bdad140a5bc8f134c3089b543 P 045a3c29944c4080bbd1d36baafbba13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "326059a64833452393d4072b47484170" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40155 } } peers { permanent_uuid: "d1cd2c1471fa43d59530e88252f0fb2e" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38071 } } peers { permanent_uuid: "045a3c29944c4080bbd1d36baafbba13" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 46023 } }
I20260811 16:41:33.053261 27794 ts_tablet_manager.cc:1428] T 219aa59bdad140a5bc8f134c3089b543 P 045a3c29944c4080bbd1d36baafbba13: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 16:41:33.053323 27755 heartbeater.cc:503] Master 127.24.175.254:38047 was elected leader, sending a full tablet report...
I20260811 16:41:33.105393 27798 raft_consensus.cc:482] T 219aa59bdad140a5bc8f134c3089b543 P d1cd2c1471fa43d59530e88252f0fb2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:41:33.105571 27798 raft_consensus.cc:504] T 219aa59bdad140a5bc8f134c3089b543 P d1cd2c1471fa43d59530e88252f0fb2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "326059a64833452393d4072b47484170" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40155 } } peers { permanent_uuid: "d1cd2c1471fa43d59530e88252f0fb2e" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38071 } } peers { permanent_uuid: "045a3c29944c4080bbd1d36baafbba13" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 46023 } }
I20260811 16:41:33.105916 27798 leader_election.cc:288] T 219aa59bdad140a5bc8f134c3089b543 P d1cd2c1471fa43d59530e88252f0fb2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 326059a64833452393d4072b47484170 (127.24.175.193:40155), 045a3c29944c4080bbd1d36baafbba13 (127.24.175.195:46023)
I20260811 16:41:33.108736 27803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:33.106095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.193:40155 (local address 127.24.175.194:43251)
0811 16:41:33.106315 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:33.106324 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:41:33.106371 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:41:33.106534 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:41:33.106535 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:41:33.106536 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:41:33.106607 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:33.106608 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:33.107214 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:33.107215 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:33.107971 (+ 756us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:33.107973 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:33.108473 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:33.108474 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:33.108548 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:33.108552 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:41:33.108606 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 16:41:33.108641 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":120,"threads_started":1}
I20260811 16:41:33.108793 27786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:33.106207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:43251 (local address 127.24.175.193:40155)
0811 16:41:33.106256 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:33.106258 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:33.106423 (+ 165us) server_negotiation.cc:407] Connection header received
0811 16:41:33.106457 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:33.106459 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:33.106471 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:33.106527 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:41:33.106675 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:33.107142 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:33.108047 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:33.108398 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:33.108451 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:33.108459 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:33.108689 (+ 230us) server_negotiation.cc:299] Negotiation successful
0811 16:41:33.108730 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 16:41:33.108830 27542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:33.106081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.195:46023 (local address 127.24.175.194:36361)
0811 16:41:33.106136 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:33.106165 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0811 16:41:33.106207 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:41:33.106387 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:41:33.106389 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:41:33.106392 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:41:33.106472 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:33.106474 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:33.107146 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:33.107147 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:33.107969 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:41:33.107971 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:41:33.108565 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:41:33.108567 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:41:33.108639 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:33.108642 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:41:33.108686 (+ 44us) client_negotiation.cc:240] Negotiation successful
0811 16:41:33.108726 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260811 16:41:33.109072 27784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:33.106180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.175.194:36361 (local address 127.24.175.195:46023)
0811 16:41:33.106236 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:33.106237 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:33.106246 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:41:33.106276 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:33.106277 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:33.106286 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:33.106345 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:41:33.106535 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:33.107059 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:33.108058 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:33.108424 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:33.108540 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:33.108549 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:33.108969 (+ 420us) server_negotiation.cc:299] Negotiation successful
0811 16:41:33.109013 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 16:41:33.109141 27251 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "219aa59bdad140a5bc8f134c3089b543" candidate_uuid: "d1cd2c1471fa43d59530e88252f0fb2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "326059a64833452393d4072b47484170" is_pre_election: true
I20260811 16:41:33.109297 27251 raft_consensus.cc:2454] T 219aa59bdad140a5bc8f134c3089b543 P 326059a64833452393d4072b47484170 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1cd2c1471fa43d59530e88252f0fb2e in term 0.
I20260811 16:41:33.109472 27685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "219aa59bdad140a5bc8f134c3089b543" candidate_uuid: "d1cd2c1471fa43d59530e88252f0fb2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "045a3c29944c4080bbd1d36baafbba13" is_pre_election: true
I20260811 16:41:33.109556 27356 leader_election.cc:302] T 219aa59bdad140a5bc8f134c3089b543 P d1cd2c1471fa43d59530e88252f0fb2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 326059a64833452393d4072b47484170, d1cd2c1471fa43d59530e88252f0fb2e; no voters:
I20260811 16:41:33.109625 27685 raft_consensus.cc:2454] T 219aa59bdad140a5bc8f134c3089b543 P 045a3c29944c4080bbd1d36baafbba13 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1cd2c1471fa43d59530e88252f0fb2e in term 0.
I20260811 16:41:33.109683 27798 raft_consensus.cc:2781] T 219aa59bdad140a5bc8f134c3089b543 P d1cd2c1471fa43d59530e88252f0fb2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:41:33.109766 27798 raft_consensus.cc:482] T 219aa59bdad140a5bc8f134c3089b543 P d1cd2c1471fa43d59530e88252f0fb2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:41:33.109800 27798 raft_consensus.cc:3037] T 219aa59bdad140a5bc8f134c3089b543 P d1cd2c1471fa43d59530e88252f0fb2e [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:41:33.110564 27798 raft_consensus.cc:504] T 219aa59bdad140a5bc8f134c3089b543 P d1cd2c1471fa43d59530e88252f0fb2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "326059a64833452393d4072b47484170" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40155 } } peers { permanent_uuid: "d1cd2c1471fa43d59530e88252f0fb2e" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38071 } } peers { permanent_uuid: "045a3c29944c4080bbd1d36baafbba13" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 46023 } }
I20260811 16:41:33.110677 27798 leader_election.cc:288] T 219aa59bdad140a5bc8f134c3089b543 P d1cd2c1471fa43d59530e88252f0fb2e [CANDIDATE]: Term 1 election: Requested vote from peers 326059a64833452393d4072b47484170 (127.24.175.193:40155), 045a3c29944c4080bbd1d36baafbba13 (127.24.175.195:46023)
I20260811 16:41:33.110867 27685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "219aa59bdad140a5bc8f134c3089b543" candidate_uuid: "d1cd2c1471fa43d59530e88252f0fb2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "045a3c29944c4080bbd1d36baafbba13"
I20260811 16:41:33.110859 27251 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "219aa59bdad140a5bc8f134c3089b543" candidate_uuid: "d1cd2c1471fa43d59530e88252f0fb2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "326059a64833452393d4072b47484170"
I20260811 16:41:33.110942 27685 raft_consensus.cc:3037] T 219aa59bdad140a5bc8f134c3089b543 P 045a3c29944c4080bbd1d36baafbba13 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:41:33.110960 27251 raft_consensus.cc:3037] T 219aa59bdad140a5bc8f134c3089b543 P 326059a64833452393d4072b47484170 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:41:33.111738 27685 raft_consensus.cc:2454] T 219aa59bdad140a5bc8f134c3089b543 P 045a3c29944c4080bbd1d36baafbba13 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1cd2c1471fa43d59530e88252f0fb2e in term 1.
I20260811 16:41:33.111900 27251 raft_consensus.cc:2454] T 219aa59bdad140a5bc8f134c3089b543 P 326059a64833452393d4072b47484170 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1cd2c1471fa43d59530e88252f0fb2e in term 1.
I20260811 16:41:33.111924 27360 leader_election.cc:302] T 219aa59bdad140a5bc8f134c3089b543 P d1cd2c1471fa43d59530e88252f0fb2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 045a3c29944c4080bbd1d36baafbba13, d1cd2c1471fa43d59530e88252f0fb2e; no voters:
I20260811 16:41:33.112052 27798 raft_consensus.cc:2781] T 219aa59bdad140a5bc8f134c3089b543 P d1cd2c1471fa43d59530e88252f0fb2e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:41:33.112201 27798 raft_consensus.cc:686] T 219aa59bdad140a5bc8f134c3089b543 P d1cd2c1471fa43d59530e88252f0fb2e [term 1 LEADER]: Becoming Leader. State: Replica: d1cd2c1471fa43d59530e88252f0fb2e, State: Running, Role: LEADER
I20260811 16:41:33.112282 27798 consensus_queue.cc:237] T 219aa59bdad140a5bc8f134c3089b543 P d1cd2c1471fa43d59530e88252f0fb2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "326059a64833452393d4072b47484170" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40155 } } peers { permanent_uuid: "d1cd2c1471fa43d59530e88252f0fb2e" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38071 } } peers { permanent_uuid: "045a3c29944c4080bbd1d36baafbba13" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 46023 } }
I20260811 16:41:33.113171 27002 catalog_manager.cc:5495] T 219aa59bdad140a5bc8f134c3089b543 P d1cd2c1471fa43d59530e88252f0fb2e reported cstate change: term changed from 0 to 1, leader changed from <none> to d1cd2c1471fa43d59530e88252f0fb2e (127.24.175.194). New cstate: current_term: 1 leader_uuid: "d1cd2c1471fa43d59530e88252f0fb2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "326059a64833452393d4072b47484170" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1cd2c1471fa43d59530e88252f0fb2e" member_type: VOTER last_known_addr { host: "127.24.175.194" port: 38071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "045a3c29944c4080bbd1d36baafbba13" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 46023 } health_report { overall_health: UNKNOWN } } }
I20260811 16:41:33.131032 27785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:33.129003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40232 (local address 127.24.175.194:38071)
0811 16:41:33.129044 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:33.129046 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:33.129065 (+ 19us) server_negotiation.cc:407] Connection header received
0811 16:41:33.129097 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:33.129098 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:33.129114 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:33.129164 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:41:33.129261 (+ 97us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:33.129700 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:33.130407 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:33.130587 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:33.130633 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:33.130764 (+ 131us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:41:33.130859 (+ 95us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:41:33.130915 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:33.130930 (+ 15us) server_negotiation.cc:299] Negotiation successful
0811 16:41:33.130944 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 16:41:33.132783 27251 raft_consensus.cc:1261] T 219aa59bdad140a5bc8f134c3089b543 P 326059a64833452393d4072b47484170 [term 1 FOLLOWER]: Refusing update from remote peer d1cd2c1471fa43d59530e88252f0fb2e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:41:33.132782 27685 raft_consensus.cc:1261] T 219aa59bdad140a5bc8f134c3089b543 P 045a3c29944c4080bbd1d36baafbba13 [term 1 FOLLOWER]: Refusing update from remote peer d1cd2c1471fa43d59530e88252f0fb2e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:41:33.133091 27798 consensus_queue.cc:1035] T 219aa59bdad140a5bc8f134c3089b543 P d1cd2c1471fa43d59530e88252f0fb2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "326059a64833452393d4072b47484170" member_type: VOTER last_known_addr { host: "127.24.175.193" port: 40155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:41:33.133214 27804 consensus_queue.cc:1035] T 219aa59bdad140a5bc8f134c3089b543 P d1cd2c1471fa43d59530e88252f0fb2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "045a3c29944c4080bbd1d36baafbba13" member_type: VOTER last_known_addr { host: "127.24.175.195" port: 46023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:41:33.135418 27812 mvcc.cc:205] Tried to move back new op lower bound from 7317366755869401088 to 7317366755788750848. Current Snapshot: MvccSnapshot[applied={T|T < 7317366755869401088}]
I20260811 16:41:33.135846 27818 mvcc.cc:205] Tried to move back new op lower bound from 7317366755869401088 to 7317366755788750848. Current Snapshot: MvccSnapshot[applied={T|T < 7317366755869401088 or (T in {7317366755869401088})}]
I20260811 16:41:33.136292 27816 mvcc.cc:205] Tried to move back new op lower bound from 7317366755869401088 to 7317366755788750848. Current Snapshot: MvccSnapshot[applied={T|T < 7317366755869401088}]
I20260811 16:41:33.138227 27002 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46568:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:41:33.138320 27002 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46568:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:41:33.138995 27002 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e734911205b645348db35815fbc4f3ef: Sending DeleteTablet for 3 replicas of tablet 219aa59bdad140a5bc8f134c3089b543
I20260811 16:41:33.139328 27441 tablet_service.cc:1514] Processing DeleteTablet for tablet 219aa59bdad140a5bc8f134c3089b543 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:41:33 UTC) from {username='slave'} at 127.0.0.1:40226
I20260811 16:41:33.139336 27654 tablet_service.cc:1514] Processing DeleteTablet for tablet 219aa59bdad140a5bc8f134c3089b543 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:41:33 UTC) from {username='slave'} at 127.0.0.1:39020
I20260811 16:41:33.139353 27210 tablet_service.cc:1514] Processing DeleteTablet for tablet 219aa59bdad140a5bc8f134c3089b543 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:41:33 UTC) from {username='slave'} at 127.0.0.1:51764
I20260811 16:41:33.139566 27832 tablet_replica.cc:330] T 219aa59bdad140a5bc8f134c3089b543 P 045a3c29944c4080bbd1d36baafbba13: stopping tablet replica
I20260811 16:41:33.139669 27832 raft_consensus.cc:2229] T 219aa59bdad140a5bc8f134c3089b543 P 045a3c29944c4080bbd1d36baafbba13 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:41:33.139755 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 27101
I20260811 16:41:33.139771 27832 raft_consensus.cc:2258] T 219aa59bdad140a5bc8f134c3089b543 P 045a3c29944c4080bbd1d36baafbba13 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:41:33.143389 27832 ts_tablet_manager.cc:1905] T 219aa59bdad140a5bc8f134c3089b543 P 045a3c29944c4080bbd1d36baafbba13: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:41:33.144800 27832 ts_tablet_manager.cc:1918] T 219aa59bdad140a5bc8f134c3089b543 P 045a3c29944c4080bbd1d36baafbba13: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:41:33.144867 27832 log.cc:1196] T 219aa59bdad140a5bc8f134c3089b543 P 045a3c29944c4080bbd1d36baafbba13: Deleting WAL directory at /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/ts-2/wal/wals/219aa59bdad140a5bc8f134c3089b543
I20260811 16:41:33.145087 27832 ts_tablet_manager.cc:1939] T 219aa59bdad140a5bc8f134c3089b543 P 045a3c29944c4080bbd1d36baafbba13: Deleting consensus metadata
I20260811 16:41:33.145467 26982 catalog_manager.cc:4841] TS 045a3c29944c4080bbd1d36baafbba13 (127.24.175.195:46023): tablet 219aa59bdad140a5bc8f134c3089b543 (table test-table [id=2f44c1d86b3a41fe922b1fd1d1c50f9b]) successfully deleted
I20260811 16:41:33.150337 27831 tablet_replica.cc:330] T 219aa59bdad140a5bc8f134c3089b543 P d1cd2c1471fa43d59530e88252f0fb2e: stopping tablet replica
I20260811 16:41:33.150646 27831 raft_consensus.cc:2229] T 219aa59bdad140a5bc8f134c3089b543 P d1cd2c1471fa43d59530e88252f0fb2e [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:41:33.150810 27831 raft_consensus.cc:2258] T 219aa59bdad140a5bc8f134c3089b543 P d1cd2c1471fa43d59530e88252f0fb2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:41:33.151297 27831 ts_tablet_manager.cc:1905] T 219aa59bdad140a5bc8f134c3089b543 P d1cd2c1471fa43d59530e88252f0fb2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:41:33.152879 27831 ts_tablet_manager.cc:1918] T 219aa59bdad140a5bc8f134c3089b543 P d1cd2c1471fa43d59530e88252f0fb2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:41:33.152956 27831 log.cc:1196] T 219aa59bdad140a5bc8f134c3089b543 P d1cd2c1471fa43d59530e88252f0fb2e: Deleting WAL directory at /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466249441839-25279-0/minicluster-data/ts-1/wal/wals/219aa59bdad140a5bc8f134c3089b543
I20260811 16:41:33.153211 27831 ts_tablet_manager.cc:1939] T 219aa59bdad140a5bc8f134c3089b543 P d1cd2c1471fa43d59530e88252f0fb2e: Deleting consensus metadata
I20260811 16:41:33.153692 26978 catalog_manager.cc:4841] TS d1cd2c1471fa43d59530e88252f0fb2e (127.24.175.194:38071): tablet 219aa59bdad140a5bc8f134c3089b543 (table test-table [id=2f44c1d86b3a41fe922b1fd1d1c50f9b]) successfully deleted
W20260811 16:41:33.155555 26979 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.24.175.193:40155 (error 108)
I20260811 16:41:33.155777 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 27328
I20260811 16:41:33.156044 27779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:33.155925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.193:40155 (local address 127.0.0.1:51778)
0811 16:41:33.155974 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 16:41:33.156011 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.193:40155: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260811 16:41:33.156142 26979 catalog_manager.cc:4584] TS 326059a64833452393d4072b47484170 (127.24.175.193:40155): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 219aa59bdad140a5bc8f134c3089b543: Network error: Client connection negotiation failed: client connection to 127.24.175.193:40155: connect: Connection refused (error 111)
I20260811 16:41:33.167889 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 27543
I20260811 16:41:33.193899 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 26948
2026-08-11T16:41:33Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (738 ms)
[----------] 6 tests from EncryptionPolicyTest (8861 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466249441839-25279-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:41:33 dist-test-slave-zj8q krb5kdc[27839](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:41:33 dist-test-slave-zj8q krb5kdc[27839](info): set up 2 sockets
Aug 11 16:41:33 dist-test-slave-zj8q krb5kdc[27839](info): commencing operation
krb5kdc: starting...
W20260811 16:41:34.347831 25279 mini_kdc.cc:121] Time spent starting KDC: real 1.133s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Aug 11 16:41:34 dist-test-slave-zj8q krb5kdc[27839](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466494, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:41:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:41:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466249441839-25279-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466249441839-25279-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 16:41:34.464078 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466249441839-25279-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466249441839-25279-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466249441839-25279-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41343
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466249441839-25279-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46783
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41343
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:41:34.545012 27867 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:41:34.545220 27867 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:41:34.545252 27867 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:41:34.546396 27867 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:41:34.546435 27867 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:41:34.546454 27867 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:41:34.546470 27867 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:41:34.546485 27867 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:41:34.547950 27867 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46783
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466249441839-25279-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466249441839-25279-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41343
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466249441839-25279-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41343
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27867
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466249441839-25279-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:41:34.548206 27867 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:41:34.548406 27867 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:41:34.553051 27875 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:41:34.553058 27879 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:34.553164 27867 server_base.cc:1034] running on GCE node
W20260811 16:41:34.553066 27877 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:34.553423 27867 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:41:34.553705 27867 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:41:34.554840 27867 hybrid_clock.cc:648] HybridClock initialized: now 1786466494554823 us; error 33 us; skew 500 ppm
Aug 11 16:41:34 dist-test-slave-zj8q krb5kdc[27839](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466494, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:41:34.557266 27867 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 16:41:34.557685 27867 webserver.cc:460] Webserver started at http://127.0.0.1:41419/ using document root <none> and password file <none>
I20260811 16:41:34.557885 27867 fs_manager.cc:359] Metadata directory not provided
I20260811 16:41:34.557933 27867 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:41:34.558059 27867 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:41:34.559115 27867 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466249441839-25279-0/minicluster-data/master-0/data/instance:
uuid: "80d1527ab9444e3a8c957a9dda8533b8"
format_stamp: "Formatted at 2026-08-11 16:41:34 on dist-test-slave-zj8q"
server_key: "9778da92b674f5561b641f803a54ade6"
server_key_iv: "988bf4de468123576d35b1a61c76d294"
server_key_version: "encryptionkey@0"
I20260811 16:41:34.559459 27867 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466249441839-25279-0/minicluster-data/master-0/wal/instance:
uuid: "80d1527ab9444e3a8c957a9dda8533b8"
format_stamp: "Formatted at 2026-08-11 16:41:34 on dist-test-slave-zj8q"
server_key: "9778da92b674f5561b641f803a54ade6"
server_key_iv: "988bf4de468123576d35b1a61c76d294"
server_key_version: "encryptionkey@0"
I20260811 16:41:34.560665 27867 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:41:34.561311 27888 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:34.561460 27867 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:41:34.561544 27867 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466249441839-25279-0/minicluster-data/master-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466249441839-25279-0/minicluster-data/master-0/wal
uuid: "80d1527ab9444e3a8c957a9dda8533b8"
format_stamp: "Formatted at 2026-08-11 16:41:34 on dist-test-slave-zj8q"
server_key: "9778da92b674f5561b641f803a54ade6"
server_key_iv: "988bf4de468123576d35b1a61c76d294"
server_key_version: "encryptionkey@0"
I20260811 16:41:34.561604 27867 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466249441839-25279-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466249441839-25279-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466249441839-25279-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:41:34.587059 27867 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:41:34.591758 27867 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:41:34.591921 27867 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:41:34.597229 27867 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41343
I20260811 16:41:34.597273 27983 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41343 every 8 connection(s)
I20260811 16:41:34.597720 27867 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
I20260811 16:41:34.598788 27984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:41:34.600950 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 27867
I20260811 16:41:34.601061 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466249441839-25279-0/minicluster-data/master-0/wal/instance
I20260811 16:41:34.601256 25279 external_mini_cluster.cc:1428] Setting key bd52f0b89c5edf7c314e35aa107e87cc
I20260811 16:41:34.601518 27984 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 80d1527ab9444e3a8c957a9dda8533b8: Bootstrap starting.
I20260811 16:41:34.602335 27984 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 80d1527ab9444e3a8c957a9dda8533b8: Neither blocks nor log segments found. Creating new log.
I20260811 16:41:34.602664 27984 log.cc:824] T 00000000000000000000000000000000 P 80d1527ab9444e3a8c957a9dda8533b8: Log is configured to *not* fsync() on all Append() calls
I20260811 16:41:34.603425 27984 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 80d1527ab9444e3a8c957a9dda8533b8: No bootstrap required, opened a new log
I20260811 16:41:34.606006 27984 raft_consensus.cc:348] T 00000000000000000000000000000000 P 80d1527ab9444e3a8c957a9dda8533b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80d1527ab9444e3a8c957a9dda8533b8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41343 } }
I20260811 16:41:34.606215 27984 raft_consensus.cc:374] T 00000000000000000000000000000000 P 80d1527ab9444e3a8c957a9dda8533b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:41:34.606261 27984 raft_consensus.cc:729] T 00000000000000000000000000000000 P 80d1527ab9444e3a8c957a9dda8533b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80d1527ab9444e3a8c957a9dda8533b8, State: Initialized, Role: FOLLOWER
I20260811 16:41:34.606418 27984 consensus_queue.cc:260] T 00000000000000000000000000000000 P 80d1527ab9444e3a8c957a9dda8533b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80d1527ab9444e3a8c957a9dda8533b8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41343 } }
I20260811 16:41:34.606508 27984 raft_consensus.cc:388] T 00000000000000000000000000000000 P 80d1527ab9444e3a8c957a9dda8533b8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:41:34.606547 27984 raft_consensus.cc:482] T 00000000000000000000000000000000 P 80d1527ab9444e3a8c957a9dda8533b8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:41:34.606590 27984 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 80d1527ab9444e3a8c957a9dda8533b8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:41:34.607334 27984 raft_consensus.cc:504] T 00000000000000000000000000000000 P 80d1527ab9444e3a8c957a9dda8533b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80d1527ab9444e3a8c957a9dda8533b8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41343 } }
I20260811 16:41:34.607456 27984 leader_election.cc:302] T 00000000000000000000000000000000 P 80d1527ab9444e3a8c957a9dda8533b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 80d1527ab9444e3a8c957a9dda8533b8; no voters:
I20260811 16:41:34.607626 27984 leader_election.cc:288] T 00000000000000000000000000000000 P 80d1527ab9444e3a8c957a9dda8533b8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:41:34.607723 27999 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 80d1527ab9444e3a8c957a9dda8533b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:41:34.607913 27999 raft_consensus.cc:686] T 00000000000000000000000000000000 P 80d1527ab9444e3a8c957a9dda8533b8 [term 1 LEADER]: Becoming Leader. State: Replica: 80d1527ab9444e3a8c957a9dda8533b8, State: Running, Role: LEADER
I20260811 16:41:34.607928 27984 sys_catalog.cc:564] T 00000000000000000000000000000000 P 80d1527ab9444e3a8c957a9dda8533b8 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:41:34.608105 27999 consensus_queue.cc:237] T 00000000000000000000000000000000 P 80d1527ab9444e3a8c957a9dda8533b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80d1527ab9444e3a8c957a9dda8533b8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41343 } }
Aug 11 16:41:34 dist-test-slave-zj8q krb5kdc[27839](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466494, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 16:41:34.608558 27999 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80d1527ab9444e3a8c957a9dda8533b8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 80d1527ab9444e3a8c957a9dda8533b8. Latest consensus state: current_term: 1 leader_uuid: "80d1527ab9444e3a8c957a9dda8533b8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80d1527ab9444e3a8c957a9dda8533b8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41343 } } }
I20260811 16:41:34.608712 27999 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80d1527ab9444e3a8c957a9dda8533b8 [sys.catalog]: This master's current role is: LEADER
I20260811 16:41:34.609192 28017 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:41:34.609580 28000 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80d1527ab9444e3a8c957a9dda8533b8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "80d1527ab9444e3a8c957a9dda8533b8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80d1527ab9444e3a8c957a9dda8533b8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41343 } } }
I20260811 16:41:34.609663 28000 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80d1527ab9444e3a8c957a9dda8533b8 [sys.catalog]: This master's current role is: LEADER
I20260811 16:41:34.609731 28017 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:41:34.615797 27992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:34.601798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38859 (local address 127.0.0.1:41343)
0811 16:41:34.601952 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:34.601962 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:34.601991 (+ 29us) server_negotiation.cc:407] Connection header received
0811 16:41:34.602599 (+ 608us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:34.602608 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:34.602663 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:34.602791 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:41:34.603568 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:34.604619 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:34.605383 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:34.605822 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:34.605919 (+ 97us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:34.608759 (+ 2840us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:41:34.608764 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:41:34.608764 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:41:34.608777 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:41:34.611928 (+ 3151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:41:34.614582 (+ 2654us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:41:34.614585 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:41:34.614586 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:41:34.614683 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:41:34.614894 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:41:34.614894 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:41:34.614895 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:41:34.615175 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:41:34.615365 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:34.615513 (+ 148us) server_negotiation.cc:299] Negotiation successful
0811 16:41:34.615594 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107,"thread_start_us":60,"threads_started":1}
I20260811 16:41:34.616830 25279 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:41:34.623296 28017 catalog_manager.cc:1347] Generated new cluster ID: a73cb872e79542a09c9e5af9edcd5a89
I20260811 16:41:34.623356 28017 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:41:34.624121 27992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:34.618121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40033 (local address 127.0.0.1:41343)
0811 16:41:34.618196 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:34.618198 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:34.618259 (+ 61us) server_negotiation.cc:407] Connection header received
0811 16:41:34.618326 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:34.618327 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:34.618335 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:34.618375 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:41:34.618904 (+ 529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:34.619390 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:34.620081 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:34.620307 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:34.620361 (+ 54us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:34.621464 (+ 1103us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:41:34.621466 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:41:34.621466 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:41:34.621473 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:41:34.622748 (+ 1275us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:41:34.623149 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:41:34.623150 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:41:34.623150 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:41:34.623208 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:41:34.623555 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:41:34.623556 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:41:34.623556 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:41:34.623689 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:41:34.623773 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:34.623979 (+ 206us) server_negotiation.cc:299] Negotiation successful
0811 16:41:34.624039 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 16:41:34.634641 28017 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:41:34.635289 28017 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:41:34.639541 28017 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 80d1527ab9444e3a8c957a9dda8533b8: Generated new TSK 0
I20260811 16:41:34.639706 28017 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:41:34.644340 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 27867
W20260811 16:41:34.659672 27837 connection.cc:535] client connection to 127.0.0.1:41343 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41343): Connection reset by peer (error 104)
2026-08-11T16:41:34Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1458 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466249441839-25279-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:41:34 dist-test-slave-zj8q krb5kdc[28047](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:41:34 dist-test-slave-zj8q krb5kdc[28047](info): set up 2 sockets
Aug 11 16:41:34 dist-test-slave-zj8q krb5kdc[28047](info): commencing operation
krb5kdc: starting...
W20260811 16:41:35.830489 25279 mini_kdc.cc:121] Time spent starting KDC: real 1.157s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Aug 11 16:41:35 dist-test-slave-zj8q krb5kdc[28047](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466495, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:41:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:41:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466249441839-25279-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466249441839-25279-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 16:41:35.950824 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466249441839-25279-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466249441839-25279-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466249441839-25279-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44717
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466249441839-25279-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34387
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44717
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:41:36.034500 28068 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:41:36.034714 28068 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:41:36.034746 28068 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:41:36.035895 28068 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:41:36.035938 28068 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:41:36.035957 28068 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:41:36.035972 28068 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:41:36.035987 28068 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:41:36.037519 28068 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34387
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466249441839-25279-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466249441839-25279-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44717
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466249441839-25279-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44717
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28068
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466249441839-25279-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:41:36.037771 28068 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:41:36.037987 28068 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:41:36.043393 28076 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:41:36.043371 28074 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:41:36.043378 28078 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:36.043581 28068 server_base.cc:1034] running on GCE node
I20260811 16:41:36.044006 28068 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:41:36.044373 28068 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:41:36.045558 28068 hybrid_clock.cc:648] HybridClock initialized: now 1786466496045532 us; error 41 us; skew 500 ppm
Aug 11 16:41:36 dist-test-slave-zj8q krb5kdc[28047](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466496, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:41:36.048041 28068 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 16:41:36.048462 28068 webserver.cc:460] Webserver started at http://127.0.0.1:33699/ using document root <none> and password file <none>
I20260811 16:41:36.048684 28068 fs_manager.cc:359] Metadata directory not provided
I20260811 16:41:36.048727 28068 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:41:36.048820 28068 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:41:36.049851 28068 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466249441839-25279-0/minicluster-data/master-0/data/instance:
uuid: "70fbe49e10434675a3106a15bc756370"
format_stamp: "Formatted at 2026-08-11 16:41:36 on dist-test-slave-zj8q"
server_key: "78afb9cb32950c66967cb0a6dba1f4d7"
server_key_iv: "acbbb9bae1ca626cfe68c750967abb1a"
server_key_version: "encryptionkey@0"
I20260811 16:41:36.050179 28068 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466249441839-25279-0/minicluster-data/master-0/wal/instance:
uuid: "70fbe49e10434675a3106a15bc756370"
format_stamp: "Formatted at 2026-08-11 16:41:36 on dist-test-slave-zj8q"
server_key: "78afb9cb32950c66967cb0a6dba1f4d7"
server_key_iv: "acbbb9bae1ca626cfe68c750967abb1a"
server_key_version: "encryptionkey@0"
I20260811 16:41:36.051419 28068 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:41:36.052084 28090 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:36.052237 28068 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:36.052326 28068 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466249441839-25279-0/minicluster-data/master-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466249441839-25279-0/minicluster-data/master-0/wal
uuid: "70fbe49e10434675a3106a15bc756370"
format_stamp: "Formatted at 2026-08-11 16:41:36 on dist-test-slave-zj8q"
server_key: "78afb9cb32950c66967cb0a6dba1f4d7"
server_key_iv: "acbbb9bae1ca626cfe68c750967abb1a"
server_key_version: "encryptionkey@0"
I20260811 16:41:36.052387 28068 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466249441839-25279-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466249441839-25279-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466249441839-25279-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:41:36.064400 28068 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:41:36.066629 28068 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:41:36.066780 28068 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:41:36.070679 28068 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44717
I20260811 16:41:36.070716 28190 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44717 every 8 connection(s)
I20260811 16:41:36.071051 28068 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
I20260811 16:41:36.071913 28191 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:41:36.074283 28191 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70fbe49e10434675a3106a15bc756370: Bootstrap starting.
I20260811 16:41:36.074865 28191 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 70fbe49e10434675a3106a15bc756370: Neither blocks nor log segments found. Creating new log.
I20260811 16:41:36.075136 28191 log.cc:824] T 00000000000000000000000000000000 P 70fbe49e10434675a3106a15bc756370: Log is configured to *not* fsync() on all Append() calls
I20260811 16:41:36.075809 28191 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70fbe49e10434675a3106a15bc756370: No bootstrap required, opened a new log
I20260811 16:41:36.076066 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 28068
I20260811 16:41:36.076185 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466249441839-25279-0/minicluster-data/master-0/wal/instance
I20260811 16:41:36.076367 25279 external_mini_cluster.cc:1428] Setting key 528593e118bf264cbc569a8cf18bdefd
I20260811 16:41:36.077821 28191 raft_consensus.cc:348] T 00000000000000000000000000000000 P 70fbe49e10434675a3106a15bc756370 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70fbe49e10434675a3106a15bc756370" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44717 } }
I20260811 16:41:36.077981 28191 raft_consensus.cc:374] T 00000000000000000000000000000000 P 70fbe49e10434675a3106a15bc756370 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:41:36.078019 28191 raft_consensus.cc:729] T 00000000000000000000000000000000 P 70fbe49e10434675a3106a15bc756370 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70fbe49e10434675a3106a15bc756370, State: Initialized, Role: FOLLOWER
I20260811 16:41:36.078176 28191 consensus_queue.cc:260] T 00000000000000000000000000000000 P 70fbe49e10434675a3106a15bc756370 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70fbe49e10434675a3106a15bc756370" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44717 } }
I20260811 16:41:36.078276 28191 raft_consensus.cc:388] T 00000000000000000000000000000000 P 70fbe49e10434675a3106a15bc756370 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:41:36.078317 28191 raft_consensus.cc:482] T 00000000000000000000000000000000 P 70fbe49e10434675a3106a15bc756370 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:41:36.078358 28191 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 70fbe49e10434675a3106a15bc756370 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:41:36.078915 28191 raft_consensus.cc:504] T 00000000000000000000000000000000 P 70fbe49e10434675a3106a15bc756370 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70fbe49e10434675a3106a15bc756370" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44717 } }
I20260811 16:41:36.079008 28191 leader_election.cc:302] T 00000000000000000000000000000000 P 70fbe49e10434675a3106a15bc756370 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 70fbe49e10434675a3106a15bc756370; no voters:
I20260811 16:41:36.079152 28191 leader_election.cc:288] T 00000000000000000000000000000000 P 70fbe49e10434675a3106a15bc756370 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:41:36.079219 28196 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 70fbe49e10434675a3106a15bc756370 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:41:36.079365 28196 raft_consensus.cc:686] T 00000000000000000000000000000000 P 70fbe49e10434675a3106a15bc756370 [term 1 LEADER]: Becoming Leader. State: Replica: 70fbe49e10434675a3106a15bc756370, State: Running, Role: LEADER
I20260811 16:41:36.079396 28191 sys_catalog.cc:564] T 00000000000000000000000000000000 P 70fbe49e10434675a3106a15bc756370 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:41:36.079453 28196 consensus_queue.cc:237] T 00000000000000000000000000000000 P 70fbe49e10434675a3106a15bc756370 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70fbe49e10434675a3106a15bc756370" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44717 } }
I20260811 16:41:36.079767 28198 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70fbe49e10434675a3106a15bc756370 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "70fbe49e10434675a3106a15bc756370" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70fbe49e10434675a3106a15bc756370" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44717 } } }
I20260811 16:41:36.079843 28198 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70fbe49e10434675a3106a15bc756370 [sys.catalog]: This master's current role is: LEADER
I20260811 16:41:36.080036 28200 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70fbe49e10434675a3106a15bc756370 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 70fbe49e10434675a3106a15bc756370. Latest consensus state: current_term: 1 leader_uuid: "70fbe49e10434675a3106a15bc756370" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70fbe49e10434675a3106a15bc756370" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44717 } } }
I20260811 16:41:36.080103 28200 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70fbe49e10434675a3106a15bc756370 [sys.catalog]: This master's current role is: LEADER
I20260811 16:41:36.080225 28205 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:41:36.080698 28205 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:41:36.083206 28195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:36.076881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39055 (local address 127.0.0.1:44717)
0811 16:41:36.077082 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:36.077090 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:36.077115 (+ 25us) server_negotiation.cc:407] Connection header received
0811 16:41:36.077785 (+ 670us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:36.077791 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:36.077835 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:36.077953 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:41:36.078326 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:36.079808 (+ 1482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:36.080941 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:36.081596 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:36.081706 (+ 110us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:36.082412 (+ 706us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:41:36.082417 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:41:36.082418 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:41:36.082629 (+ 211us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:41:36.082678 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:41:36.082693 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:41:36.082926 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:36.082969 (+ 43us) server_negotiation.cc:299] Negotiation successful
0811 16:41:36.083001 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":84,"threads_started":1}
I20260811 16:41:36.083626 28205 catalog_manager.cc:1347] Generated new cluster ID: b25db8861c954f8a84af4fffa0027cab
I20260811 16:41:36.083681 28205 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:41:36.084172 25279 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:41:36.089267 28195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:36.085546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39289 (local address 127.0.0.1:44717)
0811 16:41:36.085586 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:36.085587 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:36.085725 (+ 138us) server_negotiation.cc:407] Connection header received
0811 16:41:36.085815 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:36.085816 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:36.085827 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:36.085854 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:41:36.086038 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:36.086789 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:36.087827 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:36.088156 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:36.088195 (+ 39us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:36.088981 (+ 786us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:41:36.088982 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:41:36.088983 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:41:36.088987 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:41:36.089001 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:41:36.089005 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:41:36.089036 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:36.089166 (+ 130us) server_negotiation.cc:299] Negotiation successful
0811 16:41:36.089179 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 16:41:36.092087 28205 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:41:36.092542 28205 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:41:36.097966 28205 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 70fbe49e10434675a3106a15bc756370: Generated new TSK 0
I20260811 16:41:36.098214 28205 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:41:36.104425 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 28068
W20260811 16:41:36.122895 28044 connection.cc:535] client connection to 127.0.0.1:44717 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:44717): Connection reset by peer (error 104)
2026-08-11T16:41:36Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1463 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466249441839-25279-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:41:36 dist-test-slave-zj8q krb5kdc[28239](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:41:36 dist-test-slave-zj8q krb5kdc[28239](info): set up 2 sockets
Aug 11 16:41:36 dist-test-slave-zj8q krb5kdc[28239](info): commencing operation
krb5kdc: starting...
W20260811 16:41:37.285187 25279 mini_kdc.cc:121] Time spent starting KDC: real 1.149s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Aug 11 16:41:37 dist-test-slave-zj8q krb5kdc[28239](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466497, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:41:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:41:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466249441839-25279-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466249441839-25279-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 16:41:37.403638 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466249441839-25279-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466249441839-25279-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466249441839-25279-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44189
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466249441839-25279-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44189
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:41:37.488117 28262 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:41:37.488317 28262 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:41:37.488350 28262 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:41:37.489463 28262 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:41:37.489503 28262 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:41:37.489522 28262 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:41:37.489538 28262 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:41:37.489569 28262 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:41:37.491081 28262 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466249441839-25279-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466249441839-25279-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44189
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466249441839-25279-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44189
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28262
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466249441839-25279-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:41:37.491323 28262 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:41:37.491523 28262 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:41:37.496220 28271 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:41:37.496248 28277 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:41:37.496250 28273 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:37.496433 28262 server_base.cc:1034] running on GCE node
I20260811 16:41:37.496737 28262 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:41:37.497016 28262 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:41:37.498190 28262 hybrid_clock.cc:648] HybridClock initialized: now 1786466497498173 us; error 28 us; skew 500 ppm
Aug 11 16:41:37 dist-test-slave-zj8q krb5kdc[28239](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466497, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:41:37.500665 28262 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 16:41:37.501097 28262 webserver.cc:460] Webserver started at http://127.0.0.1:37901/ using document root <none> and password file <none>
I20260811 16:41:37.501320 28262 fs_manager.cc:359] Metadata directory not provided
I20260811 16:41:37.501364 28262 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:41:37.501492 28262 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:41:37.502588 28262 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466249441839-25279-0/minicluster-data/master-0/data/instance:
uuid: "72fc58039c4e4b8a8a71955e904ca042"
format_stamp: "Formatted at 2026-08-11 16:41:37 on dist-test-slave-zj8q"
server_key: "08b79312512932ca337ad73ee5f61aaa"
server_key_iv: "6668e459e18e5be59a97ee816f8dd841"
server_key_version: "encryptionkey@0"
I20260811 16:41:37.502924 28262 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466249441839-25279-0/minicluster-data/master-0/wal/instance:
uuid: "72fc58039c4e4b8a8a71955e904ca042"
format_stamp: "Formatted at 2026-08-11 16:41:37 on dist-test-slave-zj8q"
server_key: "08b79312512932ca337ad73ee5f61aaa"
server_key_iv: "6668e459e18e5be59a97ee816f8dd841"
server_key_version: "encryptionkey@0"
I20260811 16:41:37.504117 28262 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:41:37.504799 28293 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:37.504956 28262 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:41:37.505028 28262 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466249441839-25279-0/minicluster-data/master-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466249441839-25279-0/minicluster-data/master-0/wal
uuid: "72fc58039c4e4b8a8a71955e904ca042"
format_stamp: "Formatted at 2026-08-11 16:41:37 on dist-test-slave-zj8q"
server_key: "08b79312512932ca337ad73ee5f61aaa"
server_key_iv: "6668e459e18e5be59a97ee816f8dd841"
server_key_version: "encryptionkey@0"
I20260811 16:41:37.505092 28262 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466249441839-25279-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466249441839-25279-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466249441839-25279-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:41:37.508322 28262 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:41:37.510360 28262 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:41:37.510480 28262 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:41:37.514233 28262 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44189
I20260811 16:41:37.514261 28384 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44189 every 8 connection(s)
I20260811 16:41:37.514545 28262 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
I20260811 16:41:37.515499 28387 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:41:37.517632 28387 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72fc58039c4e4b8a8a71955e904ca042: Bootstrap starting.
I20260811 16:41:37.518144 28387 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 72fc58039c4e4b8a8a71955e904ca042: Neither blocks nor log segments found. Creating new log.
I20260811 16:41:37.518426 28387 log.cc:824] T 00000000000000000000000000000000 P 72fc58039c4e4b8a8a71955e904ca042: Log is configured to *not* fsync() on all Append() calls
I20260811 16:41:37.518676 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 28262
I20260811 16:41:37.518782 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466249441839-25279-0/minicluster-data/master-0/wal/instance
I20260811 16:41:37.518957 25279 external_mini_cluster.cc:1428] Setting key 229db9387b0318e01950fd14cfdc3080
I20260811 16:41:37.519155 28387 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72fc58039c4e4b8a8a71955e904ca042: No bootstrap required, opened a new log
I20260811 16:41:37.521137 28387 raft_consensus.cc:348] T 00000000000000000000000000000000 P 72fc58039c4e4b8a8a71955e904ca042 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72fc58039c4e4b8a8a71955e904ca042" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44189 } }
I20260811 16:41:37.521289 28387 raft_consensus.cc:374] T 00000000000000000000000000000000 P 72fc58039c4e4b8a8a71955e904ca042 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:41:37.521360 28387 raft_consensus.cc:729] T 00000000000000000000000000000000 P 72fc58039c4e4b8a8a71955e904ca042 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72fc58039c4e4b8a8a71955e904ca042, State: Initialized, Role: FOLLOWER
I20260811 16:41:37.521494 28387 consensus_queue.cc:260] T 00000000000000000000000000000000 P 72fc58039c4e4b8a8a71955e904ca042 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72fc58039c4e4b8a8a71955e904ca042" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44189 } }
I20260811 16:41:37.521576 28387 raft_consensus.cc:388] T 00000000000000000000000000000000 P 72fc58039c4e4b8a8a71955e904ca042 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:41:37.521607 28387 raft_consensus.cc:482] T 00000000000000000000000000000000 P 72fc58039c4e4b8a8a71955e904ca042 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:41:37.521654 28387 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 72fc58039c4e4b8a8a71955e904ca042 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:41:37.521725 28399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:37.519425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52741 (local address 127.0.0.1:44189)
0811 16:41:37.519600 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:37.519609 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:37.519638 (+ 29us) server_negotiation.cc:407] Connection header received
0811 16:41:37.520324 (+ 686us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:37.520331 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:37.520356 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:37.520475 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:41:37.521105 (+ 630us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:41:37.521109 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:41:37.521109 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:41:37.521114 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:41:37.521158 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:41:37.521171 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:41:37.521223 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:37.521350 (+ 127us) server_negotiation.cc:299] Negotiation successful
0811 16:41:37.521393 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":77,"threads_started":1}
I20260811 16:41:37.522392 28387 raft_consensus.cc:504] T 00000000000000000000000000000000 P 72fc58039c4e4b8a8a71955e904ca042 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72fc58039c4e4b8a8a71955e904ca042" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44189 } }
I20260811 16:41:37.522495 28387 leader_election.cc:302] T 00000000000000000000000000000000 P 72fc58039c4e4b8a8a71955e904ca042 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 72fc58039c4e4b8a8a71955e904ca042; no voters:
I20260811 16:41:37.522630 25279 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:41:37.522644 28387 leader_election.cc:288] T 00000000000000000000000000000000 P 72fc58039c4e4b8a8a71955e904ca042 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:41:37.522693 28400 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 72fc58039c4e4b8a8a71955e904ca042 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:41:37.522842 28400 raft_consensus.cc:686] T 00000000000000000000000000000000 P 72fc58039c4e4b8a8a71955e904ca042 [term 1 LEADER]: Becoming Leader. State: Replica: 72fc58039c4e4b8a8a71955e904ca042, State: Running, Role: LEADER
I20260811 16:41:37.522878 28387 sys_catalog.cc:564] T 00000000000000000000000000000000 P 72fc58039c4e4b8a8a71955e904ca042 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:41:37.522969 28400 consensus_queue.cc:237] T 00000000000000000000000000000000 P 72fc58039c4e4b8a8a71955e904ca042 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72fc58039c4e4b8a8a71955e904ca042" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44189 } }
I20260811 16:41:37.523387 28402 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72fc58039c4e4b8a8a71955e904ca042 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "72fc58039c4e4b8a8a71955e904ca042" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72fc58039c4e4b8a8a71955e904ca042" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44189 } } }
I20260811 16:41:37.523614 28402 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72fc58039c4e4b8a8a71955e904ca042 [sys.catalog]: This master's current role is: LEADER
I20260811 16:41:37.523535 28401 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72fc58039c4e4b8a8a71955e904ca042 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 72fc58039c4e4b8a8a71955e904ca042. Latest consensus state: current_term: 1 leader_uuid: "72fc58039c4e4b8a8a71955e904ca042" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72fc58039c4e4b8a8a71955e904ca042" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44189 } } }
I20260811 16:41:37.523867 28401 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72fc58039c4e4b8a8a71955e904ca042 [sys.catalog]: This master's current role is: LEADER
I20260811 16:41:37.524353 28414 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:41:37.524921 28414 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:41:37.525285 28399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:37.524198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34543 (local address 127.0.0.1:44189)
0811 16:41:37.524235 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:37.524238 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:37.524336 (+ 98us) server_negotiation.cc:407] Connection header received
0811 16:41:37.524430 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:37.524431 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:37.524436 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:37.524464 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:41:37.525022 (+ 558us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:41:37.525024 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:41:37.525024 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:41:37.525028 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:41:37.525040 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:41:37.525044 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:41:37.525071 (+ 27us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:37.525213 (+ 142us) server_negotiation.cc:299] Negotiation successful
0811 16:41:37.525226 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 16:41:37.526464 28414 catalog_manager.cc:1347] Generated new cluster ID: f4ac00c8df3948fab021bf69b735e854
I20260811 16:41:37.526515 28414 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:41:37.538110 28414 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:41:37.538278 28414 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:41:37.544719 28414 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 72fc58039c4e4b8a8a71955e904ca042: Generated new TSK 0
I20260811 16:41:37.544903 28414 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:41:37.550268 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 28262
2026-08-11T16:41:37Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1455 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466249441839-25279-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:41:37 dist-test-slave-zj8q krb5kdc[28438](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:41:37 dist-test-slave-zj8q krb5kdc[28438](info): set up 2 sockets
Aug 11 16:41:37 dist-test-slave-zj8q krb5kdc[28438](info): commencing operation
krb5kdc: starting...
W20260811 16:41:38.725489 25279 mini_kdc.cc:121] Time spent starting KDC: real 1.133s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Aug 11 16:41:38 dist-test-slave-zj8q krb5kdc[28438](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466498, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:41:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:41:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466249441839-25279-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466249441839-25279-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 16:41:38.843048 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466249441839-25279-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466249441839-25279-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466249441839-25279-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46857
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466249441839-25279-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46413
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46857
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:41:38.924813 28458 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:41:38.925010 28458 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:41:38.925040 28458 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:41:38.926192 28458 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:41:38.926232 28458 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:41:38.926245 28458 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:41:38.926259 28458 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:41:38.926282 28458 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:41:38.927758 28458 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46413
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466249441839-25279-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466249441839-25279-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46857
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466249441839-25279-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46857
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28458
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466249441839-25279-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:41:38.927985 28458 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:41:38.928202 28458 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:41:38.933279 28471 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:41:38.933283 28472 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:41:38.933265 28479 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:38.933455 28458 server_base.cc:1034] running on GCE node
I20260811 16:41:38.933769 28458 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:41:38.934067 28458 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:41:38.935209 28458 hybrid_clock.cc:648] HybridClock initialized: now 1786466498935190 us; error 31 us; skew 500 ppm
Aug 11 16:41:38 dist-test-slave-zj8q krb5kdc[28438](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466498, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:41:38.937541 28458 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 16:41:38.937971 28458 webserver.cc:460] Webserver started at http://127.0.0.1:40049/ using document root <none> and password file <none>
I20260811 16:41:38.938239 28458 fs_manager.cc:359] Metadata directory not provided
I20260811 16:41:38.938293 28458 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:41:38.938423 28458 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:41:38.939466 28458 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466249441839-25279-0/minicluster-data/master-0/data/instance:
uuid: "f0fdaf76f2624aa7bc4405a6fc2859c4"
format_stamp: "Formatted at 2026-08-11 16:41:38 on dist-test-slave-zj8q"
server_key: "f4ad71737ade0cd3196a72fdb5d342ec"
server_key_iv: "37a88e43474d8f3e8cc2605a1128231f"
server_key_version: "encryptionkey@0"
I20260811 16:41:38.939800 28458 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466249441839-25279-0/minicluster-data/master-0/wal/instance:
uuid: "f0fdaf76f2624aa7bc4405a6fc2859c4"
format_stamp: "Formatted at 2026-08-11 16:41:38 on dist-test-slave-zj8q"
server_key: "f4ad71737ade0cd3196a72fdb5d342ec"
server_key_iv: "37a88e43474d8f3e8cc2605a1128231f"
server_key_version: "encryptionkey@0"
I20260811 16:41:38.941028 28458 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:41:38.941704 28487 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:38.941859 28458 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:41:38.941947 28458 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466249441839-25279-0/minicluster-data/master-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466249441839-25279-0/minicluster-data/master-0/wal
uuid: "f0fdaf76f2624aa7bc4405a6fc2859c4"
format_stamp: "Formatted at 2026-08-11 16:41:38 on dist-test-slave-zj8q"
server_key: "f4ad71737ade0cd3196a72fdb5d342ec"
server_key_iv: "37a88e43474d8f3e8cc2605a1128231f"
server_key_version: "encryptionkey@0"
I20260811 16:41:38.942014 28458 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466249441839-25279-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466249441839-25279-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466249441839-25279-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:41:38.959930 28458 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:41:38.961856 28458 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:41:38.961998 28458 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:41:38.966176 28458 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46857
I20260811 16:41:38.966264 28580 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46857 every 8 connection(s)
I20260811 16:41:38.966611 28458 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
I20260811 16:41:38.967519 28584 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:41:38.967852 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 28458
I20260811 16:41:38.967980 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466249441839-25279-0/minicluster-data/master-0/wal/instance
I20260811 16:41:38.968173 25279 external_mini_cluster.cc:1428] Setting key de875b5950f426f9334058d79ff968c6
I20260811 16:41:38.970315 28584 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0fdaf76f2624aa7bc4405a6fc2859c4: Bootstrap starting.
I20260811 16:41:38.970966 28584 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f0fdaf76f2624aa7bc4405a6fc2859c4: Neither blocks nor log segments found. Creating new log.
I20260811 16:41:38.971236 28584 log.cc:824] T 00000000000000000000000000000000 P f0fdaf76f2624aa7bc4405a6fc2859c4: Log is configured to *not* fsync() on all Append() calls
I20260811 16:41:38.971961 28584 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0fdaf76f2624aa7bc4405a6fc2859c4: No bootstrap required, opened a new log
I20260811 16:41:38.974002 28584 raft_consensus.cc:348] T 00000000000000000000000000000000 P f0fdaf76f2624aa7bc4405a6fc2859c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0fdaf76f2624aa7bc4405a6fc2859c4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46857 } }
I20260811 16:41:38.974206 28584 raft_consensus.cc:374] T 00000000000000000000000000000000 P f0fdaf76f2624aa7bc4405a6fc2859c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:41:38.974251 28584 raft_consensus.cc:729] T 00000000000000000000000000000000 P f0fdaf76f2624aa7bc4405a6fc2859c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0fdaf76f2624aa7bc4405a6fc2859c4, State: Initialized, Role: FOLLOWER
I20260811 16:41:38.974383 28584 consensus_queue.cc:260] T 00000000000000000000000000000000 P f0fdaf76f2624aa7bc4405a6fc2859c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0fdaf76f2624aa7bc4405a6fc2859c4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46857 } }
I20260811 16:41:38.974466 28584 raft_consensus.cc:388] T 00000000000000000000000000000000 P f0fdaf76f2624aa7bc4405a6fc2859c4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:41:38.974504 28584 raft_consensus.cc:482] T 00000000000000000000000000000000 P f0fdaf76f2624aa7bc4405a6fc2859c4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:41:38.974561 28584 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f0fdaf76f2624aa7bc4405a6fc2859c4 [term 0 FOLLOWER]: Advancing to term 1
Aug 11 16:41:38 dist-test-slave-zj8q krb5kdc[28438](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466498, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 16:41:38.975075 28584 raft_consensus.cc:504] T 00000000000000000000000000000000 P f0fdaf76f2624aa7bc4405a6fc2859c4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0fdaf76f2624aa7bc4405a6fc2859c4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46857 } }
I20260811 16:41:38.975167 28584 leader_election.cc:302] T 00000000000000000000000000000000 P f0fdaf76f2624aa7bc4405a6fc2859c4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f0fdaf76f2624aa7bc4405a6fc2859c4; no voters:
I20260811 16:41:38.975311 28584 leader_election.cc:288] T 00000000000000000000000000000000 P f0fdaf76f2624aa7bc4405a6fc2859c4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:41:38.975351 28591 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f0fdaf76f2624aa7bc4405a6fc2859c4 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:41:38.975551 28591 raft_consensus.cc:686] T 00000000000000000000000000000000 P f0fdaf76f2624aa7bc4405a6fc2859c4 [term 1 LEADER]: Becoming Leader. State: Replica: f0fdaf76f2624aa7bc4405a6fc2859c4, State: Running, Role: LEADER
I20260811 16:41:38.975584 28584 sys_catalog.cc:564] T 00000000000000000000000000000000 P f0fdaf76f2624aa7bc4405a6fc2859c4 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:41:38.975710 28591 consensus_queue.cc:237] T 00000000000000000000000000000000 P f0fdaf76f2624aa7bc4405a6fc2859c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0fdaf76f2624aa7bc4405a6fc2859c4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46857 } }
I20260811 16:41:38.976032 28591 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0fdaf76f2624aa7bc4405a6fc2859c4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f0fdaf76f2624aa7bc4405a6fc2859c4. Latest consensus state: current_term: 1 leader_uuid: "f0fdaf76f2624aa7bc4405a6fc2859c4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0fdaf76f2624aa7bc4405a6fc2859c4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46857 } } }
I20260811 16:41:38.976123 28594 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0fdaf76f2624aa7bc4405a6fc2859c4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f0fdaf76f2624aa7bc4405a6fc2859c4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0fdaf76f2624aa7bc4405a6fc2859c4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46857 } } }
I20260811 16:41:38.976166 28591 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0fdaf76f2624aa7bc4405a6fc2859c4 [sys.catalog]: This master's current role is: LEADER
I20260811 16:41:38.976249 28594 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0fdaf76f2624aa7bc4405a6fc2859c4 [sys.catalog]: This master's current role is: LEADER
W20260811 16:41:38.977617 28616 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f0fdaf76f2624aa7bc4405a6fc2859c4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 16:41:38.977698 28616 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 16:41:38.978178 28599 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:41:38.978451 28599 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:41:38.978657 28588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:38.968713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51607 (local address 127.0.0.1:46857)
0811 16:41:38.968905 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:38.968915 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:38.968941 (+ 26us) server_negotiation.cc:407] Connection header received
0811 16:41:38.969362 (+ 421us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:38.969372 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:38.969425 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:38.969558 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:41:38.970222 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:38.971200 (+ 978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:38.972067 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:38.972497 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:38.972594 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:38.975005 (+ 2411us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:41:38.975009 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:41:38.975009 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:41:38.975022 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:41:38.976873 (+ 1851us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:41:38.977275 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:41:38.977278 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:41:38.977278 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:41:38.977388 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:41:38.977631 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:41:38.977632 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:41:38.977632 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:41:38.977970 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:41:38.978121 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:38.978311 (+ 190us) server_negotiation.cc:299] Negotiation successful
0811 16:41:38.978452 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":81,"threads_started":1}
I20260811 16:41:38.979527 25279 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:41:38.981199 28599 catalog_manager.cc:1347] Generated new cluster ID: 1df03a7769ce41eea0452d2891d88f52
I20260811 16:41:38.981256 28599 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:41:38.987201 28599 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:41:38.987906 28599 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:41:38.988234 28588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:38.980796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43389 (local address 127.0.0.1:46857)
0811 16:41:38.980834 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:38.980836 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:38.981326 (+ 490us) server_negotiation.cc:407] Connection header received
0811 16:41:38.981420 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:38.981422 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:38.981433 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:38.981482 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:41:38.982109 (+ 627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:38.982852 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:38.983845 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:38.984168 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:38.984224 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:38.985599 (+ 1375us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:41:38.985600 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:41:38.985601 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:41:38.985607 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:41:38.987160 (+ 1553us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:41:38.987490 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:41:38.987491 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:41:38.987492 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:41:38.987549 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:41:38.987725 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:41:38.987726 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:41:38.987726 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:41:38.987832 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:41:38.987915 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:38.988063 (+ 148us) server_negotiation.cc:299] Negotiation successful
0811 16:41:38.988150 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 16:41:38.991472 28599 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f0fdaf76f2624aa7bc4405a6fc2859c4: Generated new TSK 0
I20260811 16:41:38.991649 28599 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:41:38.995777 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 28458
2026-08-11T16:41:39Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1433 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466249441839-25279-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:41:39 dist-test-slave-zj8q krb5kdc[28641](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:41:39 dist-test-slave-zj8q krb5kdc[28641](info): set up 2 sockets
Aug 11 16:41:39 dist-test-slave-zj8q krb5kdc[28641](info): commencing operation
krb5kdc: starting...
W20260811 16:41:40.175982 25279 mini_kdc.cc:121] Time spent starting KDC: real 1.150s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Aug 11 16:41:40 dist-test-slave-zj8q krb5kdc[28641](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466500, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:41:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:41:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466249441839-25279-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466249441839-25279-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 16:41:40.290174 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466249441839-25279-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466249441839-25279-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466249441839-25279-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44459
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466249441839-25279-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36747
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44459
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:41:40.372458 28660 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:41:40.372684 28660 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:41:40.372718 28660 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:41:40.373867 28660 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:41:40.373911 28660 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:41:40.373929 28660 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:41:40.373945 28660 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:41:40.373960 28660 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:41:40.375515 28660 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36747
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466249441839-25279-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466249441839-25279-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44459
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466249441839-25279-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44459
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28660
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466249441839-25279-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:41:40.375777 28660 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:41:40.375983 28660 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:41:40.380777 28666 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:41:40.380797 28670 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:40.380827 28660 server_base.cc:1034] running on GCE node
W20260811 16:41:40.380790 28665 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:40.381243 28660 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:41:40.381537 28660 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:41:40.382691 28660 hybrid_clock.cc:648] HybridClock initialized: now 1786466500382673 us; error 29 us; skew 500 ppm
Aug 11 16:41:40 dist-test-slave-zj8q krb5kdc[28641](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466500, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:41:40.388988 28660 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 16:41:40.389460 28660 webserver.cc:460] Webserver started at http://127.0.0.1:36411/ using document root <none> and password file <none>
I20260811 16:41:40.389683 28660 fs_manager.cc:359] Metadata directory not provided
I20260811 16:41:40.389734 28660 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:41:40.389863 28660 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:41:40.390992 28660 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466249441839-25279-0/minicluster-data/master-0/data/instance:
uuid: "c32e55d7712e4a709feb6d8b4f0d3da9"
format_stamp: "Formatted at 2026-08-11 16:41:40 on dist-test-slave-zj8q"
server_key: "997f6e67c40181cda11581d649aee294"
server_key_iv: "3d71b275e18e1b030a8cef9ef2f48d48"
server_key_version: "encryptionkey@0"
I20260811 16:41:40.391355 28660 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466249441839-25279-0/minicluster-data/master-0/wal/instance:
uuid: "c32e55d7712e4a709feb6d8b4f0d3da9"
format_stamp: "Formatted at 2026-08-11 16:41:40 on dist-test-slave-zj8q"
server_key: "997f6e67c40181cda11581d649aee294"
server_key_iv: "3d71b275e18e1b030a8cef9ef2f48d48"
server_key_version: "encryptionkey@0"
I20260811 16:41:40.392627 28660 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:41:40.393301 28685 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:40.393460 28660 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:41:40.393563 28660 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466249441839-25279-0/minicluster-data/master-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466249441839-25279-0/minicluster-data/master-0/wal
uuid: "c32e55d7712e4a709feb6d8b4f0d3da9"
format_stamp: "Formatted at 2026-08-11 16:41:40 on dist-test-slave-zj8q"
server_key: "997f6e67c40181cda11581d649aee294"
server_key_iv: "3d71b275e18e1b030a8cef9ef2f48d48"
server_key_version: "encryptionkey@0"
I20260811 16:41:40.393627 28660 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466249441839-25279-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466249441839-25279-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466249441839-25279-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:41:40.405812 28660 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:41:40.407575 28660 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:41:40.407711 28660 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:41:40.411594 28660 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44459
I20260811 16:41:40.411633 28769 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44459 every 8 connection(s)
I20260811 16:41:40.411947 28660 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
I20260811 16:41:40.412875 28770 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:41:40.415158 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 28660
I20260811 16:41:40.415280 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466249441839-25279-0/minicluster-data/master-0/wal/instance
I20260811 16:41:40.415273 28770 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c32e55d7712e4a709feb6d8b4f0d3da9: Bootstrap starting.
I20260811 16:41:40.415468 25279 external_mini_cluster.cc:1428] Setting key b355444dee2babe78b3fabfc6384c8be
I20260811 16:41:40.415948 28770 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c32e55d7712e4a709feb6d8b4f0d3da9: Neither blocks nor log segments found. Creating new log.
I20260811 16:41:40.416255 28770 log.cc:824] T 00000000000000000000000000000000 P c32e55d7712e4a709feb6d8b4f0d3da9: Log is configured to *not* fsync() on all Append() calls
I20260811 16:41:40.417021 28770 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c32e55d7712e4a709feb6d8b4f0d3da9: No bootstrap required, opened a new log
I20260811 16:41:40.419175 28770 raft_consensus.cc:348] T 00000000000000000000000000000000 P c32e55d7712e4a709feb6d8b4f0d3da9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c32e55d7712e4a709feb6d8b4f0d3da9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44459 } }
I20260811 16:41:40.419312 28770 raft_consensus.cc:374] T 00000000000000000000000000000000 P c32e55d7712e4a709feb6d8b4f0d3da9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:41:40.419334 28770 raft_consensus.cc:729] T 00000000000000000000000000000000 P c32e55d7712e4a709feb6d8b4f0d3da9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c32e55d7712e4a709feb6d8b4f0d3da9, State: Initialized, Role: FOLLOWER
I20260811 16:41:40.419443 28770 consensus_queue.cc:260] T 00000000000000000000000000000000 P c32e55d7712e4a709feb6d8b4f0d3da9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c32e55d7712e4a709feb6d8b4f0d3da9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44459 } }
I20260811 16:41:40.419502 28770 raft_consensus.cc:388] T 00000000000000000000000000000000 P c32e55d7712e4a709feb6d8b4f0d3da9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:41:40.419540 28770 raft_consensus.cc:482] T 00000000000000000000000000000000 P c32e55d7712e4a709feb6d8b4f0d3da9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:41:40.419589 28770 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c32e55d7712e4a709feb6d8b4f0d3da9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:41:40.420233 28770 raft_consensus.cc:504] T 00000000000000000000000000000000 P c32e55d7712e4a709feb6d8b4f0d3da9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c32e55d7712e4a709feb6d8b4f0d3da9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44459 } }
I20260811 16:41:40.420354 28770 leader_election.cc:302] T 00000000000000000000000000000000 P c32e55d7712e4a709feb6d8b4f0d3da9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c32e55d7712e4a709feb6d8b4f0d3da9; no voters:
I20260811 16:41:40.420538 28770 leader_election.cc:288] T 00000000000000000000000000000000 P c32e55d7712e4a709feb6d8b4f0d3da9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:41:40.420549 28778 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c32e55d7712e4a709feb6d8b4f0d3da9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:41:40.420680 28778 raft_consensus.cc:686] T 00000000000000000000000000000000 P c32e55d7712e4a709feb6d8b4f0d3da9 [term 1 LEADER]: Becoming Leader. State: Replica: c32e55d7712e4a709feb6d8b4f0d3da9, State: Running, Role: LEADER
I20260811 16:41:40.420832 28770 sys_catalog.cc:564] T 00000000000000000000000000000000 P c32e55d7712e4a709feb6d8b4f0d3da9 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:41:40.420821 28778 consensus_queue.cc:237] T 00000000000000000000000000000000 P c32e55d7712e4a709feb6d8b4f0d3da9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c32e55d7712e4a709feb6d8b4f0d3da9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44459 } }
I20260811 16:41:40.421212 28776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:40.415979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57227 (local address 127.0.0.1:44459)
0811 16:41:40.416136 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:40.416150 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:40.416176 (+ 26us) server_negotiation.cc:407] Connection header received
0811 16:41:40.416684 (+ 508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:40.416694 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:40.416754 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:40.416865 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:41:40.417170 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:40.418020 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:40.419153 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:40.419700 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:40.419778 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:40.420387 (+ 609us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:41:40.420391 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:41:40.420392 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:41:40.420567 (+ 175us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:41:40.420604 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:41:40.420620 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:41:40.420883 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:40.420917 (+ 34us) server_negotiation.cc:299] Negotiation successful
0811 16:41:40.420985 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":65,"threads_started":1}
I20260811 16:41:40.421303 28779 sys_catalog.cc:455] T 00000000000000000000000000000000 P c32e55d7712e4a709feb6d8b4f0d3da9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c32e55d7712e4a709feb6d8b4f0d3da9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c32e55d7712e4a709feb6d8b4f0d3da9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44459 } } }
I20260811 16:41:40.421310 28784 sys_catalog.cc:455] T 00000000000000000000000000000000 P c32e55d7712e4a709feb6d8b4f0d3da9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c32e55d7712e4a709feb6d8b4f0d3da9. Latest consensus state: current_term: 1 leader_uuid: "c32e55d7712e4a709feb6d8b4f0d3da9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c32e55d7712e4a709feb6d8b4f0d3da9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44459 } } }
I20260811 16:41:40.421543 28779 sys_catalog.cc:458] T 00000000000000000000000000000000 P c32e55d7712e4a709feb6d8b4f0d3da9 [sys.catalog]: This master's current role is: LEADER
I20260811 16:41:40.421552 28784 sys_catalog.cc:458] T 00000000000000000000000000000000 P c32e55d7712e4a709feb6d8b4f0d3da9 [sys.catalog]: This master's current role is: LEADER
I20260811 16:41:40.422540 28798 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:41:40.422664 25279 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:41:40.423017 28798 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:41:40.424685 28798 catalog_manager.cc:1347] Generated new cluster ID: e0bcbd1884a841faa81dbf3ef6e49d08
I20260811 16:41:40.424741 28798 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:41:40.427448 28776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:40.424119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39889 (local address 127.0.0.1:44459)
0811 16:41:40.424157 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:40.424159 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:40.424281 (+ 122us) server_negotiation.cc:407] Connection header received
0811 16:41:40.424331 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:40.424331 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:40.424342 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:40.424399 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:41:40.424515 (+ 116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:40.425216 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:40.426258 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:40.426557 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:40.426619 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:40.427218 (+ 599us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:41:40.427220 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:41:40.427220 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:41:40.427225 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:41:40.427240 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:41:40.427245 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:41:40.427297 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:40.427352 (+ 55us) server_negotiation.cc:299] Negotiation successful
0811 16:41:40.427376 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260811 16:41:40.440186 28798 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:41:40.440891 28798 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:41:40.453190 28798 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c32e55d7712e4a709feb6d8b4f0d3da9: Generated new TSK 0
I20260811 16:41:40.453384 28798 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:41:40.461534 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 28660
2026-08-11T16:41:40Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1458 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466249441839-25279-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:41:40 dist-test-slave-zj8q krb5kdc[28828](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:41:40 dist-test-slave-zj8q krb5kdc[28828](info): set up 2 sockets
Aug 11 16:41:40 dist-test-slave-zj8q krb5kdc[28828](info): commencing operation
krb5kdc: starting...
W20260811 16:41:41.626402 25279 mini_kdc.cc:121] Time spent starting KDC: real 1.142s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Aug 11 16:41:41 dist-test-slave-zj8q krb5kdc[28828](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466501, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:41:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:41:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466249441839-25279-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466249441839-25279-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 16:41:41.744282 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466249441839-25279-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466249441839-25279-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466249441839-25279-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40085
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466249441839-25279-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40085
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:41:41.827020 28853 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:41:41.827244 28853 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:41:41.827267 28853 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:41:41.828401 28853 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:41:41.828449 28853 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:41:41.828462 28853 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:41:41.828473 28853 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:41:41.828483 28853 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:41:41.830062 28853 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466249441839-25279-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466249441839-25279-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40085
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466249441839-25279-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40085
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28853
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466249441839-25279-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:41:41.830333 28853 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:41:41.830541 28853 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:41:41.835393 28862 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:41:41.835393 28861 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:41.835470 28853 server_base.cc:1034] running on GCE node
W20260811 16:41:41.835446 28865 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:41.835866 28853 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:41:41.836179 28853 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:41:41.837328 28853 hybrid_clock.cc:648] HybridClock initialized: now 1786466501837309 us; error 31 us; skew 500 ppm
Aug 11 16:41:41 dist-test-slave-zj8q krb5kdc[28828](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466501, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:41:41.839865 28853 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 16:41:41.840323 28853 webserver.cc:460] Webserver started at http://127.0.0.1:39669/ using document root <none> and password file <none>
I20260811 16:41:41.840525 28853 fs_manager.cc:359] Metadata directory not provided
I20260811 16:41:41.840574 28853 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:41:41.840699 28853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:41:41.841760 28853 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466249441839-25279-0/minicluster-data/master-0/data/instance:
uuid: "77963b502d654e549ccf086cde4d3532"
format_stamp: "Formatted at 2026-08-11 16:41:41 on dist-test-slave-zj8q"
server_key: "d20ece47428599c7ba5a476ddc4637e1"
server_key_iv: "75b135fa8cfffd61025cc259c14fb7b2"
server_key_version: "encryptionkey@0"
I20260811 16:41:41.842109 28853 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466249441839-25279-0/minicluster-data/master-0/wal/instance:
uuid: "77963b502d654e549ccf086cde4d3532"
format_stamp: "Formatted at 2026-08-11 16:41:41 on dist-test-slave-zj8q"
server_key: "d20ece47428599c7ba5a476ddc4637e1"
server_key_iv: "75b135fa8cfffd61025cc259c14fb7b2"
server_key_version: "encryptionkey@0"
I20260811 16:41:41.843359 28853 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:41:41.844007 28880 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:41.844156 28853 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:41:41.844242 28853 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466249441839-25279-0/minicluster-data/master-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466249441839-25279-0/minicluster-data/master-0/wal
uuid: "77963b502d654e549ccf086cde4d3532"
format_stamp: "Formatted at 2026-08-11 16:41:41 on dist-test-slave-zj8q"
server_key: "d20ece47428599c7ba5a476ddc4637e1"
server_key_iv: "75b135fa8cfffd61025cc259c14fb7b2"
server_key_version: "encryptionkey@0"
I20260811 16:41:41.844302 28853 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466249441839-25279-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466249441839-25279-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466249441839-25279-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:41:41.847556 28853 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:41:41.849452 28853 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:41:41.849574 28853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:41:41.853395 28853 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40085
I20260811 16:41:41.853430 28951 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40085 every 8 connection(s)
I20260811 16:41:41.853739 28853 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
I20260811 16:41:41.854748 28952 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:41:41.857020 28952 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77963b502d654e549ccf086cde4d3532: Bootstrap starting.
I20260811 16:41:41.857604 28952 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 77963b502d654e549ccf086cde4d3532: Neither blocks nor log segments found. Creating new log.
I20260811 16:41:41.857863 28952 log.cc:824] T 00000000000000000000000000000000 P 77963b502d654e549ccf086cde4d3532: Log is configured to *not* fsync() on all Append() calls
I20260811 16:41:41.858561 28952 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77963b502d654e549ccf086cde4d3532: No bootstrap required, opened a new log
I20260811 16:41:41.859476 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 28853
I20260811 16:41:41.859586 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466249441839-25279-0/minicluster-data/master-0/wal/instance
I20260811 16:41:41.859777 25279 external_mini_cluster.cc:1428] Setting key f824e46d68afb3ed90706d47f66c1dcb
I20260811 16:41:41.860452 28952 raft_consensus.cc:348] T 00000000000000000000000000000000 P 77963b502d654e549ccf086cde4d3532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77963b502d654e549ccf086cde4d3532" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40085 } }
I20260811 16:41:41.860634 28952 raft_consensus.cc:374] T 00000000000000000000000000000000 P 77963b502d654e549ccf086cde4d3532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:41:41.860680 28952 raft_consensus.cc:729] T 00000000000000000000000000000000 P 77963b502d654e549ccf086cde4d3532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77963b502d654e549ccf086cde4d3532, State: Initialized, Role: FOLLOWER
I20260811 16:41:41.860809 28952 consensus_queue.cc:260] T 00000000000000000000000000000000 P 77963b502d654e549ccf086cde4d3532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77963b502d654e549ccf086cde4d3532" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40085 } }
I20260811 16:41:41.860893 28952 raft_consensus.cc:388] T 00000000000000000000000000000000 P 77963b502d654e549ccf086cde4d3532 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:41:41.860970 28952 raft_consensus.cc:482] T 00000000000000000000000000000000 P 77963b502d654e549ccf086cde4d3532 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:41:41.861027 28952 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 77963b502d654e549ccf086cde4d3532 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:41:41.862061 28966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:41.860289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37329 (local address 127.0.0.1:40085)
0811 16:41:41.860493 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:41.860503 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:41.860535 (+ 32us) server_negotiation.cc:407] Connection header received
0811 16:41:41.860657 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:41.860664 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:41.860695 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:41.860835 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:41:41.861526 (+ 691us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:41:41.861531 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:41:41.861532 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:41:41.861537 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:41:41.861590 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:41:41.861606 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:41:41.861692 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:41.861729 (+ 37us) server_negotiation.cc:299] Negotiation successful
0811 16:41:41.861863 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":101,"threads_started":1}
I20260811 16:41:41.862197 28952 raft_consensus.cc:504] T 00000000000000000000000000000000 P 77963b502d654e549ccf086cde4d3532 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77963b502d654e549ccf086cde4d3532" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40085 } }
I20260811 16:41:41.862304 28952 leader_election.cc:302] T 00000000000000000000000000000000 P 77963b502d654e549ccf086cde4d3532 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 77963b502d654e549ccf086cde4d3532; no voters:
I20260811 16:41:41.862458 28952 leader_election.cc:288] T 00000000000000000000000000000000 P 77963b502d654e549ccf086cde4d3532 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:41:41.862488 28967 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 77963b502d654e549ccf086cde4d3532 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:41:41.862597 28967 raft_consensus.cc:686] T 00000000000000000000000000000000 P 77963b502d654e549ccf086cde4d3532 [term 1 LEADER]: Becoming Leader. State: Replica: 77963b502d654e549ccf086cde4d3532, State: Running, Role: LEADER
I20260811 16:41:41.862727 28952 sys_catalog.cc:564] T 00000000000000000000000000000000 P 77963b502d654e549ccf086cde4d3532 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:41:41.862721 28967 consensus_queue.cc:237] T 00000000000000000000000000000000 P 77963b502d654e549ccf086cde4d3532 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77963b502d654e549ccf086cde4d3532" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40085 } }
I20260811 16:41:41.863147 25279 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:41:41.863196 28968 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77963b502d654e549ccf086cde4d3532 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "77963b502d654e549ccf086cde4d3532" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77963b502d654e549ccf086cde4d3532" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40085 } } }
I20260811 16:41:41.863268 28968 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77963b502d654e549ccf086cde4d3532 [sys.catalog]: This master's current role is: LEADER
I20260811 16:41:41.863430 28969 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77963b502d654e549ccf086cde4d3532 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 77963b502d654e549ccf086cde4d3532. Latest consensus state: current_term: 1 leader_uuid: "77963b502d654e549ccf086cde4d3532" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77963b502d654e549ccf086cde4d3532" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40085 } } }
I20260811 16:41:41.863471 28969 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77963b502d654e549ccf086cde4d3532 [sys.catalog]: This master's current role is: LEADER
W20260811 16:41:41.864528 28992 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 77963b502d654e549ccf086cde4d3532: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 16:41:41.864573 28992 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 16:41:41.864734 28978 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:41:41.864976 28978 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:41:41.865824 28966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:41.864698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60981 (local address 127.0.0.1:40085)
0811 16:41:41.864737 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:41.864739 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:41.864903 (+ 164us) server_negotiation.cc:407] Connection header received
0811 16:41:41.864951 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:41.864952 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:41.864967 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:41.865018 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:41:41.865612 (+ 594us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:41:41.865613 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:41:41.865614 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:41:41.865618 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:41:41.865635 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:41:41.865639 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:41:41.865698 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:41.865756 (+ 58us) server_negotiation.cc:299] Negotiation successful
0811 16:41:41.865768 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 16:41:41.866525 28978 catalog_manager.cc:1347] Generated new cluster ID: a449c252386145a092b31707bcbffed6
I20260811 16:41:41.866585 28978 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:41:41.884030 28978 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:41:41.884196 28978 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:41:41.890764 28978 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 77963b502d654e549ccf086cde4d3532: Generated new TSK 0
I20260811 16:41:41.890933 28978 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:41:41.896334 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 28853
2026-08-11T16:41:41Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1445 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466249441839-25279-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:41:41 dist-test-slave-zj8q krb5kdc[29008](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:41:41 dist-test-slave-zj8q krb5kdc[29008](info): set up 2 sockets
Aug 11 16:41:41 dist-test-slave-zj8q krb5kdc[29008](info): commencing operation
krb5kdc: starting...
W20260811 16:41:43.090914 25279 mini_kdc.cc:121] Time spent starting KDC: real 1.161s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Aug 11 16:41:43 dist-test-slave-zj8q krb5kdc[29008](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466503, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:41:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:41:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466249441839-25279-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466249441839-25279-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 16:41:43.206523 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466249441839-25279-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466249441839-25279-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466249441839-25279-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42171
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466249441839-25279-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40261
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42171
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:41:43.288239 29035 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:41:43.288444 29035 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:41:43.288466 29035 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:41:43.289662 29035 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:41:43.289713 29035 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:41:43.289726 29035 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:41:43.289737 29035 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:41:43.289763 29035 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:41:43.291317 29035 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40261
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466249441839-25279-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466249441839-25279-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42171
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466249441839-25279-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42171
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29035
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466249441839-25279-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:41:43.291559 29035 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:41:43.291761 29035 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 16:41:43.296656 29035 server_base.cc:1034] running on GCE node
W20260811 16:41:43.296608 29046 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:41:43.296590 29042 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:41:43.296612 29041 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:43.297122 29035 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:41:43.297415 29035 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:41:43.298547 29035 hybrid_clock.cc:648] HybridClock initialized: now 1786466503298514 us; error 48 us; skew 500 ppm
Aug 11 16:41:43 dist-test-slave-zj8q krb5kdc[29008](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466503, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:41:43.300921 29035 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 16:41:43.301368 29035 webserver.cc:460] Webserver started at http://127.0.0.1:43375/ using document root <none> and password file <none>
I20260811 16:41:43.301568 29035 fs_manager.cc:359] Metadata directory not provided
I20260811 16:41:43.301615 29035 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:41:43.301740 29035 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:41:43.302793 29035 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466249441839-25279-0/minicluster-data/master-0/data/instance:
uuid: "3337e89b56c54de9a1508d435309573b"
format_stamp: "Formatted at 2026-08-11 16:41:43 on dist-test-slave-zj8q"
server_key: "f566ae8d95979f3f447c2ded4c810299"
server_key_iv: "d0e80be4210d86092bd1098b83e9716e"
server_key_version: "encryptionkey@0"
I20260811 16:41:43.303125 29035 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466249441839-25279-0/minicluster-data/master-0/wal/instance:
uuid: "3337e89b56c54de9a1508d435309573b"
format_stamp: "Formatted at 2026-08-11 16:41:43 on dist-test-slave-zj8q"
server_key: "f566ae8d95979f3f447c2ded4c810299"
server_key_iv: "d0e80be4210d86092bd1098b83e9716e"
server_key_version: "encryptionkey@0"
I20260811 16:41:43.304378 29035 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:41:43.305121 29057 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:43.305291 29035 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:41:43.305380 29035 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466249441839-25279-0/minicluster-data/master-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466249441839-25279-0/minicluster-data/master-0/wal
uuid: "3337e89b56c54de9a1508d435309573b"
format_stamp: "Formatted at 2026-08-11 16:41:43 on dist-test-slave-zj8q"
server_key: "f566ae8d95979f3f447c2ded4c810299"
server_key_iv: "d0e80be4210d86092bd1098b83e9716e"
server_key_version: "encryptionkey@0"
I20260811 16:41:43.305442 29035 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466249441839-25279-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466249441839-25279-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466249441839-25279-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:41:43.332183 29035 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:41:43.334352 29035 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:41:43.334479 29035 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:41:43.338555 29035 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42171
I20260811 16:41:43.338617 29145 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42171 every 8 connection(s)
I20260811 16:41:43.338999 29035 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
I20260811 16:41:43.339888 29146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:41:43.341270 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 29035
I20260811 16:41:43.341369 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466249441839-25279-0/minicluster-data/master-0/wal/instance
I20260811 16:41:43.341539 25279 external_mini_cluster.cc:1428] Setting key df4c84a7bfbdb5156e5607c766ab28b3
I20260811 16:41:43.342505 29146 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3337e89b56c54de9a1508d435309573b: Bootstrap starting.
I20260811 16:41:43.343122 29146 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3337e89b56c54de9a1508d435309573b: Neither blocks nor log segments found. Creating new log.
I20260811 16:41:43.343473 29146 log.cc:824] T 00000000000000000000000000000000 P 3337e89b56c54de9a1508d435309573b: Log is configured to *not* fsync() on all Append() calls
I20260811 16:41:43.344199 29146 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3337e89b56c54de9a1508d435309573b: No bootstrap required, opened a new log
I20260811 16:41:43.346395 29146 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3337e89b56c54de9a1508d435309573b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3337e89b56c54de9a1508d435309573b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42171 } }
I20260811 16:41:43.346583 29146 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3337e89b56c54de9a1508d435309573b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:41:43.346625 29146 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3337e89b56c54de9a1508d435309573b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3337e89b56c54de9a1508d435309573b, State: Initialized, Role: FOLLOWER
I20260811 16:41:43.346740 29146 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3337e89b56c54de9a1508d435309573b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3337e89b56c54de9a1508d435309573b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42171 } }
I20260811 16:41:43.346813 29146 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3337e89b56c54de9a1508d435309573b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:41:43.346844 29146 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3337e89b56c54de9a1508d435309573b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:41:43.346890 29146 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3337e89b56c54de9a1508d435309573b [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:41:43.347599 29146 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3337e89b56c54de9a1508d435309573b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3337e89b56c54de9a1508d435309573b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42171 } }
I20260811 16:41:43.347715 29146 leader_election.cc:302] T 00000000000000000000000000000000 P 3337e89b56c54de9a1508d435309573b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3337e89b56c54de9a1508d435309573b; no voters:
I20260811 16:41:43.347877 29146 leader_election.cc:288] T 00000000000000000000000000000000 P 3337e89b56c54de9a1508d435309573b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:41:43.347913 29152 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3337e89b56c54de9a1508d435309573b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:41:43.348060 29152 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3337e89b56c54de9a1508d435309573b [term 1 LEADER]: Becoming Leader. State: Replica: 3337e89b56c54de9a1508d435309573b, State: Running, Role: LEADER
I20260811 16:41:43.348153 29146 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3337e89b56c54de9a1508d435309573b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:41:43.348235 29152 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3337e89b56c54de9a1508d435309573b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3337e89b56c54de9a1508d435309573b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42171 } }
Aug 11 16:41:43 dist-test-slave-zj8q krb5kdc[29008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466503, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 16:41:43.348552 29152 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3337e89b56c54de9a1508d435309573b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3337e89b56c54de9a1508d435309573b. Latest consensus state: current_term: 1 leader_uuid: "3337e89b56c54de9a1508d435309573b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3337e89b56c54de9a1508d435309573b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42171 } } }
I20260811 16:41:43.348618 29152 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3337e89b56c54de9a1508d435309573b [sys.catalog]: This master's current role is: LEADER
I20260811 16:41:43.348771 29155 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3337e89b56c54de9a1508d435309573b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3337e89b56c54de9a1508d435309573b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3337e89b56c54de9a1508d435309573b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42171 } } }
I20260811 16:41:43.348889 29155 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3337e89b56c54de9a1508d435309573b [sys.catalog]: This master's current role is: LEADER
I20260811 16:41:43.349261 29159 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:41:43.350016 29159 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:41:43.351444 29159 catalog_manager.cc:1347] Generated new cluster ID: 032f3e02e4b943309fbb8892027113a8
I20260811 16:41:43.351493 29159 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:41:43.353192 29150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:43.342140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.236:52367 (local address 127.0.0.1:42171)
0811 16:41:43.342325 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:43.342334 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:43.342361 (+ 27us) server_negotiation.cc:407] Connection header received
0811 16:41:43.342816 (+ 455us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:43.342823 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:43.342876 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:43.342992 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:41:43.343779 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:43.344771 (+ 992us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:43.345823 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:43.346275 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:43.346355 (+ 80us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:43.349249 (+ 2894us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:41:43.349254 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:41:43.349254 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:41:43.349266 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:41:43.351172 (+ 1906us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:41:43.351622 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:41:43.351626 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:41:43.351626 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:41:43.351745 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:41:43.351992 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:41:43.351993 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:41:43.351994 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:41:43.352291 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:41:43.352430 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:43.352876 (+ 446us) server_negotiation.cc:299] Negotiation successful
0811 16:41:43.352979 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":71,"threads_started":1}
I20260811 16:41:43.355123 25279 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:41:43.362258 29159 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:41:43.362911 29159 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:41:43.363484 29150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:43.356667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.236:40489 (local address 127.0.0.1:42171)
0811 16:41:43.356708 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:43.356710 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:43.356718 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:41:43.356738 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:43.356739 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:43.356750 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:43.356805 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:41:43.357365 (+ 560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:43.358119 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:43.359079 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:43.359402 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:43.359476 (+ 74us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:43.360702 (+ 1226us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:41:43.360704 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:41:43.360704 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:41:43.360711 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:41:43.362214 (+ 1503us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:41:43.362608 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:41:43.362609 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:41:43.362609 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:41:43.362676 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:41:43.362883 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:41:43.362883 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:41:43.362884 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:41:43.363003 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:41:43.363099 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:43.363237 (+ 138us) server_negotiation.cc:299] Negotiation successful
0811 16:41:43.363302 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 16:41:43.367571 29159 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3337e89b56c54de9a1508d435309573b: Generated new TSK 0
I20260811 16:41:43.367741 29159 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:41:43.372334 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 29035
W20260811 16:41:43.394266 29006 connection.cc:535] client connection to 127.0.0.1:42171 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42171): Connection reset by peer (error 104)
2026-08-11T16:41:43Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1478 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466249441839-25279-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:41:43 dist-test-slave-zj8q krb5kdc[29191](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:41:43 dist-test-slave-zj8q krb5kdc[29191](info): set up 2 sockets
Aug 11 16:41:43 dist-test-slave-zj8q krb5kdc[29191](info): commencing operation
krb5kdc: starting...
W20260811 16:41:44.558058 25279 mini_kdc.cc:121] Time spent starting KDC: real 1.150s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Aug 11 16:41:44 dist-test-slave-zj8q krb5kdc[29191](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466504, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:41:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:41:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466249441839-25279-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466249441839-25279-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 16:41:44.686034 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466249441839-25279-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466249441839-25279-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466249441839-25279-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40955
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466249441839-25279-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43635
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40955
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:41:44.773275 29212 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:41:44.773469 29212 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:41:44.773491 29212 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:41:44.774623 29212 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:41:44.774667 29212 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:41:44.774679 29212 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:41:44.774693 29212 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:41:44.774716 29212 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:41:44.776203 29212 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43635
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466249441839-25279-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466249441839-25279-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40955
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466249441839-25279-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40955
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29212
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466249441839-25279-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:41:44.776422 29212 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:41:44.776634 29212 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:41:44.781311 29223 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:41:44.781349 29221 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:41:44.781399 29229 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:44.781553 29212 server_base.cc:1034] running on GCE node
I20260811 16:41:44.781790 29212 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:41:44.782059 29212 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:41:44.783197 29212 hybrid_clock.cc:648] HybridClock initialized: now 1786466504783177 us; error 34 us; skew 500 ppm
Aug 11 16:41:44 dist-test-slave-zj8q krb5kdc[29191](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466504, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:41:44.785518 29212 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 16:41:44.785923 29212 webserver.cc:460] Webserver started at http://127.0.0.1:34853/ using document root <none> and password file <none>
I20260811 16:41:44.786139 29212 fs_manager.cc:359] Metadata directory not provided
I20260811 16:41:44.786211 29212 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:41:44.786340 29212 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:41:44.787369 29212 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466249441839-25279-0/minicluster-data/master-0/data/instance:
uuid: "91e83af37c5f4514a43377657123065d"
format_stamp: "Formatted at 2026-08-11 16:41:44 on dist-test-slave-zj8q"
server_key: "aaf2bddec9103e792b09de7a96a8e856"
server_key_iv: "23b6b53982a562a178bb337e175cdca7"
server_key_version: "encryptionkey@0"
I20260811 16:41:44.787696 29212 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466249441839-25279-0/minicluster-data/master-0/wal/instance:
uuid: "91e83af37c5f4514a43377657123065d"
format_stamp: "Formatted at 2026-08-11 16:41:44 on dist-test-slave-zj8q"
server_key: "aaf2bddec9103e792b09de7a96a8e856"
server_key_iv: "23b6b53982a562a178bb337e175cdca7"
server_key_version: "encryptionkey@0"
I20260811 16:41:44.788883 29212 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:41:44.789487 29243 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:44.789635 29212 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:41:44.789721 29212 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466249441839-25279-0/minicluster-data/master-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466249441839-25279-0/minicluster-data/master-0/wal
uuid: "91e83af37c5f4514a43377657123065d"
format_stamp: "Formatted at 2026-08-11 16:41:44 on dist-test-slave-zj8q"
server_key: "aaf2bddec9103e792b09de7a96a8e856"
server_key_iv: "23b6b53982a562a178bb337e175cdca7"
server_key_version: "encryptionkey@0"
I20260811 16:41:44.789781 29212 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466249441839-25279-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466249441839-25279-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466249441839-25279-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:41:44.796932 29212 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:41:44.798913 29212 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:41:44.799036 29212 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:41:44.802801 29212 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40955
I20260811 16:41:44.802839 29326 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40955 every 8 connection(s)
I20260811 16:41:44.803150 29212 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
I20260811 16:41:44.803998 29330 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:41:44.806366 29330 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 91e83af37c5f4514a43377657123065d: Bootstrap starting.
I20260811 16:41:44.806941 29330 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 91e83af37c5f4514a43377657123065d: Neither blocks nor log segments found. Creating new log.
I20260811 16:41:44.807210 29330 log.cc:824] T 00000000000000000000000000000000 P 91e83af37c5f4514a43377657123065d: Log is configured to *not* fsync() on all Append() calls
I20260811 16:41:44.807863 29330 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 91e83af37c5f4514a43377657123065d: No bootstrap required, opened a new log
I20260811 16:41:44.809455 29330 raft_consensus.cc:348] T 00000000000000000000000000000000 P 91e83af37c5f4514a43377657123065d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91e83af37c5f4514a43377657123065d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40955 } }
I20260811 16:41:44.809600 29330 raft_consensus.cc:374] T 00000000000000000000000000000000 P 91e83af37c5f4514a43377657123065d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:41:44.809633 29330 raft_consensus.cc:729] T 00000000000000000000000000000000 P 91e83af37c5f4514a43377657123065d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e83af37c5f4514a43377657123065d, State: Initialized, Role: FOLLOWER
I20260811 16:41:44.809772 29330 consensus_queue.cc:260] T 00000000000000000000000000000000 P 91e83af37c5f4514a43377657123065d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91e83af37c5f4514a43377657123065d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40955 } }
I20260811 16:41:44.809834 29330 raft_consensus.cc:388] T 00000000000000000000000000000000 P 91e83af37c5f4514a43377657123065d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:41:44.809854 29330 raft_consensus.cc:482] T 00000000000000000000000000000000 P 91e83af37c5f4514a43377657123065d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:41:44.809900 29330 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 91e83af37c5f4514a43377657123065d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:41:44.810490 29330 raft_consensus.cc:504] T 00000000000000000000000000000000 P 91e83af37c5f4514a43377657123065d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91e83af37c5f4514a43377657123065d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40955 } }
I20260811 16:41:44.810588 29330 leader_election.cc:302] T 00000000000000000000000000000000 P 91e83af37c5f4514a43377657123065d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 91e83af37c5f4514a43377657123065d; no voters:
I20260811 16:41:44.810750 29330 leader_election.cc:288] T 00000000000000000000000000000000 P 91e83af37c5f4514a43377657123065d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:41:44.810788 29333 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 91e83af37c5f4514a43377657123065d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:41:44.810937 29333 raft_consensus.cc:686] T 00000000000000000000000000000000 P 91e83af37c5f4514a43377657123065d [term 1 LEADER]: Becoming Leader. State: Replica: 91e83af37c5f4514a43377657123065d, State: Running, Role: LEADER
I20260811 16:41:44.811003 29330 sys_catalog.cc:564] T 00000000000000000000000000000000 P 91e83af37c5f4514a43377657123065d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:41:44.811030 29333 consensus_queue.cc:237] T 00000000000000000000000000000000 P 91e83af37c5f4514a43377657123065d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91e83af37c5f4514a43377657123065d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40955 } }
I20260811 16:41:44.811393 29336 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91e83af37c5f4514a43377657123065d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 91e83af37c5f4514a43377657123065d. Latest consensus state: current_term: 1 leader_uuid: "91e83af37c5f4514a43377657123065d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91e83af37c5f4514a43377657123065d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40955 } } }
I20260811 16:41:44.811477 29336 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91e83af37c5f4514a43377657123065d [sys.catalog]: This master's current role is: LEADER
I20260811 16:41:44.811599 29335 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91e83af37c5f4514a43377657123065d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "91e83af37c5f4514a43377657123065d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91e83af37c5f4514a43377657123065d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40955 } } }
I20260811 16:41:44.811704 29335 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91e83af37c5f4514a43377657123065d [sys.catalog]: This master's current role is: LEADER
I20260811 16:41:44.811709 29347 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:41:44.812217 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 29212
I20260811 16:41:44.812338 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466249441839-25279-0/minicluster-data/master-0/wal/instance
I20260811 16:41:44.812438 29347 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:41:44.812541 25279 external_mini_cluster.cc:1428] Setting key 80d897f4e33a14530123f450bc82c27c
I20260811 16:41:44.814087 29347 catalog_manager.cc:1347] Generated new cluster ID: 0559306f505d475687b2e4b2156951e8
I20260811 16:41:44.814143 29347 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:41:44.824373 29347 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:41:44.825116 29347 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:41:44.826471 29373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:44.813157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.236:46583 (local address 127.0.0.1:40955)
0811 16:41:44.813335 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:44.813344 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:44.813380 (+ 36us) server_negotiation.cc:407] Connection header received
0811 16:41:44.813494 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:44.813501 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:44.813569 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:44.813708 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:41:44.822259 (+ 8551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:44.823246 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:44.824365 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:44.824850 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:44.824951 (+ 101us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:44.825730 (+ 779us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:41:44.825735 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:41:44.825736 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:41:44.825906 (+ 170us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:41:44.825938 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:41:44.825950 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:41:44.826022 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:44.826122 (+ 100us) server_negotiation.cc:299] Negotiation successful
0811 16:41:44.826281 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":23,"server-negotiator.queue_time_us":123,"thread_start_us":73,"threads_started":1}
I20260811 16:41:44.827402 25279 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:41:44.830474 29347 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 91e83af37c5f4514a43377657123065d: Generated new TSK 0
I20260811 16:41:44.830651 29347 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:41:44.831723 29373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:44.828706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.236:36813 (local address 127.0.0.1:40955)
0811 16:41:44.828745 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:44.828746 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:44.828879 (+ 133us) server_negotiation.cc:407] Connection header received
0811 16:41:44.828921 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:44.828922 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:44.828933 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:44.828984 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:41:44.829108 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:44.829608 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:44.830427 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:44.830742 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:44.830807 (+ 65us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:44.831480 (+ 673us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:41:44.831481 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:41:44.831482 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:41:44.831486 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:41:44.831501 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:41:44.831505 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:41:44.831550 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:44.831639 (+ 89us) server_negotiation.cc:299] Negotiation successful
0811 16:41:44.831653 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":19}
I20260811 16:41:44.833468 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 29212
W20260811 16:41:44.847427 29187 connection.cc:535] client connection to 127.0.0.1:40955 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40955): Connection reset by peer (error 104)
2026-08-11T16:41:44Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1453 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466249441839-25279-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:41:44 dist-test-slave-zj8q krb5kdc[29386](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:41:44 dist-test-slave-zj8q krb5kdc[29386](info): set up 2 sockets
Aug 11 16:41:44 dist-test-slave-zj8q krb5kdc[29386](info): commencing operation
krb5kdc: starting...
W20260811 16:41:46.007278 25279 mini_kdc.cc:121] Time spent starting KDC: real 1.146s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Aug 11 16:41:46 dist-test-slave-zj8q krb5kdc[29386](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466506, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:41:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:41:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466249441839-25279-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466249441839-25279-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 16:41:46.125416 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466249441839-25279-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466249441839-25279-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466249441839-25279-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46565
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466249441839-25279-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44225
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46565
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:41:46.212595 29406 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:41:46.212816 29406 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:41:46.212839 29406 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:41:46.213958 29406 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:41:46.213995 29406 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:41:46.214007 29406 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:41:46.214018 29406 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:41:46.214030 29406 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:41:46.215523 29406 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44225
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466249441839-25279-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466249441839-25279-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46565
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466249441839-25279-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46565
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29406
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466249441839-25279-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:41:46.215734 29406 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:41:46.215915 29406 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:41:46.220721 29413 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:46.220827 29406 server_base.cc:1034] running on GCE node
W20260811 16:41:46.220715 29411 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:41:46.220713 29415 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:46.221181 29406 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:41:46.221451 29406 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:41:46.222584 29406 hybrid_clock.cc:648] HybridClock initialized: now 1786466506222559 us; error 37 us; skew 500 ppm
Aug 11 16:41:46 dist-test-slave-zj8q krb5kdc[29386](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466506, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:41:46.228523 29406 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 16:41:46.229154 29406 webserver.cc:460] Webserver started at http://127.0.0.1:40009/ using document root <none> and password file <none>
I20260811 16:41:46.229409 29406 fs_manager.cc:359] Metadata directory not provided
I20260811 16:41:46.229463 29406 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:41:46.229594 29406 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:41:46.230779 29406 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466249441839-25279-0/minicluster-data/master-0/data/instance:
uuid: "558405d4922b4b6fb83a72f0d6cf3d6b"
format_stamp: "Formatted at 2026-08-11 16:41:46 on dist-test-slave-zj8q"
server_key: "4f742e8ebaa9dca7515ddfce45571db2"
server_key_iv: "f998b7e2f1370f258d33e88a0bcb4a92"
server_key_version: "encryptionkey@0"
I20260811 16:41:46.231137 29406 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466249441839-25279-0/minicluster-data/master-0/wal/instance:
uuid: "558405d4922b4b6fb83a72f0d6cf3d6b"
format_stamp: "Formatted at 2026-08-11 16:41:46 on dist-test-slave-zj8q"
server_key: "4f742e8ebaa9dca7515ddfce45571db2"
server_key_iv: "f998b7e2f1370f258d33e88a0bcb4a92"
server_key_version: "encryptionkey@0"
I20260811 16:41:46.232452 29406 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:41:46.233199 29423 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:46.233354 29406 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:41:46.233444 29406 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466249441839-25279-0/minicluster-data/master-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466249441839-25279-0/minicluster-data/master-0/wal
uuid: "558405d4922b4b6fb83a72f0d6cf3d6b"
format_stamp: "Formatted at 2026-08-11 16:41:46 on dist-test-slave-zj8q"
server_key: "4f742e8ebaa9dca7515ddfce45571db2"
server_key_iv: "f998b7e2f1370f258d33e88a0bcb4a92"
server_key_version: "encryptionkey@0"
I20260811 16:41:46.233506 29406 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466249441839-25279-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466249441839-25279-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466249441839-25279-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:41:46.236799 29406 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:41:46.238744 29406 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:41:46.238875 29406 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:41:46.242900 29406 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46565
I20260811 16:41:46.242935 29509 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46565 every 8 connection(s)
I20260811 16:41:46.243249 29406 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
I20260811 16:41:46.244235 29511 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:41:46.246516 29511 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 558405d4922b4b6fb83a72f0d6cf3d6b: Bootstrap starting.
I20260811 16:41:46.247062 29511 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 558405d4922b4b6fb83a72f0d6cf3d6b: Neither blocks nor log segments found. Creating new log.
I20260811 16:41:46.247287 29511 log.cc:824] T 00000000000000000000000000000000 P 558405d4922b4b6fb83a72f0d6cf3d6b: Log is configured to *not* fsync() on all Append() calls
I20260811 16:41:46.247900 29511 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 558405d4922b4b6fb83a72f0d6cf3d6b: No bootstrap required, opened a new log
I20260811 16:41:46.249437 29511 raft_consensus.cc:348] T 00000000000000000000000000000000 P 558405d4922b4b6fb83a72f0d6cf3d6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "558405d4922b4b6fb83a72f0d6cf3d6b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46565 } }
I20260811 16:41:46.249573 29511 raft_consensus.cc:374] T 00000000000000000000000000000000 P 558405d4922b4b6fb83a72f0d6cf3d6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:41:46.249595 29511 raft_consensus.cc:729] T 00000000000000000000000000000000 P 558405d4922b4b6fb83a72f0d6cf3d6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 558405d4922b4b6fb83a72f0d6cf3d6b, State: Initialized, Role: FOLLOWER
I20260811 16:41:46.249706 29511 consensus_queue.cc:260] T 00000000000000000000000000000000 P 558405d4922b4b6fb83a72f0d6cf3d6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "558405d4922b4b6fb83a72f0d6cf3d6b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46565 } }
I20260811 16:41:46.249758 29511 raft_consensus.cc:388] T 00000000000000000000000000000000 P 558405d4922b4b6fb83a72f0d6cf3d6b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:41:46.249781 29511 raft_consensus.cc:482] T 00000000000000000000000000000000 P 558405d4922b4b6fb83a72f0d6cf3d6b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:41:46.249810 29511 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 558405d4922b4b6fb83a72f0d6cf3d6b [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:41:46.250337 29511 raft_consensus.cc:504] T 00000000000000000000000000000000 P 558405d4922b4b6fb83a72f0d6cf3d6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "558405d4922b4b6fb83a72f0d6cf3d6b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46565 } }
I20260811 16:41:46.250425 29511 leader_election.cc:302] T 00000000000000000000000000000000 P 558405d4922b4b6fb83a72f0d6cf3d6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 558405d4922b4b6fb83a72f0d6cf3d6b; no voters:
I20260811 16:41:46.250542 29511 leader_election.cc:288] T 00000000000000000000000000000000 P 558405d4922b4b6fb83a72f0d6cf3d6b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:41:46.250593 29516 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 558405d4922b4b6fb83a72f0d6cf3d6b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:41:46.250747 29516 raft_consensus.cc:686] T 00000000000000000000000000000000 P 558405d4922b4b6fb83a72f0d6cf3d6b [term 1 LEADER]: Becoming Leader. State: Replica: 558405d4922b4b6fb83a72f0d6cf3d6b, State: Running, Role: LEADER
I20260811 16:41:46.250795 29511 sys_catalog.cc:564] T 00000000000000000000000000000000 P 558405d4922b4b6fb83a72f0d6cf3d6b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:41:46.250840 29516 consensus_queue.cc:237] T 00000000000000000000000000000000 P 558405d4922b4b6fb83a72f0d6cf3d6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "558405d4922b4b6fb83a72f0d6cf3d6b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46565 } }
I20260811 16:41:46.250886 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 29406
I20260811 16:41:46.250999 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466249441839-25279-0/minicluster-data/master-0/wal/instance
I20260811 16:41:46.251201 25279 external_mini_cluster.cc:1428] Setting key 655e04a49083f68d7b77f5e46f7d3798
I20260811 16:41:46.251191 29518 sys_catalog.cc:455] T 00000000000000000000000000000000 P 558405d4922b4b6fb83a72f0d6cf3d6b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "558405d4922b4b6fb83a72f0d6cf3d6b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "558405d4922b4b6fb83a72f0d6cf3d6b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46565 } } }
I20260811 16:41:46.251276 29518 sys_catalog.cc:458] T 00000000000000000000000000000000 P 558405d4922b4b6fb83a72f0d6cf3d6b [sys.catalog]: This master's current role is: LEADER
I20260811 16:41:46.251382 29520 sys_catalog.cc:455] T 00000000000000000000000000000000 P 558405d4922b4b6fb83a72f0d6cf3d6b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 558405d4922b4b6fb83a72f0d6cf3d6b. Latest consensus state: current_term: 1 leader_uuid: "558405d4922b4b6fb83a72f0d6cf3d6b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "558405d4922b4b6fb83a72f0d6cf3d6b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46565 } } }
I20260811 16:41:46.251461 29520 sys_catalog.cc:458] T 00000000000000000000000000000000 P 558405d4922b4b6fb83a72f0d6cf3d6b [sys.catalog]: This master's current role is: LEADER
W20260811 16:41:46.253079 29549 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 558405d4922b4b6fb83a72f0d6cf3d6b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 16:41:46.253182 29549 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 16:41:46.253257 29529 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:41:46.253404 29529 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:41:46.253648 29533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:46.251828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.236:39457 (local address 127.0.0.1:46565)
0811 16:41:46.252091 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:46.252100 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:46.252133 (+ 33us) server_negotiation.cc:407] Connection header received
0811 16:41:46.252264 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:46.252271 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:46.252303 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:46.252447 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:41:46.253188 (+ 741us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:41:46.253192 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:41:46.253192 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:41:46.253196 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:41:46.253243 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:41:46.253259 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:41:46.253321 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:46.253420 (+ 99us) server_negotiation.cc:299] Negotiation successful
0811 16:41:46.253464 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":198,"thread_start_us":80,"threads_started":1}
I20260811 16:41:46.254500 25279 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:41:46.255124 29529 catalog_manager.cc:1347] Generated new cluster ID: 5d70c47253114f31aac96d89601e2b73
I20260811 16:41:46.255177 29529 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:41:46.259146 29533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:46.255901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.236:40583 (local address 127.0.0.1:46565)
0811 16:41:46.255933 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:46.255935 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:46.258335 (+ 2400us) server_negotiation.cc:407] Connection header received
0811 16:41:46.258395 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:46.258396 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:46.258402 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:46.258445 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:41:46.258955 (+ 510us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:41:46.258956 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:41:46.258956 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:41:46.258960 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:41:46.258976 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:41:46.258980 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:41:46.259027 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:46.259074 (+ 47us) server_negotiation.cc:299] Negotiation successful
0811 16:41:46.259087 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 16:41:46.293290 29529 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:41:46.293478 29529 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:41:46.300956 29529 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 558405d4922b4b6fb83a72f0d6cf3d6b: Generated new TSK 0
I20260811 16:41:46.301146 29529 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:41:46.306877 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 29406
2026-08-11T16:41:46Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1476 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466249441839-25279-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:41:46 dist-test-slave-zj8q krb5kdc[29567](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:41:46 dist-test-slave-zj8q krb5kdc[29567](info): set up 2 sockets
Aug 11 16:41:46 dist-test-slave-zj8q krb5kdc[29567](info): commencing operation
krb5kdc: starting...
W20260811 16:41:47.485330 25279 mini_kdc.cc:121] Time spent starting KDC: real 1.148s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Aug 11 16:41:47 dist-test-slave-zj8q krb5kdc[29567](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466507, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:41:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:41:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466249441839-25279-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466249441839-25279-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 16:41:47.604353 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466249441839-25279-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466249441839-25279-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466249441839-25279-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42681
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466249441839-25279-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34287
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42681
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:41:47.687780 29585 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:41:47.688015 29585 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:41:47.688047 29585 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:41:47.689224 29585 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:41:47.689268 29585 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:41:47.689286 29585 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:41:47.689302 29585 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:41:47.689317 29585 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:41:47.690871 29585 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34287
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466249441839-25279-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466249441839-25279-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42681
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466249441839-25279-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42681
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29585
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466249441839-25279-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:41:47.691140 29585 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:41:47.691361 29585 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:41:47.696194 29597 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:41:47.696200 29595 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:41:47.696192 29593 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:47.696448 29585 server_base.cc:1034] running on GCE node
I20260811 16:41:47.696707 29585 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:41:47.696986 29585 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:41:47.698190 29585 hybrid_clock.cc:648] HybridClock initialized: now 1786466507698163 us; error 31 us; skew 500 ppm
Aug 11 16:41:47 dist-test-slave-zj8q krb5kdc[29567](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466507, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:41:47.700941 29585 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 16:41:47.701381 29585 webserver.cc:460] Webserver started at http://127.0.0.1:43803/ using document root <none> and password file <none>
I20260811 16:41:47.701597 29585 fs_manager.cc:359] Metadata directory not provided
I20260811 16:41:47.701656 29585 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:41:47.701787 29585 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:41:47.702909 29585 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466249441839-25279-0/minicluster-data/master-0/data/instance:
uuid: "9d3565a86ce24e5aa2b85686d95b97c2"
format_stamp: "Formatted at 2026-08-11 16:41:47 on dist-test-slave-zj8q"
server_key: "f0501f94f302152d93f8fdafcfcc0e4b"
server_key_iv: "619989819bb5037fbfcaa655fa16d5cb"
server_key_version: "encryptionkey@0"
I20260811 16:41:47.703251 29585 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466249441839-25279-0/minicluster-data/master-0/wal/instance:
uuid: "9d3565a86ce24e5aa2b85686d95b97c2"
format_stamp: "Formatted at 2026-08-11 16:41:47 on dist-test-slave-zj8q"
server_key: "f0501f94f302152d93f8fdafcfcc0e4b"
server_key_iv: "619989819bb5037fbfcaa655fa16d5cb"
server_key_version: "encryptionkey@0"
I20260811 16:41:47.704563 29585 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:41:47.705339 29608 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:47.705497 29585 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:41:47.705600 29585 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466249441839-25279-0/minicluster-data/master-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466249441839-25279-0/minicluster-data/master-0/wal
uuid: "9d3565a86ce24e5aa2b85686d95b97c2"
format_stamp: "Formatted at 2026-08-11 16:41:47 on dist-test-slave-zj8q"
server_key: "f0501f94f302152d93f8fdafcfcc0e4b"
server_key_iv: "619989819bb5037fbfcaa655fa16d5cb"
server_key_version: "encryptionkey@0"
I20260811 16:41:47.705704 29585 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466249441839-25279-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466249441839-25279-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466249441839-25279-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:41:47.736696 29585 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:41:47.738726 29585 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:41:47.738871 29585 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:41:47.742885 29585 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42681
I20260811 16:41:47.742931 29703 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42681 every 8 connection(s)
I20260811 16:41:47.743290 29585 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
I20260811 16:41:47.744220 29706 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:41:47.746745 29706 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d3565a86ce24e5aa2b85686d95b97c2: Bootstrap starting.
I20260811 16:41:47.747350 29706 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9d3565a86ce24e5aa2b85686d95b97c2: Neither blocks nor log segments found. Creating new log.
I20260811 16:41:47.747627 29706 log.cc:824] T 00000000000000000000000000000000 P 9d3565a86ce24e5aa2b85686d95b97c2: Log is configured to *not* fsync() on all Append() calls
I20260811 16:41:47.748339 29706 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d3565a86ce24e5aa2b85686d95b97c2: No bootstrap required, opened a new log
I20260811 16:41:47.750173 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 29585
I20260811 16:41:47.750008 29706 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9d3565a86ce24e5aa2b85686d95b97c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d3565a86ce24e5aa2b85686d95b97c2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42681 } }
I20260811 16:41:47.750234 29706 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9d3565a86ce24e5aa2b85686d95b97c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:41:47.750281 29706 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9d3565a86ce24e5aa2b85686d95b97c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d3565a86ce24e5aa2b85686d95b97c2, State: Initialized, Role: FOLLOWER
I20260811 16:41:47.750293 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466249441839-25279-0/minicluster-data/master-0/wal/instance
I20260811 16:41:47.750435 29706 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9d3565a86ce24e5aa2b85686d95b97c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d3565a86ce24e5aa2b85686d95b97c2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42681 } }
I20260811 16:41:47.750501 25279 external_mini_cluster.cc:1428] Setting key da7a35bed9283f07b9d2d785e5e62461
I20260811 16:41:47.750517 29706 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9d3565a86ce24e5aa2b85686d95b97c2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:41:47.750566 29706 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9d3565a86ce24e5aa2b85686d95b97c2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:41:47.750614 29706 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9d3565a86ce24e5aa2b85686d95b97c2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:41:47.751623 29706 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9d3565a86ce24e5aa2b85686d95b97c2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d3565a86ce24e5aa2b85686d95b97c2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42681 } }
I20260811 16:41:47.751724 29706 leader_election.cc:302] T 00000000000000000000000000000000 P 9d3565a86ce24e5aa2b85686d95b97c2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9d3565a86ce24e5aa2b85686d95b97c2; no voters:
I20260811 16:41:47.751878 29706 leader_election.cc:288] T 00000000000000000000000000000000 P 9d3565a86ce24e5aa2b85686d95b97c2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:41:47.751911 29713 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9d3565a86ce24e5aa2b85686d95b97c2 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:41:47.752081 29713 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9d3565a86ce24e5aa2b85686d95b97c2 [term 1 LEADER]: Becoming Leader. State: Replica: 9d3565a86ce24e5aa2b85686d95b97c2, State: Running, Role: LEADER
I20260811 16:41:47.752146 29706 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9d3565a86ce24e5aa2b85686d95b97c2 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:41:47.752225 29713 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9d3565a86ce24e5aa2b85686d95b97c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d3565a86ce24e5aa2b85686d95b97c2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42681 } }
I20260811 16:41:47.752657 29715 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d3565a86ce24e5aa2b85686d95b97c2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9d3565a86ce24e5aa2b85686d95b97c2. Latest consensus state: current_term: 1 leader_uuid: "9d3565a86ce24e5aa2b85686d95b97c2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d3565a86ce24e5aa2b85686d95b97c2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42681 } } }
I20260811 16:41:47.752810 29715 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d3565a86ce24e5aa2b85686d95b97c2 [sys.catalog]: This master's current role is: LEADER
I20260811 16:41:47.753074 29728 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:41:47.753582 29728 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:41:47.754416 29716 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d3565a86ce24e5aa2b85686d95b97c2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9d3565a86ce24e5aa2b85686d95b97c2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d3565a86ce24e5aa2b85686d95b97c2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42681 } } }
I20260811 16:41:47.754819 29716 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d3565a86ce24e5aa2b85686d95b97c2 [sys.catalog]: This master's current role is: LEADER
I20260811 16:41:47.755414 29728 catalog_manager.cc:1347] Generated new cluster ID: 6956a38612b54abe850ae722717bd311
I20260811 16:41:47.755458 29728 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 16:41:47 dist-test-slave-zj8q krb5kdc[29567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466507, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 16:41:47.761238 29711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:47.751034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.236:40557 (local address 127.0.0.1:42681)
0811 16:41:47.751247 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:47.751257 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:47.751283 (+ 26us) server_negotiation.cc:407] Connection header received
0811 16:41:47.751378 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:47.751383 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:47.751427 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:47.751542 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:41:47.752311 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:47.753693 (+ 1382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:47.754631 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:47.755220 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:47.755322 (+ 102us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:47.757551 (+ 2229us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:41:47.757555 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:41:47.757556 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:41:47.757568 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:41:47.759223 (+ 1655us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:41:47.759597 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:41:47.759600 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:41:47.759600 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:41:47.760192 (+ 592us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:41:47.760423 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:41:47.760424 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:41:47.760425 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:41:47.760668 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:41:47.760829 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:47.760951 (+ 122us) server_negotiation.cc:299] Negotiation successful
0811 16:41:47.761049 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":112,"threads_started":1}
I20260811 16:41:47.762245 25279 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:41:47.769106 29711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:47.763502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.236:48189 (local address 127.0.0.1:42681)
0811 16:41:47.763539 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:47.763541 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:47.763681 (+ 140us) server_negotiation.cc:407] Connection header received
0811 16:41:47.763745 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:47.763746 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:47.763755 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:47.763800 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:41:47.764281 (+ 481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:47.764764 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:47.765420 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:47.765657 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:47.765710 (+ 53us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:47.766788 (+ 1078us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:41:47.766789 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:41:47.766790 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:41:47.766796 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:41:47.768059 (+ 1263us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:41:47.768388 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:41:47.768389 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:41:47.768390 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:41:47.768444 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:41:47.768639 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:41:47.768640 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:41:47.768640 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:41:47.768745 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:41:47.768848 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:47.768960 (+ 112us) server_negotiation.cc:299] Negotiation successful
0811 16:41:47.769017 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 16:41:47.775141 29728 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:41:47.775667 29728 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:41:47.791285 29728 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9d3565a86ce24e5aa2b85686d95b97c2: Generated new TSK 0
I20260811 16:41:47.791505 29728 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:41:47.799168 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 29585
W20260811 16:41:47.818039 29564 connection.cc:535] client connection to 127.0.0.1:42681 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42681): Connection reset by peer (error 104)
2026-08-11T16:41:47Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1494 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466249441839-25279-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:41:47 dist-test-slave-zj8q krb5kdc[29757](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:41:47 dist-test-slave-zj8q krb5kdc[29757](info): set up 2 sockets
Aug 11 16:41:47 dist-test-slave-zj8q krb5kdc[29757](info): commencing operation
krb5kdc: starting...
W20260811 16:41:48.987841 25279 mini_kdc.cc:121] Time spent starting KDC: real 1.156s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Aug 11 16:41:49 dist-test-slave-zj8q krb5kdc[29757](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466509, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:41:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:41:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466249441839-25279-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466249441839-25279-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 16:41:49.104560 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466249441839-25279-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466249441839-25279-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466249441839-25279-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41693
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466249441839-25279-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35313
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41693
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:41:49.185655 29781 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:41:49.185858 29781 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:41:49.185889 29781 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:41:49.187005 29781 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:41:49.187047 29781 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:41:49.187067 29781 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:41:49.187081 29781 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:41:49.187096 29781 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:41:49.188529 29781 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35313
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466249441839-25279-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466249441839-25279-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41693
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466249441839-25279-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41693
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29781
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466249441839-25279-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:41:49.188784 29781 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:41:49.188984 29781 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:41:49.193670 29788 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:41:49.193681 29790 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:41:49.193684 29794 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:49.194098 29781 server_base.cc:1034] running on GCE node
I20260811 16:41:49.194422 29781 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:41:49.194671 29781 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:41:49.195829 29781 hybrid_clock.cc:648] HybridClock initialized: now 1786466509195814 us; error 29 us; skew 500 ppm
Aug 11 16:41:49 dist-test-slave-zj8q krb5kdc[29757](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466509, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:41:49.198338 29781 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 16:41:49.198782 29781 webserver.cc:460] Webserver started at http://127.0.0.1:39771/ using document root <none> and password file <none>
I20260811 16:41:49.198990 29781 fs_manager.cc:359] Metadata directory not provided
I20260811 16:41:49.199033 29781 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:41:49.199147 29781 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:41:49.200184 29781 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466249441839-25279-0/minicluster-data/master-0/data/instance:
uuid: "afbe8574e9534f82b5f29cc690161503"
format_stamp: "Formatted at 2026-08-11 16:41:49 on dist-test-slave-zj8q"
server_key: "b720dd1650f7f049039f6c664b2d82b2"
server_key_iv: "13b6135a9d6af772904acec16fe38e91"
server_key_version: "encryptionkey@0"
I20260811 16:41:49.200523 29781 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466249441839-25279-0/minicluster-data/master-0/wal/instance:
uuid: "afbe8574e9534f82b5f29cc690161503"
format_stamp: "Formatted at 2026-08-11 16:41:49 on dist-test-slave-zj8q"
server_key: "b720dd1650f7f049039f6c664b2d82b2"
server_key_iv: "13b6135a9d6af772904acec16fe38e91"
server_key_version: "encryptionkey@0"
I20260811 16:41:49.201763 29781 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 16:41:49.202457 29807 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:49.202594 29781 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:49.202687 29781 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466249441839-25279-0/minicluster-data/master-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466249441839-25279-0/minicluster-data/master-0/wal
uuid: "afbe8574e9534f82b5f29cc690161503"
format_stamp: "Formatted at 2026-08-11 16:41:49 on dist-test-slave-zj8q"
server_key: "b720dd1650f7f049039f6c664b2d82b2"
server_key_iv: "13b6135a9d6af772904acec16fe38e91"
server_key_version: "encryptionkey@0"
I20260811 16:41:49.202754 29781 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466249441839-25279-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466249441839-25279-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466249441839-25279-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:41:49.227334 29781 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:41:49.229468 29781 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:41:49.229607 29781 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:41:49.233603 29781 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41693
I20260811 16:41:49.233656 29897 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41693 every 8 connection(s)
I20260811 16:41:49.233980 29781 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
I20260811 16:41:49.234949 29900 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:41:49.237218 29900 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P afbe8574e9534f82b5f29cc690161503: Bootstrap starting.
I20260811 16:41:49.237761 29900 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P afbe8574e9534f82b5f29cc690161503: Neither blocks nor log segments found. Creating new log.
I20260811 16:41:49.238008 29900 log.cc:824] T 00000000000000000000000000000000 P afbe8574e9534f82b5f29cc690161503: Log is configured to *not* fsync() on all Append() calls
I20260811 16:41:49.238698 29900 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P afbe8574e9534f82b5f29cc690161503: No bootstrap required, opened a new log
I20260811 16:41:49.239050 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 29781
I20260811 16:41:49.239156 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466249441839-25279-0/minicluster-data/master-0/wal/instance
I20260811 16:41:49.239320 25279 external_mini_cluster.cc:1428] Setting key 9d0af73c7addda6329b5464c6107a898
I20260811 16:41:49.240763 29900 raft_consensus.cc:348] T 00000000000000000000000000000000 P afbe8574e9534f82b5f29cc690161503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afbe8574e9534f82b5f29cc690161503" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41693 } }
I20260811 16:41:49.240947 29900 raft_consensus.cc:374] T 00000000000000000000000000000000 P afbe8574e9534f82b5f29cc690161503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:41:49.241044 29900 raft_consensus.cc:729] T 00000000000000000000000000000000 P afbe8574e9534f82b5f29cc690161503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afbe8574e9534f82b5f29cc690161503, State: Initialized, Role: FOLLOWER
I20260811 16:41:49.241194 29900 consensus_queue.cc:260] T 00000000000000000000000000000000 P afbe8574e9534f82b5f29cc690161503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afbe8574e9534f82b5f29cc690161503" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41693 } }
I20260811 16:41:49.241286 29900 raft_consensus.cc:388] T 00000000000000000000000000000000 P afbe8574e9534f82b5f29cc690161503 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:41:49.241325 29900 raft_consensus.cc:482] T 00000000000000000000000000000000 P afbe8574e9534f82b5f29cc690161503 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:41:49.241369 29900 raft_consensus.cc:3037] T 00000000000000000000000000000000 P afbe8574e9534f82b5f29cc690161503 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:41:49.242069 29900 raft_consensus.cc:504] T 00000000000000000000000000000000 P afbe8574e9534f82b5f29cc690161503 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afbe8574e9534f82b5f29cc690161503" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41693 } }
I20260811 16:41:49.242199 29900 leader_election.cc:302] T 00000000000000000000000000000000 P afbe8574e9534f82b5f29cc690161503 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: afbe8574e9534f82b5f29cc690161503; no voters:
I20260811 16:41:49.242349 29900 leader_election.cc:288] T 00000000000000000000000000000000 P afbe8574e9534f82b5f29cc690161503 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:41:49.242391 29906 raft_consensus.cc:2781] T 00000000000000000000000000000000 P afbe8574e9534f82b5f29cc690161503 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:41:49.242527 29906 raft_consensus.cc:686] T 00000000000000000000000000000000 P afbe8574e9534f82b5f29cc690161503 [term 1 LEADER]: Becoming Leader. State: Replica: afbe8574e9534f82b5f29cc690161503, State: Running, Role: LEADER
I20260811 16:41:49.242594 29900 sys_catalog.cc:564] T 00000000000000000000000000000000 P afbe8574e9534f82b5f29cc690161503 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:41:49.242654 29906 consensus_queue.cc:237] T 00000000000000000000000000000000 P afbe8574e9534f82b5f29cc690161503 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afbe8574e9534f82b5f29cc690161503" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41693 } }
I20260811 16:41:49.243506 29911 sys_catalog.cc:455] T 00000000000000000000000000000000 P afbe8574e9534f82b5f29cc690161503 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "afbe8574e9534f82b5f29cc690161503" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afbe8574e9534f82b5f29cc690161503" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41693 } } }
I20260811 16:41:49.243618 29908 sys_catalog.cc:455] T 00000000000000000000000000000000 P afbe8574e9534f82b5f29cc690161503 [sys.catalog]: SysCatalogTable state changed. Reason: New leader afbe8574e9534f82b5f29cc690161503. Latest consensus state: current_term: 1 leader_uuid: "afbe8574e9534f82b5f29cc690161503" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afbe8574e9534f82b5f29cc690161503" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41693 } } }
I20260811 16:41:49.243762 29908 sys_catalog.cc:458] T 00000000000000000000000000000000 P afbe8574e9534f82b5f29cc690161503 [sys.catalog]: This master's current role is: LEADER
I20260811 16:41:49.243930 29911 sys_catalog.cc:458] T 00000000000000000000000000000000 P afbe8574e9534f82b5f29cc690161503 [sys.catalog]: This master's current role is: LEADER
I20260811 16:41:49.244093 29932 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:41:49.244616 29932 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:41:49.246050 29905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:49.239809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.236:43003 (local address 127.0.0.1:41693)
0811 16:41:49.240005 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:49.240014 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:49.240061 (+ 47us) server_negotiation.cc:407] Connection header received
0811 16:41:49.240728 (+ 667us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:49.240737 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:49.240816 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:49.240968 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:41:49.241166 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:49.242800 (+ 1634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:49.243888 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:49.244471 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:49.244567 (+ 96us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:49.245291 (+ 724us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:41:49.245295 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:41:49.245295 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:41:49.245466 (+ 171us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:41:49.245498 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:41:49.245509 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:41:49.245597 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:49.245815 (+ 218us) server_negotiation.cc:299] Negotiation successful
0811 16:41:49.245845 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":89,"threads_started":1}
I20260811 16:41:49.246500 29932 catalog_manager.cc:1347] Generated new cluster ID: d1ff967ab51d42e5b424e96df4c50157
I20260811 16:41:49.246547 29932 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:41:49.247117 25279 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:41:49.255927 29932 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:41:49.256579 29932 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:41:49.258855 29905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:49.255534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.236:42599 (local address 127.0.0.1:41693)
0811 16:41:49.255589 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:49.255590 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:49.255599 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:41:49.255618 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:49.255618 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:49.255626 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:49.255679 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:41:49.255900 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:49.256593 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:49.257584 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:49.257896 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:49.257960 (+ 64us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:49.258624 (+ 664us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:41:49.258625 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:41:49.258625 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:41:49.258630 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:41:49.258647 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:41:49.258651 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:41:49.258713 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:49.258769 (+ 56us) server_negotiation.cc:299] Negotiation successful
0811 16:41:49.258782 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 16:41:49.264330 29932 catalog_manager.cc:5868] T 00000000000000000000000000000000 P afbe8574e9534f82b5f29cc690161503: Generated new TSK 0
I20260811 16:41:49.264492 29932 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:41:49.266572 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 29781
W20260811 16:41:49.288904 29754 connection.cc:535] client connection to 127.0.0.1:41693 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41693): Connection reset by peer (error 104)
2026-08-11T16:41:49Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1470 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466249441839-25279-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:41:49 dist-test-slave-zj8q krb5kdc[29948](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:41:49 dist-test-slave-zj8q krb5kdc[29948](info): set up 2 sockets
Aug 11 16:41:49 dist-test-slave-zj8q krb5kdc[29948](info): commencing operation
krb5kdc: starting...
W20260811 16:41:50.460611 25279 mini_kdc.cc:121] Time spent starting KDC: real 1.158s user 0.006s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Aug 11 16:41:50 dist-test-slave-zj8q krb5kdc[29948](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466510, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:41:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:41:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466249441839-25279-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466249441839-25279-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 16:41:50.580672 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466249441839-25279-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466249441839-25279-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466249441839-25279-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36297
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466249441839-25279-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36297
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:41:50.662731 29975 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:41:50.662949 29975 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:41:50.662971 29975 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:41:50.664116 29975 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:41:50.664160 29975 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:41:50.664172 29975 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:41:50.664183 29975 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:41:50.664194 29975 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:41:50.665776 29975 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466249441839-25279-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466249441839-25279-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36297
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466249441839-25279-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36297
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29975
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466249441839-25279-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:41:50.666019 29975 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:41:50.666256 29975 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:41:50.670981 29984 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:41:50.670990 29982 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:50.671171 29975 server_base.cc:1034] running on GCE node
W20260811 16:41:50.670995 29986 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:50.671509 29975 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:41:50.671757 29975 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:41:50.672910 29975 hybrid_clock.cc:648] HybridClock initialized: now 1786466510672894 us; error 35 us; skew 500 ppm
Aug 11 16:41:50 dist-test-slave-zj8q krb5kdc[29948](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466510, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:41:50.675328 29975 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 16:41:50.675765 29975 webserver.cc:460] Webserver started at http://127.0.0.1:34015/ using document root <none> and password file <none>
I20260811 16:41:50.675989 29975 fs_manager.cc:359] Metadata directory not provided
I20260811 16:41:50.676039 29975 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:41:50.676163 29975 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:41:50.677156 29975 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466249441839-25279-0/minicluster-data/master-0/data/instance:
uuid: "3a700581d5584ed28ee978abc68a1aa9"
format_stamp: "Formatted at 2026-08-11 16:41:50 on dist-test-slave-zj8q"
server_key: "73d85b57c78bdfdeba1eae5e0bc77b5a"
server_key_iv: "1419b76427be6d592be8672b9aa03cca"
server_key_version: "encryptionkey@0"
I20260811 16:41:50.677503 29975 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466249441839-25279-0/minicluster-data/master-0/wal/instance:
uuid: "3a700581d5584ed28ee978abc68a1aa9"
format_stamp: "Formatted at 2026-08-11 16:41:50 on dist-test-slave-zj8q"
server_key: "73d85b57c78bdfdeba1eae5e0bc77b5a"
server_key_iv: "1419b76427be6d592be8672b9aa03cca"
server_key_version: "encryptionkey@0"
I20260811 16:41:50.678823 29975 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:41:50.679466 29998 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:50.679615 29975 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:41:50.679702 29975 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466249441839-25279-0/minicluster-data/master-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466249441839-25279-0/minicluster-data/master-0/wal
uuid: "3a700581d5584ed28ee978abc68a1aa9"
format_stamp: "Formatted at 2026-08-11 16:41:50 on dist-test-slave-zj8q"
server_key: "73d85b57c78bdfdeba1eae5e0bc77b5a"
server_key_iv: "1419b76427be6d592be8672b9aa03cca"
server_key_version: "encryptionkey@0"
I20260811 16:41:50.679762 29975 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466249441839-25279-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466249441839-25279-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466249441839-25279-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:41:50.683032 29975 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:41:50.684768 29975 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:41:50.684899 29975 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:41:50.688764 29975 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36297
I20260811 16:41:50.688795 30082 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36297 every 8 connection(s)
I20260811 16:41:50.689086 29975 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
I20260811 16:41:50.690069 30084 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:41:50.692302 30084 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a700581d5584ed28ee978abc68a1aa9: Bootstrap starting.
I20260811 16:41:50.692858 30084 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3a700581d5584ed28ee978abc68a1aa9: Neither blocks nor log segments found. Creating new log.
I20260811 16:41:50.693106 30084 log.cc:824] T 00000000000000000000000000000000 P 3a700581d5584ed28ee978abc68a1aa9: Log is configured to *not* fsync() on all Append() calls
I20260811 16:41:50.693758 30084 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a700581d5584ed28ee978abc68a1aa9: No bootstrap required, opened a new log
I20260811 16:41:50.695371 30084 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3a700581d5584ed28ee978abc68a1aa9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a700581d5584ed28ee978abc68a1aa9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36297 } }
I20260811 16:41:50.695531 30084 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3a700581d5584ed28ee978abc68a1aa9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:41:50.695578 30084 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3a700581d5584ed28ee978abc68a1aa9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a700581d5584ed28ee978abc68a1aa9, State: Initialized, Role: FOLLOWER
I20260811 16:41:50.695631 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 29975
I20260811 16:41:50.695739 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466249441839-25279-0/minicluster-data/master-0/wal/instance
I20260811 16:41:50.695739 30084 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3a700581d5584ed28ee978abc68a1aa9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a700581d5584ed28ee978abc68a1aa9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36297 } }
I20260811 16:41:50.695829 30084 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3a700581d5584ed28ee978abc68a1aa9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:41:50.695868 30084 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3a700581d5584ed28ee978abc68a1aa9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:41:50.695912 30084 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3a700581d5584ed28ee978abc68a1aa9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:41:50.695935 25279 external_mini_cluster.cc:1428] Setting key 59f2717deda1f5f49034847421ed5170
I20260811 16:41:50.696514 30084 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3a700581d5584ed28ee978abc68a1aa9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a700581d5584ed28ee978abc68a1aa9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36297 } }
I20260811 16:41:50.696636 30084 leader_election.cc:302] T 00000000000000000000000000000000 P 3a700581d5584ed28ee978abc68a1aa9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3a700581d5584ed28ee978abc68a1aa9; no voters:
I20260811 16:41:50.696795 30084 leader_election.cc:288] T 00000000000000000000000000000000 P 3a700581d5584ed28ee978abc68a1aa9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:41:50.696846 30094 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3a700581d5584ed28ee978abc68a1aa9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:41:50.697036 30094 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3a700581d5584ed28ee978abc68a1aa9 [term 1 LEADER]: Becoming Leader. State: Replica: 3a700581d5584ed28ee978abc68a1aa9, State: Running, Role: LEADER
I20260811 16:41:50.697098 30084 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3a700581d5584ed28ee978abc68a1aa9 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:41:50.697170 30094 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3a700581d5584ed28ee978abc68a1aa9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a700581d5584ed28ee978abc68a1aa9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36297 } }
I20260811 16:41:50.698176 30092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:50.696375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.236:53217 (local address 127.0.0.1:36297)
0811 16:41:50.696526 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:50.696533 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:50.696559 (+ 26us) server_negotiation.cc:407] Connection header received
0811 16:41:50.696688 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:50.696696 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:50.696727 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:50.696863 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:41:50.697647 (+ 784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:41:50.697652 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:41:50.697652 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:41:50.697656 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:41:50.697706 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:41:50.697722 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:41:50.697782 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:50.697911 (+ 129us) server_negotiation.cc:299] Negotiation successful
0811 16:41:50.697969 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99,"thread_start_us":69,"threads_started":1}
I20260811 16:41:50.698459 30094 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a700581d5584ed28ee978abc68a1aa9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3a700581d5584ed28ee978abc68a1aa9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a700581d5584ed28ee978abc68a1aa9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36297 } } }
I20260811 16:41:50.698519 30098 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a700581d5584ed28ee978abc68a1aa9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3a700581d5584ed28ee978abc68a1aa9. Latest consensus state: current_term: 1 leader_uuid: "3a700581d5584ed28ee978abc68a1aa9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a700581d5584ed28ee978abc68a1aa9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36297 } } }
I20260811 16:41:50.698637 30098 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a700581d5584ed28ee978abc68a1aa9 [sys.catalog]: This master's current role is: LEADER
I20260811 16:41:50.698621 30094 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a700581d5584ed28ee978abc68a1aa9 [sys.catalog]: This master's current role is: LEADER
W20260811 16:41:50.699043 30124 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3a700581d5584ed28ee978abc68a1aa9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 16:41:50.699191 30124 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 16:41:50.699286 30126 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:41:50.699298 25279 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:41:50.699482 30126 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:41:50.701042 30126 catalog_manager.cc:1347] Generated new cluster ID: 6ab25dac3c284282933c023f562c64d6
I20260811 16:41:50.701097 30126 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:41:50.701885 30092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:50.700832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.236:44225 (local address 127.0.0.1:36297)
0811 16:41:50.700862 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:50.700864 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:50.700872 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:41:50.700926 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:50.700927 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:50.700932 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:50.700988 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:41:50.701588 (+ 600us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:41:50.701590 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:41:50.701590 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:41:50.701594 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:41:50.701610 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:41:50.701614 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:41:50.701663 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:50.701736 (+ 73us) server_negotiation.cc:299] Negotiation successful
0811 16:41:50.701748 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260811 16:41:50.709798 30126 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:41:50.709955 30126 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:41:50.716671 30126 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3a700581d5584ed28ee978abc68a1aa9: Generated new TSK 0
I20260811 16:41:50.716854 30126 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:41:50.724475 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 29975
2026-08-11T16:41:50Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1452 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466249441839-25279-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:41:50 dist-test-slave-zj8q krb5kdc[30145](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:41:50 dist-test-slave-zj8q krb5kdc[30145](info): set up 2 sockets
Aug 11 16:41:50 dist-test-slave-zj8q krb5kdc[30145](info): commencing operation
krb5kdc: starting...
W20260811 16:41:51.901564 25279 mini_kdc.cc:121] Time spent starting KDC: real 1.147s user 0.005s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Aug 11 16:41:51 dist-test-slave-zj8q krb5kdc[30145](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466511, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:41:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:41:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab.
Entry for principal kudu/127.24.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab.
I20260811 16:41:52.019300 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466249441839-25279-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466249441839-25279-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466249441839-25279-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:41263
--webserver_interface=127.24.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:41963
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.175.254:41263
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:41:52.100925 30160 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:41:52.101125 30160 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:41:52.101146 30160 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:41:52.102263 30160 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:41:52.102300 30160 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:41:52.102312 30160 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:41:52.102324 30160 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:41:52.102334 30160 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:41:52.103861 30160 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:41963
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466249441839-25279-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466249441839-25279-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.175.254:41263
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:41263
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30160
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466249441839-25279-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:41:52.104122 30160 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:41:52.104346 30160 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:41:52.109206 30168 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:52.109335 30160 server_base.cc:1034] running on GCE node
W20260811 16:41:52.109417 30171 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:41:52.109197 30167 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:52.109701 30160 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:41:52.109992 30160 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:41:52.111136 30160 hybrid_clock.cc:648] HybridClock initialized: now 1786466512111120 us; error 32 us; skew 500 ppm
Aug 11 16:41:52 dist-test-slave-zj8q krb5kdc[30145](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466512, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:41:52.117067 30160 init.cc:377] Logged in from keytab as kudu/127.24.175.254@KRBTEST.COM (short username kudu)
I20260811 16:41:52.117511 30160 webserver.cc:460] Webserver started at http://127.24.175.254:36991/ using document root <none> and password file <none>
I20260811 16:41:52.117722 30160 fs_manager.cc:359] Metadata directory not provided
I20260811 16:41:52.117769 30160 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:41:52.117866 30160 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:41:52.118943 30160 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466249441839-25279-0/minicluster-data/master-0/data/instance:
uuid: "560acf8596004a48b8778122167078b2"
format_stamp: "Formatted at 2026-08-11 16:41:52 on dist-test-slave-zj8q"
server_key: "dc579f0054db8cabc103249a47477189"
server_key_iv: "36bff4af864e4b4be6aa847e549d6587"
server_key_version: "encryptionkey@0"
I20260811 16:41:52.119246 30160 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466249441839-25279-0/minicluster-data/master-0/wal/instance:
uuid: "560acf8596004a48b8778122167078b2"
format_stamp: "Formatted at 2026-08-11 16:41:52 on dist-test-slave-zj8q"
server_key: "dc579f0054db8cabc103249a47477189"
server_key_iv: "36bff4af864e4b4be6aa847e549d6587"
server_key_version: "encryptionkey@0"
I20260811 16:41:52.120448 30160 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 16:41:52.121133 30182 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:52.121369 30160 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:41:52.121460 30160 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466249441839-25279-0/minicluster-data/master-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466249441839-25279-0/minicluster-data/master-0/wal
uuid: "560acf8596004a48b8778122167078b2"
format_stamp: "Formatted at 2026-08-11 16:41:52 on dist-test-slave-zj8q"
server_key: "dc579f0054db8cabc103249a47477189"
server_key_iv: "36bff4af864e4b4be6aa847e549d6587"
server_key_version: "encryptionkey@0"
I20260811 16:41:52.121523 30160 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466249441839-25279-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466249441839-25279-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466249441839-25279-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:41:52.129381 30160 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:41:52.131414 30160 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:41:52.131549 30160 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:41:52.135552 30160 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.254:41263
I20260811 16:41:52.135586 30279 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.254:41263 every 8 connection(s)
I20260811 16:41:52.135917 30160 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
I20260811 16:41:52.136766 30280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:41:52.139070 30280 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 560acf8596004a48b8778122167078b2: Bootstrap starting.
I20260811 16:41:52.139642 30280 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 560acf8596004a48b8778122167078b2: Neither blocks nor log segments found. Creating new log.
I20260811 16:41:52.139904 30280 log.cc:824] T 00000000000000000000000000000000 P 560acf8596004a48b8778122167078b2: Log is configured to *not* fsync() on all Append() calls
I20260811 16:41:52.140534 30280 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 560acf8596004a48b8778122167078b2: No bootstrap required, opened a new log
I20260811 16:41:52.142091 30280 raft_consensus.cc:348] T 00000000000000000000000000000000 P 560acf8596004a48b8778122167078b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "560acf8596004a48b8778122167078b2" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 41263 } }
I20260811 16:41:52.142302 30280 raft_consensus.cc:374] T 00000000000000000000000000000000 P 560acf8596004a48b8778122167078b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:41:52.142343 30280 raft_consensus.cc:729] T 00000000000000000000000000000000 P 560acf8596004a48b8778122167078b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 560acf8596004a48b8778122167078b2, State: Initialized, Role: FOLLOWER
I20260811 16:41:52.142481 30280 consensus_queue.cc:260] T 00000000000000000000000000000000 P 560acf8596004a48b8778122167078b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "560acf8596004a48b8778122167078b2" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 41263 } }
I20260811 16:41:52.142541 30280 raft_consensus.cc:388] T 00000000000000000000000000000000 P 560acf8596004a48b8778122167078b2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:41:52.142571 30280 raft_consensus.cc:482] T 00000000000000000000000000000000 P 560acf8596004a48b8778122167078b2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:41:52.142616 30280 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 560acf8596004a48b8778122167078b2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:41:52.143420 30280 raft_consensus.cc:504] T 00000000000000000000000000000000 P 560acf8596004a48b8778122167078b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "560acf8596004a48b8778122167078b2" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 41263 } }
I20260811 16:41:52.143513 30280 leader_election.cc:302] T 00000000000000000000000000000000 P 560acf8596004a48b8778122167078b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 560acf8596004a48b8778122167078b2; no voters:
I20260811 16:41:52.143666 30280 leader_election.cc:288] T 00000000000000000000000000000000 P 560acf8596004a48b8778122167078b2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:41:52.143700 30283 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 560acf8596004a48b8778122167078b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:41:52.143864 30283 raft_consensus.cc:686] T 00000000000000000000000000000000 P 560acf8596004a48b8778122167078b2 [term 1 LEADER]: Becoming Leader. State: Replica: 560acf8596004a48b8778122167078b2, State: Running, Role: LEADER
I20260811 16:41:52.143905 30280 sys_catalog.cc:564] T 00000000000000000000000000000000 P 560acf8596004a48b8778122167078b2 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:41:52.143959 30283 consensus_queue.cc:237] T 00000000000000000000000000000000 P 560acf8596004a48b8778122167078b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "560acf8596004a48b8778122167078b2" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 41263 } }
I20260811 16:41:52.144577 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 30160
I20260811 16:41:52.144721 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466249441839-25279-0/minicluster-data/master-0/wal/instance
I20260811 16:41:52.144910 25279 external_mini_cluster.cc:1428] Setting key f67db52a7ef1a681eb290eb06d6d5ba3
I20260811 16:41:52.144299 30284 sys_catalog.cc:455] T 00000000000000000000000000000000 P 560acf8596004a48b8778122167078b2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "560acf8596004a48b8778122167078b2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "560acf8596004a48b8778122167078b2" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 41263 } } }
I20260811 16:41:52.144315 30285 sys_catalog.cc:455] T 00000000000000000000000000000000 P 560acf8596004a48b8778122167078b2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 560acf8596004a48b8778122167078b2. Latest consensus state: current_term: 1 leader_uuid: "560acf8596004a48b8778122167078b2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "560acf8596004a48b8778122167078b2" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 41263 } } }
I20260811 16:41:52.145071 30284 sys_catalog.cc:458] T 00000000000000000000000000000000 P 560acf8596004a48b8778122167078b2 [sys.catalog]: This master's current role is: LEADER
I20260811 16:41:52.145089 30285 sys_catalog.cc:458] T 00000000000000000000000000000000 P 560acf8596004a48b8778122167078b2 [sys.catalog]: This master's current role is: LEADER
W20260811 16:41:52.145749 30307 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 560acf8596004a48b8778122167078b2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 16:41:52.145797 30307 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 16:41:52.145860 30305 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:41:52.146052 30305 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:41:52.147578 30305 catalog_manager.cc:1347] Generated new cluster ID: b27e8428005f4ebc9498612c31e72d96
I20260811 16:41:52.147632 30305 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 16:41:52 dist-test-slave-zj8q krb5kdc[30145](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466511, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:41:52.155213 30311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:52.145401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35845 (local address 127.24.175.254:41263)
0811 16:41:52.145667 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:52.145677 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:52.145707 (+ 30us) server_negotiation.cc:407] Connection header received
0811 16:41:52.145802 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:52.145809 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:52.145866 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:52.145999 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:41:52.146674 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:52.147873 (+ 1199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:52.148598 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:52.149034 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:52.149126 (+ 92us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:52.151409 (+ 2283us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:41:52.151413 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:41:52.151414 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:41:52.151424 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:41:52.153476 (+ 2052us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:41:52.153839 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:41:52.153843 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:41:52.153843 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:41:52.153936 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:41:52.154146 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:41:52.154147 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:41:52.154147 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:41:52.154444 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:41:52.154597 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:52.154840 (+ 243us) server_negotiation.cc:299] Negotiation successful
0811 16:41:52.155047 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":216,"thread_start_us":68,"threads_started":1}
I20260811 16:41:52.156191 25279 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:41:52.158493 30305 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:41:52.158953 30305 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:41:52.163815 30305 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 560acf8596004a48b8778122167078b2: Generated new TSK 0
I20260811 16:41:52.164008 30305 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:41:52.164475 30311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:52.157435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45993 (local address 127.24.175.254:41263)
0811 16:41:52.157468 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:52.157470 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:52.157565 (+ 95us) server_negotiation.cc:407] Connection header received
0811 16:41:52.157624 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:52.157624 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:52.157632 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:52.157677 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:41:52.158214 (+ 537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:52.158985 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:52.160022 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:52.160340 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:52.160397 (+ 57us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:52.161687 (+ 1290us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:41:52.161689 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:41:52.161689 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:41:52.161695 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:41:52.163141 (+ 1446us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:41:52.163567 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:41:52.163568 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:41:52.163568 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:41:52.163627 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:41:52.163888 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:41:52.163889 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:41:52.163889 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:41:52.164014 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:41:52.164114 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:52.164334 (+ 220us) server_negotiation.cc:299] Negotiation successful
0811 16:41:52.164396 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":8,"server-negotiator.queue_time_us":16}
I20260811 16:41:52.166404 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 30160
W20260811 16:41:52.181481 30140 connection.cc:535] client connection to 127.24.175.254:41263 recv error: Network error: failed to read from TLS socket (remote: 127.24.175.254:41263): Connection reset by peer (error 104)
2026-08-11T16:41:52Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1439 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466249441839-25279-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:41:52 dist-test-slave-zj8q krb5kdc[30329](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:41:52 dist-test-slave-zj8q krb5kdc[30329](info): set up 2 sockets
Aug 11 16:41:52 dist-test-slave-zj8q krb5kdc[30329](info): commencing operation
krb5kdc: starting...
W20260811 16:41:53.333115 25279 mini_kdc.cc:121] Time spent starting KDC: real 1.138s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Aug 11 16:41:53 dist-test-slave-zj8q krb5kdc[30329](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466513, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:41:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:41:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab.
Entry for principal kudu/127.24.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab.
I20260811 16:41:53.447110 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466249441839-25279-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466249441839-25279-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466249441839-25279-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:46057
--webserver_interface=127.24.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:36447
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.175.254:46057
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:41:53.528527 30348 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:41:53.528723 30348 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:41:53.528745 30348 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:41:53.529834 30348 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:41:53.529870 30348 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:41:53.529883 30348 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:41:53.529893 30348 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:41:53.529907 30348 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:41:53.531370 30348 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:36447
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466249441839-25279-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466249441839-25279-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.175.254:46057
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:46057
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30348
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466249441839-25279-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:41:53.531562 30348 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:41:53.531728 30348 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:41:53.536362 30359 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:53.536404 30348 server_base.cc:1034] running on GCE node
W20260811 16:41:53.536377 30361 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:41:53.536528 30355 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:53.536782 30348 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:41:53.537043 30348 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:41:53.538192 30348 hybrid_clock.cc:648] HybridClock initialized: now 1786466513538177 us; error 30 us; skew 500 ppm
Aug 11 16:41:53 dist-test-slave-zj8q krb5kdc[30329](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466513, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:41:53.540490 30348 init.cc:377] Logged in from keytab as kudu/127.24.175.254@KRBTEST.COM (short username kudu)
I20260811 16:41:53.540874 30348 webserver.cc:460] Webserver started at http://127.24.175.254:40323/ using document root <none> and password file <none>
I20260811 16:41:53.541060 30348 fs_manager.cc:359] Metadata directory not provided
I20260811 16:41:53.541102 30348 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:41:53.541219 30348 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:41:53.542250 30348 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466249441839-25279-0/minicluster-data/master-0/data/instance:
uuid: "7d742eeacafe469f9c1b3e17ef67b4e9"
format_stamp: "Formatted at 2026-08-11 16:41:53 on dist-test-slave-zj8q"
server_key: "eec3ccc633b08fd68672f1502d2c1f74"
server_key_iv: "2097a5d41a1f9bf73f471bbd4397e25d"
server_key_version: "encryptionkey@0"
I20260811 16:41:53.542593 30348 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466249441839-25279-0/minicluster-data/master-0/wal/instance:
uuid: "7d742eeacafe469f9c1b3e17ef67b4e9"
format_stamp: "Formatted at 2026-08-11 16:41:53 on dist-test-slave-zj8q"
server_key: "eec3ccc633b08fd68672f1502d2c1f74"
server_key_iv: "2097a5d41a1f9bf73f471bbd4397e25d"
server_key_version: "encryptionkey@0"
I20260811 16:41:53.543794 30348 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:41:53.544426 30371 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:53.544577 30348 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 16:41:53.544662 30348 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466249441839-25279-0/minicluster-data/master-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466249441839-25279-0/minicluster-data/master-0/wal
uuid: "7d742eeacafe469f9c1b3e17ef67b4e9"
format_stamp: "Formatted at 2026-08-11 16:41:53 on dist-test-slave-zj8q"
server_key: "eec3ccc633b08fd68672f1502d2c1f74"
server_key_iv: "2097a5d41a1f9bf73f471bbd4397e25d"
server_key_version: "encryptionkey@0"
I20260811 16:41:53.544719 30348 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466249441839-25279-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466249441839-25279-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466249441839-25279-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:41:53.557111 30348 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:41:53.558841 30348 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:41:53.558974 30348 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:41:53.562891 30348 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.254:46057
I20260811 16:41:53.562922 30446 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.254:46057 every 8 connection(s)
I20260811 16:41:53.563244 30348 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
I20260811 16:41:53.564083 30448 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:41:53.566368 30448 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7d742eeacafe469f9c1b3e17ef67b4e9: Bootstrap starting.
I20260811 16:41:53.566896 30448 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7d742eeacafe469f9c1b3e17ef67b4e9: Neither blocks nor log segments found. Creating new log.
I20260811 16:41:53.567153 30448 log.cc:824] T 00000000000000000000000000000000 P 7d742eeacafe469f9c1b3e17ef67b4e9: Log is configured to *not* fsync() on all Append() calls
I20260811 16:41:53.567813 30448 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7d742eeacafe469f9c1b3e17ef67b4e9: No bootstrap required, opened a new log
I20260811 16:41:53.569355 30448 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7d742eeacafe469f9c1b3e17ef67b4e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d742eeacafe469f9c1b3e17ef67b4e9" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 46057 } }
I20260811 16:41:53.569491 30448 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7d742eeacafe469f9c1b3e17ef67b4e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:41:53.569512 30448 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7d742eeacafe469f9c1b3e17ef67b4e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d742eeacafe469f9c1b3e17ef67b4e9, State: Initialized, Role: FOLLOWER
I20260811 16:41:53.569620 30448 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7d742eeacafe469f9c1b3e17ef67b4e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d742eeacafe469f9c1b3e17ef67b4e9" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 46057 } }
I20260811 16:41:53.569700 30448 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7d742eeacafe469f9c1b3e17ef67b4e9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:41:53.569736 30448 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7d742eeacafe469f9c1b3e17ef67b4e9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:41:53.569770 30448 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7d742eeacafe469f9c1b3e17ef67b4e9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:41:53.570616 30448 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7d742eeacafe469f9c1b3e17ef67b4e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d742eeacafe469f9c1b3e17ef67b4e9" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 46057 } }
I20260811 16:41:53.570705 30448 leader_election.cc:302] T 00000000000000000000000000000000 P 7d742eeacafe469f9c1b3e17ef67b4e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7d742eeacafe469f9c1b3e17ef67b4e9; no voters:
I20260811 16:41:53.570820 30448 leader_election.cc:288] T 00000000000000000000000000000000 P 7d742eeacafe469f9c1b3e17ef67b4e9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:41:53.570871 30454 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7d742eeacafe469f9c1b3e17ef67b4e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:41:53.571038 30448 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7d742eeacafe469f9c1b3e17ef67b4e9 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:41:53.571046 30454 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7d742eeacafe469f9c1b3e17ef67b4e9 [term 1 LEADER]: Becoming Leader. State: Replica: 7d742eeacafe469f9c1b3e17ef67b4e9, State: Running, Role: LEADER
I20260811 16:41:53.571223 30454 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7d742eeacafe469f9c1b3e17ef67b4e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d742eeacafe469f9c1b3e17ef67b4e9" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 46057 } }
I20260811 16:41:53.571599 30456 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7d742eeacafe469f9c1b3e17ef67b4e9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7d742eeacafe469f9c1b3e17ef67b4e9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d742eeacafe469f9c1b3e17ef67b4e9" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 46057 } } }
I20260811 16:41:53.571698 30456 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7d742eeacafe469f9c1b3e17ef67b4e9 [sys.catalog]: This master's current role is: LEADER
I20260811 16:41:53.571740 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 30348
I20260811 16:41:53.571856 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466249441839-25279-0/minicluster-data/master-0/wal/instance
I20260811 16:41:53.572050 25279 external_mini_cluster.cc:1428] Setting key c4e9e6ec199aa5fcac58db7a0706355e
I20260811 16:41:53.572353 30467 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:41:53.572116 30457 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7d742eeacafe469f9c1b3e17ef67b4e9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7d742eeacafe469f9c1b3e17ef67b4e9. Latest consensus state: current_term: 1 leader_uuid: "7d742eeacafe469f9c1b3e17ef67b4e9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d742eeacafe469f9c1b3e17ef67b4e9" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 46057 } } }
I20260811 16:41:53.572789 30457 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7d742eeacafe469f9c1b3e17ef67b4e9 [sys.catalog]: This master's current role is: LEADER
I20260811 16:41:53.573251 30467 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:41:53.575167 30467 catalog_manager.cc:1347] Generated new cluster ID: 8e7e6fcb53e94865b02adb2ab448b106
I20260811 16:41:53.575223 30467 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:41:53.577322 30487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:53.572542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43995 (local address 127.24.175.254:46057)
0811 16:41:53.572700 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:53.572710 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:53.572743 (+ 33us) server_negotiation.cc:407] Connection header received
0811 16:41:53.572875 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:53.572883 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:53.572938 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:53.573067 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:41:53.573311 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:53.574704 (+ 1393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:53.575567 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:53.575994 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:53.576088 (+ 94us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:53.576738 (+ 650us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:41:53.576741 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:41:53.576741 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:41:53.576898 (+ 157us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:41:53.576927 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:41:53.576938 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:41:53.577007 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:53.577098 (+ 91us) server_negotiation.cc:299] Negotiation successful
0811 16:41:53.577126 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105,"thread_start_us":69,"threads_started":1}
I20260811 16:41:53.578219 25279 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:41:53.584826 30487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:53.579473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36699 (local address 127.24.175.254:46057)
0811 16:41:53.579507 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:53.579509 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:53.582306 (+ 2797us) server_negotiation.cc:407] Connection header received
0811 16:41:53.582393 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:53.582393 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:53.582404 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:53.582450 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:41:53.582574 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:53.583047 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:53.583704 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:53.583940 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:53.583993 (+ 53us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:53.584594 (+ 601us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:41:53.584596 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:41:53.584597 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:41:53.584601 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:41:53.584615 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:41:53.584619 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:41:53.584662 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:53.584738 (+ 76us) server_negotiation.cc:299] Negotiation successful
0811 16:41:53.584750 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 16:41:53.593117 30467 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:41:53.593813 30467 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:41:53.599459 30467 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7d742eeacafe469f9c1b3e17ef67b4e9: Generated new TSK 0
I20260811 16:41:53.599647 30467 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:41:53.607709 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 30348
W20260811 16:41:53.634886 30327 connection.cc:535] client connection to 127.24.175.254:46057 recv error: Network error: failed to read from TLS socket (remote: 127.24.175.254:46057): Connection reset by peer (error 104)
2026-08-11T16:41:53Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1453 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466249441839-25279-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:41:53 dist-test-slave-zj8q krb5kdc[30503](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:41:53 dist-test-slave-zj8q krb5kdc[30503](info): set up 2 sockets
Aug 11 16:41:53 dist-test-slave-zj8q krb5kdc[30503](info): commencing operation
krb5kdc: starting...
W20260811 16:41:54.814989 25279 mini_kdc.cc:121] Time spent starting KDC: real 1.167s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Aug 11 16:41:54 dist-test-slave-zj8q krb5kdc[30503](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466514, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:41:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:41:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab.
Entry for principal kudu/127.24.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab.
I20260811 16:41:54.930591 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466249441839-25279-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466249441839-25279-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466249441839-25279-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:33333
--webserver_interface=127.24.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:41143
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.175.254:33333
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:41:55.012004 30524 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:41:55.012221 30524 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:41:55.012253 30524 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:41:55.013408 30524 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:41:55.013453 30524 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:41:55.013471 30524 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:41:55.013486 30524 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:41:55.013502 30524 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:41:55.015121 30524 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:41143
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466249441839-25279-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466249441839-25279-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.175.254:33333
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:33333
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30524
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466249441839-25279-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:41:55.015370 30524 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:41:55.015580 30524 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:41:55.020216 30535 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:55.020364 30524 server_base.cc:1034] running on GCE node
W20260811 16:41:55.020229 30529 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:41:55.020255 30531 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:55.020653 30524 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:41:55.020933 30524 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:41:55.022070 30524 hybrid_clock.cc:648] HybridClock initialized: now 1786466515022054 us; error 35 us; skew 500 ppm
Aug 11 16:41:55 dist-test-slave-zj8q krb5kdc[30503](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466515, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:41:55.024571 30524 init.cc:377] Logged in from keytab as kudu/127.24.175.254@KRBTEST.COM (short username kudu)
I20260811 16:41:55.024977 30524 webserver.cc:460] Webserver started at http://127.24.175.254:42027/ using document root <none> and password file <none>
I20260811 16:41:55.025194 30524 fs_manager.cc:359] Metadata directory not provided
I20260811 16:41:55.025234 30524 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:41:55.025326 30524 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:41:55.026491 30524 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466249441839-25279-0/minicluster-data/master-0/data/instance:
uuid: "52b9da3e0b53465786443eec604530ae"
format_stamp: "Formatted at 2026-08-11 16:41:55 on dist-test-slave-zj8q"
server_key: "135f544caec98b980b668154f1031528"
server_key_iv: "2d3ab7b2ec13d068177a8905f96c4a89"
server_key_version: "encryptionkey@0"
I20260811 16:41:55.026788 30524 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466249441839-25279-0/minicluster-data/master-0/wal/instance:
uuid: "52b9da3e0b53465786443eec604530ae"
format_stamp: "Formatted at 2026-08-11 16:41:55 on dist-test-slave-zj8q"
server_key: "135f544caec98b980b668154f1031528"
server_key_iv: "2d3ab7b2ec13d068177a8905f96c4a89"
server_key_version: "encryptionkey@0"
I20260811 16:41:55.027976 30524 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:41:55.028683 30542 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:55.028885 30524 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:41:55.028978 30524 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466249441839-25279-0/minicluster-data/master-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466249441839-25279-0/minicluster-data/master-0/wal
uuid: "52b9da3e0b53465786443eec604530ae"
format_stamp: "Formatted at 2026-08-11 16:41:55 on dist-test-slave-zj8q"
server_key: "135f544caec98b980b668154f1031528"
server_key_iv: "2d3ab7b2ec13d068177a8905f96c4a89"
server_key_version: "encryptionkey@0"
I20260811 16:41:55.029047 30524 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466249441839-25279-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466249441839-25279-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466249441839-25279-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:41:55.032337 30524 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:41:55.034041 30524 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:41:55.034183 30524 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:41:55.037923 30524 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.254:33333
I20260811 16:41:55.037959 30628 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.254:33333 every 8 connection(s)
I20260811 16:41:55.038300 30524 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
I20260811 16:41:55.039280 30629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:41:55.041545 30629 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 52b9da3e0b53465786443eec604530ae: Bootstrap starting.
I20260811 16:41:55.042116 30629 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 52b9da3e0b53465786443eec604530ae: Neither blocks nor log segments found. Creating new log.
I20260811 16:41:55.042418 30629 log.cc:824] T 00000000000000000000000000000000 P 52b9da3e0b53465786443eec604530ae: Log is configured to *not* fsync() on all Append() calls
I20260811 16:41:55.043051 30629 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 52b9da3e0b53465786443eec604530ae: No bootstrap required, opened a new log
I20260811 16:41:55.044647 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 30524
I20260811 16:41:55.044617 30629 raft_consensus.cc:348] T 00000000000000000000000000000000 P 52b9da3e0b53465786443eec604530ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52b9da3e0b53465786443eec604530ae" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 33333 } }
I20260811 16:41:55.044742 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466249441839-25279-0/minicluster-data/master-0/wal/instance
I20260811 16:41:55.044757 30629 raft_consensus.cc:374] T 00000000000000000000000000000000 P 52b9da3e0b53465786443eec604530ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:41:55.044801 30629 raft_consensus.cc:729] T 00000000000000000000000000000000 P 52b9da3e0b53465786443eec604530ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52b9da3e0b53465786443eec604530ae, State: Initialized, Role: FOLLOWER
I20260811 16:41:55.044905 25279 external_mini_cluster.cc:1428] Setting key 39757e6684e3a1b2214cab7edb293f02
I20260811 16:41:55.044939 30629 consensus_queue.cc:260] T 00000000000000000000000000000000 P 52b9da3e0b53465786443eec604530ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52b9da3e0b53465786443eec604530ae" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 33333 } }
I20260811 16:41:55.045018 30629 raft_consensus.cc:388] T 00000000000000000000000000000000 P 52b9da3e0b53465786443eec604530ae [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:41:55.045053 30629 raft_consensus.cc:482] T 00000000000000000000000000000000 P 52b9da3e0b53465786443eec604530ae [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:41:55.045100 30629 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 52b9da3e0b53465786443eec604530ae [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:41:55.046147 30629 raft_consensus.cc:504] T 00000000000000000000000000000000 P 52b9da3e0b53465786443eec604530ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52b9da3e0b53465786443eec604530ae" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 33333 } }
I20260811 16:41:55.046296 30629 leader_election.cc:302] T 00000000000000000000000000000000 P 52b9da3e0b53465786443eec604530ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 52b9da3e0b53465786443eec604530ae; no voters:
I20260811 16:41:55.046453 30629 leader_election.cc:288] T 00000000000000000000000000000000 P 52b9da3e0b53465786443eec604530ae [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:41:55.046475 30636 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 52b9da3e0b53465786443eec604530ae [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:41:55.046581 30636 raft_consensus.cc:686] T 00000000000000000000000000000000 P 52b9da3e0b53465786443eec604530ae [term 1 LEADER]: Becoming Leader. State: Replica: 52b9da3e0b53465786443eec604530ae, State: Running, Role: LEADER
I20260811 16:41:55.046703 30629 sys_catalog.cc:564] T 00000000000000000000000000000000 P 52b9da3e0b53465786443eec604530ae [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:41:55.046720 30636 consensus_queue.cc:237] T 00000000000000000000000000000000 P 52b9da3e0b53465786443eec604530ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52b9da3e0b53465786443eec604530ae" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 33333 } }
I20260811 16:41:55.047044 30635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:55.045371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47965 (local address 127.24.175.254:33333)
0811 16:41:55.045585 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:55.045596 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:55.045631 (+ 35us) server_negotiation.cc:407] Connection header received
0811 16:41:55.045780 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:55.045788 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:55.045820 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:55.045970 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:41:55.046591 (+ 621us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:41:55.046595 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:41:55.046595 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:41:55.046600 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:41:55.046646 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:41:55.046659 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:41:55.046699 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:55.046806 (+ 107us) server_negotiation.cc:299] Negotiation successful
0811 16:41:55.046861 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":93,"threads_started":1}
I20260811 16:41:55.047127 30636 sys_catalog.cc:455] T 00000000000000000000000000000000 P 52b9da3e0b53465786443eec604530ae [sys.catalog]: SysCatalogTable state changed. Reason: New leader 52b9da3e0b53465786443eec604530ae. Latest consensus state: current_term: 1 leader_uuid: "52b9da3e0b53465786443eec604530ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52b9da3e0b53465786443eec604530ae" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 33333 } } }
I20260811 16:41:55.047225 30636 sys_catalog.cc:458] T 00000000000000000000000000000000 P 52b9da3e0b53465786443eec604530ae [sys.catalog]: This master's current role is: LEADER
I20260811 16:41:55.047330 30638 sys_catalog.cc:455] T 00000000000000000000000000000000 P 52b9da3e0b53465786443eec604530ae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "52b9da3e0b53465786443eec604530ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52b9da3e0b53465786443eec604530ae" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 33333 } } }
I20260811 16:41:55.047708 30638 sys_catalog.cc:458] T 00000000000000000000000000000000 P 52b9da3e0b53465786443eec604530ae [sys.catalog]: This master's current role is: LEADER
I20260811 16:41:55.048058 25279 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:41:55.048128 30648 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:41:55.048583 30648 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:41:55.050417 30648 catalog_manager.cc:1347] Generated new cluster ID: a703aebaca4f44d2a8ee41ba665d8080
I20260811 16:41:55.050470 30648 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:41:55.050634 30635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:55.049523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34325 (local address 127.24.175.254:33333)
0811 16:41:55.049562 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:55.049564 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:55.049703 (+ 139us) server_negotiation.cc:407] Connection header received
0811 16:41:55.049756 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:55.049756 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:55.049762 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:55.049821 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:41:55.050417 (+ 596us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:41:55.050418 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:41:55.050418 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:41:55.050422 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:41:55.050437 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:41:55.050441 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:41:55.050493 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:55.050568 (+ 75us) server_negotiation.cc:299] Negotiation successful
0811 16:41:55.050581 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 16:41:55.055583 30648 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:41:55.055732 30648 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:41:55.060456 30648 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 52b9da3e0b53465786443eec604530ae: Generated new TSK 0
I20260811 16:41:55.060614 30648 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:41:55.065647 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 30524
2026-08-11T16:41:55Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1446 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466249441839-25279-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:41:55 dist-test-slave-zj8q krb5kdc[30672](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:41:55 dist-test-slave-zj8q krb5kdc[30672](info): set up 2 sockets
Aug 11 16:41:55 dist-test-slave-zj8q krb5kdc[30672](info): commencing operation
krb5kdc: starting...
W20260811 16:41:56.241788 25279 mini_kdc.cc:121] Time spent starting KDC: real 1.147s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Aug 11 16:41:56 dist-test-slave-zj8q krb5kdc[30672](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466516, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:41:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:41:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab.
Entry for principal kudu/127.24.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab.
I20260811 16:41:56.359061 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466249441839-25279-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466249441839-25279-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466249441839-25279-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:44233
--webserver_interface=127.24.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:41945
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.175.254:44233
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:41:56.440433 30693 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:41:56.440622 30693 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:41:56.440644 30693 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:41:56.441753 30693 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:41:56.441803 30693 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:41:56.441817 30693 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:41:56.441828 30693 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:41:56.441838 30693 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:41:56.443326 30693 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:41945
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466249441839-25279-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466249441839-25279-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.175.254:44233
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:44233
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30693
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466249441839-25279-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:41:56.443550 30693 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:41:56.443756 30693 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:41:56.448383 30702 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:41:56.448418 30700 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:41:56.448390 30705 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:56.448604 30693 server_base.cc:1034] running on GCE node
I20260811 16:41:56.448837 30693 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:41:56.449102 30693 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:41:56.450249 30693 hybrid_clock.cc:648] HybridClock initialized: now 1786466516450241 us; error 38 us; skew 500 ppm
Aug 11 16:41:56 dist-test-slave-zj8q krb5kdc[30672](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466516, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:41:56.452639 30693 init.cc:377] Logged in from keytab as kudu/127.24.175.254@KRBTEST.COM (short username kudu)
I20260811 16:41:56.453064 30693 webserver.cc:460] Webserver started at http://127.24.175.254:41203/ using document root <none> and password file <none>
I20260811 16:41:56.453287 30693 fs_manager.cc:359] Metadata directory not provided
I20260811 16:41:56.453331 30693 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:41:56.453451 30693 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:41:56.454481 30693 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466249441839-25279-0/minicluster-data/master-0/data/instance:
uuid: "a2ee9c4e9b6c40c28491482ce897e177"
format_stamp: "Formatted at 2026-08-11 16:41:56 on dist-test-slave-zj8q"
server_key: "a8e00d197d0a61895b044b7c978d68e1"
server_key_iv: "ecfb95594c09e00b032ed51819168a79"
server_key_version: "encryptionkey@0"
I20260811 16:41:56.454802 30693 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466249441839-25279-0/minicluster-data/master-0/wal/instance:
uuid: "a2ee9c4e9b6c40c28491482ce897e177"
format_stamp: "Formatted at 2026-08-11 16:41:56 on dist-test-slave-zj8q"
server_key: "a8e00d197d0a61895b044b7c978d68e1"
server_key_iv: "ecfb95594c09e00b032ed51819168a79"
server_key_version: "encryptionkey@0"
I20260811 16:41:56.455986 30693 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:41:56.456619 30716 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:56.456760 30693 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:41:56.456844 30693 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466249441839-25279-0/minicluster-data/master-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466249441839-25279-0/minicluster-data/master-0/wal
uuid: "a2ee9c4e9b6c40c28491482ce897e177"
format_stamp: "Formatted at 2026-08-11 16:41:56 on dist-test-slave-zj8q"
server_key: "a8e00d197d0a61895b044b7c978d68e1"
server_key_iv: "ecfb95594c09e00b032ed51819168a79"
server_key_version: "encryptionkey@0"
I20260811 16:41:56.456905 30693 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466249441839-25279-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466249441839-25279-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466249441839-25279-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:41:56.464563 30693 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:41:56.466547 30693 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:41:56.466668 30693 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:41:56.470657 30693 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.254:44233
I20260811 16:41:56.470700 30803 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.254:44233 every 8 connection(s)
I20260811 16:41:56.470993 30693 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
I20260811 16:41:56.471849 30804 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:41:56.473979 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 30693
I20260811 16:41:56.474102 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466249441839-25279-0/minicluster-data/master-0/wal/instance
I20260811 16:41:56.474098 30804 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a2ee9c4e9b6c40c28491482ce897e177: Bootstrap starting.
I20260811 16:41:56.474318 25279 external_mini_cluster.cc:1428] Setting key 82ca273357204ba3712e6156bda742cb
I20260811 16:41:56.474817 30804 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a2ee9c4e9b6c40c28491482ce897e177: Neither blocks nor log segments found. Creating new log.
I20260811 16:41:56.475113 30804 log.cc:824] T 00000000000000000000000000000000 P a2ee9c4e9b6c40c28491482ce897e177: Log is configured to *not* fsync() on all Append() calls
I20260811 16:41:56.475832 30804 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a2ee9c4e9b6c40c28491482ce897e177: No bootstrap required, opened a new log
I20260811 16:41:56.477399 30804 raft_consensus.cc:348] T 00000000000000000000000000000000 P a2ee9c4e9b6c40c28491482ce897e177 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2ee9c4e9b6c40c28491482ce897e177" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 44233 } }
I20260811 16:41:56.477540 30804 raft_consensus.cc:374] T 00000000000000000000000000000000 P a2ee9c4e9b6c40c28491482ce897e177 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:41:56.477560 30804 raft_consensus.cc:729] T 00000000000000000000000000000000 P a2ee9c4e9b6c40c28491482ce897e177 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2ee9c4e9b6c40c28491482ce897e177, State: Initialized, Role: FOLLOWER
I20260811 16:41:56.477676 30804 consensus_queue.cc:260] T 00000000000000000000000000000000 P a2ee9c4e9b6c40c28491482ce897e177 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2ee9c4e9b6c40c28491482ce897e177" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 44233 } }
I20260811 16:41:56.477739 30804 raft_consensus.cc:388] T 00000000000000000000000000000000 P a2ee9c4e9b6c40c28491482ce897e177 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:41:56.477761 30804 raft_consensus.cc:482] T 00000000000000000000000000000000 P a2ee9c4e9b6c40c28491482ce897e177 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:41:56.477806 30804 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a2ee9c4e9b6c40c28491482ce897e177 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:41:56.478399 30804 raft_consensus.cc:504] T 00000000000000000000000000000000 P a2ee9c4e9b6c40c28491482ce897e177 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2ee9c4e9b6c40c28491482ce897e177" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 44233 } }
I20260811 16:41:56.478511 30804 leader_election.cc:302] T 00000000000000000000000000000000 P a2ee9c4e9b6c40c28491482ce897e177 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a2ee9c4e9b6c40c28491482ce897e177; no voters:
I20260811 16:41:56.478677 30804 leader_election.cc:288] T 00000000000000000000000000000000 P a2ee9c4e9b6c40c28491482ce897e177 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:41:56.478703 30810 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a2ee9c4e9b6c40c28491482ce897e177 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:41:56.478879 30810 raft_consensus.cc:686] T 00000000000000000000000000000000 P a2ee9c4e9b6c40c28491482ce897e177 [term 1 LEADER]: Becoming Leader. State: Replica: a2ee9c4e9b6c40c28491482ce897e177, State: Running, Role: LEADER
I20260811 16:41:56.478909 30804 sys_catalog.cc:564] T 00000000000000000000000000000000 P a2ee9c4e9b6c40c28491482ce897e177 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:41:56.479027 30810 consensus_queue.cc:237] T 00000000000000000000000000000000 P a2ee9c4e9b6c40c28491482ce897e177 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2ee9c4e9b6c40c28491482ce897e177" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 44233 } }
I20260811 16:41:56.479346 30810 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2ee9c4e9b6c40c28491482ce897e177 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a2ee9c4e9b6c40c28491482ce897e177. Latest consensus state: current_term: 1 leader_uuid: "a2ee9c4e9b6c40c28491482ce897e177" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2ee9c4e9b6c40c28491482ce897e177" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 44233 } } }
I20260811 16:41:56.479475 30810 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2ee9c4e9b6c40c28491482ce897e177 [sys.catalog]: This master's current role is: LEADER
I20260811 16:41:56.479739 30821 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:41:56.480459 30821 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:41:56.481452 30812 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2ee9c4e9b6c40c28491482ce897e177 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a2ee9c4e9b6c40c28491482ce897e177" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2ee9c4e9b6c40c28491482ce897e177" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 44233 } } }
I20260811 16:41:56.481755 30812 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2ee9c4e9b6c40c28491482ce897e177 [sys.catalog]: This master's current role is: LEADER
Aug 11 16:41:56 dist-test-slave-zj8q krb5kdc[30672](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466516, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:41:56.482908 30821 catalog_manager.cc:1347] Generated new cluster ID: c02ea58a6a8e4f1cb700f41e8bb46972
I20260811 16:41:56.482963 30821 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:41:56.486279 30807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:56.474818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37753 (local address 127.24.175.254:44233)
0811 16:41:56.474999 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:56.475007 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:56.475031 (+ 24us) server_negotiation.cc:407] Connection header received
0811 16:41:56.475563 (+ 532us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:56.475571 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:56.475620 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:56.475734 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:41:56.476493 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:56.478086 (+ 1593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:56.479187 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:56.479801 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:56.479913 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:56.482482 (+ 2569us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:41:56.482487 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:41:56.482487 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:41:56.482499 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:41:56.484334 (+ 1835us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:41:56.484684 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:41:56.484687 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:41:56.484687 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:41:56.484792 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:41:56.484957 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:41:56.484957 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:41:56.484958 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:41:56.485219 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:41:56.485356 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:56.485785 (+ 429us) server_negotiation.cc:299] Negotiation successful
0811 16:41:56.485913 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":62,"threads_started":1}
I20260811 16:41:56.487092 25279 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:41:56.492483 30821 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:41:56.492944 30821 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:41:56.496166 30821 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a2ee9c4e9b6c40c28491482ce897e177: Generated new TSK 0
I20260811 16:41:56.496322 30821 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:41:56.499119 30807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:56.490456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48859 (local address 127.24.175.254:44233)
0811 16:41:56.490501 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:56.490502 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:56.492231 (+ 1729us) server_negotiation.cc:407] Connection header received
0811 16:41:56.492257 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:56.492258 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:56.492268 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:56.492312 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:41:56.493525 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:56.494239 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:56.495220 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:56.495539 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:56.495592 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:56.496894 (+ 1302us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:41:56.496895 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:41:56.496896 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:41:56.496901 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:41:56.498080 (+ 1179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:41:56.498462 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:41:56.498463 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:41:56.498463 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:41:56.498509 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:41:56.498722 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:41:56.498722 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:41:56.498722 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:41:56.498818 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:41:56.498885 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:56.499000 (+ 115us) server_negotiation.cc:299] Negotiation successful
0811 16:41:56.499065 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 16:41:56.501050 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 30693
2026-08-11T16:41:56Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1443 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466249441839-25279-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:41:56 dist-test-slave-zj8q krb5kdc[30853](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:41:56 dist-test-slave-zj8q krb5kdc[30853](info): set up 2 sockets
Aug 11 16:41:56 dist-test-slave-zj8q krb5kdc[30853](info): commencing operation
krb5kdc: starting...
W20260811 16:41:57.688359 25279 mini_kdc.cc:121] Time spent starting KDC: real 1.151s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Aug 11 16:41:57 dist-test-slave-zj8q krb5kdc[30853](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466517, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:41:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:41:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab.
Entry for principal kudu/127.24.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab.
I20260811 16:41:57.802639 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466249441839-25279-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466249441839-25279-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466249441839-25279-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:36855
--webserver_interface=127.24.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:39957
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.175.254:36855
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:41:57.882836 30878 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:41:57.883038 30878 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:41:57.883069 30878 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:41:57.884178 30878 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:41:57.884219 30878 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:41:57.884244 30878 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:41:57.884262 30878 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:41:57.884279 30878 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:41:57.885747 30878 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:39957
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466249441839-25279-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466249441839-25279-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.175.254:36855
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:36855
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30878
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466249441839-25279-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:41:57.885988 30878 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:41:57.886209 30878 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:41:57.890870 30888 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:41:57.890897 30891 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:41:57.890910 30889 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:57.890936 30878 server_base.cc:1034] running on GCE node
I20260811 16:41:57.891294 30878 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:41:57.891570 30878 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:41:57.892726 30878 hybrid_clock.cc:648] HybridClock initialized: now 1786466517892709 us; error 28 us; skew 500 ppm
Aug 11 16:41:57 dist-test-slave-zj8q krb5kdc[30853](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466517, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:41:57.898974 30878 init.cc:377] Logged in from keytab as kudu/127.24.175.254@KRBTEST.COM (short username kudu)
I20260811 16:41:57.899412 30878 webserver.cc:460] Webserver started at http://127.24.175.254:36159/ using document root <none> and password file <none>
I20260811 16:41:57.899636 30878 fs_manager.cc:359] Metadata directory not provided
I20260811 16:41:57.899688 30878 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:41:57.899813 30878 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:41:57.900833 30878 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466249441839-25279-0/minicluster-data/master-0/data/instance:
uuid: "c28faa3512814aa094dde27d40cb1738"
format_stamp: "Formatted at 2026-08-11 16:41:57 on dist-test-slave-zj8q"
server_key: "776846c4acbb492f05d2e6160fcfb533"
server_key_iv: "b7e0d95becdb4856aa3f04e3f34a521d"
server_key_version: "encryptionkey@0"
I20260811 16:41:57.901163 30878 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466249441839-25279-0/minicluster-data/master-0/wal/instance:
uuid: "c28faa3512814aa094dde27d40cb1738"
format_stamp: "Formatted at 2026-08-11 16:41:57 on dist-test-slave-zj8q"
server_key: "776846c4acbb492f05d2e6160fcfb533"
server_key_iv: "b7e0d95becdb4856aa3f04e3f34a521d"
server_key_version: "encryptionkey@0"
I20260811 16:41:57.902386 30878 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 16:41:57.903067 30903 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:57.903223 30878 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:57.903309 30878 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466249441839-25279-0/minicluster-data/master-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466249441839-25279-0/minicluster-data/master-0/wal
uuid: "c28faa3512814aa094dde27d40cb1738"
format_stamp: "Formatted at 2026-08-11 16:41:57 on dist-test-slave-zj8q"
server_key: "776846c4acbb492f05d2e6160fcfb533"
server_key_iv: "b7e0d95becdb4856aa3f04e3f34a521d"
server_key_version: "encryptionkey@0"
I20260811 16:41:57.903373 30878 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466249441839-25279-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466249441839-25279-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466249441839-25279-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:41:57.920608 30878 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:41:57.922784 30878 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:41:57.922919 30878 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:41:57.926826 30878 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.254:36855
I20260811 16:41:57.926867 30987 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.254:36855 every 8 connection(s)
I20260811 16:41:57.927197 30878 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
I20260811 16:41:57.928014 30988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:41:57.930276 30988 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c28faa3512814aa094dde27d40cb1738: Bootstrap starting.
I20260811 16:41:57.930845 30988 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c28faa3512814aa094dde27d40cb1738: Neither blocks nor log segments found. Creating new log.
I20260811 16:41:57.931107 30988 log.cc:824] T 00000000000000000000000000000000 P c28faa3512814aa094dde27d40cb1738: Log is configured to *not* fsync() on all Append() calls
I20260811 16:41:57.931747 30988 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c28faa3512814aa094dde27d40cb1738: No bootstrap required, opened a new log
I20260811 16:41:57.933318 30988 raft_consensus.cc:348] T 00000000000000000000000000000000 P c28faa3512814aa094dde27d40cb1738 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c28faa3512814aa094dde27d40cb1738" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 36855 } }
I20260811 16:41:57.933457 30988 raft_consensus.cc:374] T 00000000000000000000000000000000 P c28faa3512814aa094dde27d40cb1738 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:41:57.933490 30988 raft_consensus.cc:729] T 00000000000000000000000000000000 P c28faa3512814aa094dde27d40cb1738 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c28faa3512814aa094dde27d40cb1738, State: Initialized, Role: FOLLOWER
I20260811 16:41:57.933622 30988 consensus_queue.cc:260] T 00000000000000000000000000000000 P c28faa3512814aa094dde27d40cb1738 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c28faa3512814aa094dde27d40cb1738" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 36855 } }
I20260811 16:41:57.933701 30988 raft_consensus.cc:388] T 00000000000000000000000000000000 P c28faa3512814aa094dde27d40cb1738 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:41:57.933734 30988 raft_consensus.cc:482] T 00000000000000000000000000000000 P c28faa3512814aa094dde27d40cb1738 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:41:57.933781 30988 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c28faa3512814aa094dde27d40cb1738 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:41:57.934600 30988 raft_consensus.cc:504] T 00000000000000000000000000000000 P c28faa3512814aa094dde27d40cb1738 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c28faa3512814aa094dde27d40cb1738" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 36855 } }
I20260811 16:41:57.934700 30988 leader_election.cc:302] T 00000000000000000000000000000000 P c28faa3512814aa094dde27d40cb1738 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c28faa3512814aa094dde27d40cb1738; no voters:
I20260811 16:41:57.934870 30988 leader_election.cc:288] T 00000000000000000000000000000000 P c28faa3512814aa094dde27d40cb1738 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:41:57.934901 30992 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c28faa3512814aa094dde27d40cb1738 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:41:57.935051 30992 raft_consensus.cc:686] T 00000000000000000000000000000000 P c28faa3512814aa094dde27d40cb1738 [term 1 LEADER]: Becoming Leader. State: Replica: c28faa3512814aa094dde27d40cb1738, State: Running, Role: LEADER
I20260811 16:41:57.935115 30988 sys_catalog.cc:564] T 00000000000000000000000000000000 P c28faa3512814aa094dde27d40cb1738 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:41:57.935143 30992 consensus_queue.cc:237] T 00000000000000000000000000000000 P c28faa3512814aa094dde27d40cb1738 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c28faa3512814aa094dde27d40cb1738" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 36855 } }
I20260811 16:41:57.935475 30995 sys_catalog.cc:455] T 00000000000000000000000000000000 P c28faa3512814aa094dde27d40cb1738 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c28faa3512814aa094dde27d40cb1738. Latest consensus state: current_term: 1 leader_uuid: "c28faa3512814aa094dde27d40cb1738" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c28faa3512814aa094dde27d40cb1738" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 36855 } } }
I20260811 16:41:57.935572 30995 sys_catalog.cc:458] T 00000000000000000000000000000000 P c28faa3512814aa094dde27d40cb1738 [sys.catalog]: This master's current role is: LEADER
I20260811 16:41:57.935474 30994 sys_catalog.cc:455] T 00000000000000000000000000000000 P c28faa3512814aa094dde27d40cb1738 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c28faa3512814aa094dde27d40cb1738" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c28faa3512814aa094dde27d40cb1738" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 36855 } } }
I20260811 16:41:57.935715 30994 sys_catalog.cc:458] T 00000000000000000000000000000000 P c28faa3512814aa094dde27d40cb1738 [sys.catalog]: This master's current role is: LEADER
I20260811 16:41:57.935817 31003 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:41:57.936494 31003 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:41:57.937193 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 30878
I20260811 16:41:57.937318 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466249441839-25279-0/minicluster-data/master-0/wal/instance
I20260811 16:41:57.937522 25279 external_mini_cluster.cc:1428] Setting key 5d426cee869163052ff8cc3c25e59f19
I20260811 16:41:57.938689 31003 catalog_manager.cc:1347] Generated new cluster ID: 815b504aa738472abee297b2b725115a
I20260811 16:41:57.938735 31003 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:41:57.943928 31023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:57.937982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39757 (local address 127.24.175.254:36855)
0811 16:41:57.938741 (+ 759us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:57.938749 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:57.938780 (+ 31us) server_negotiation.cc:407] Connection header received
0811 16:41:57.938895 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:57.938902 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:57.938956 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:57.939088 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:41:57.939334 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:57.940750 (+ 1416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:57.941804 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:57.942462 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:57.942915 (+ 453us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:57.943243 (+ 328us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:41:57.943248 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:41:57.943248 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:41:57.943440 (+ 192us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:41:57.943482 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:41:57.943497 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:41:57.943557 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:57.943663 (+ 106us) server_negotiation.cc:299] Negotiation successful
0811 16:41:57.943723 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":718,"thread_start_us":68,"threads_started":1}
I20260811 16:41:57.944790 25279 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:41:57.945020 31003 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:41:57.945494 31003 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:41:57.948449 31003 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c28faa3512814aa094dde27d40cb1738: Generated new TSK 0
I20260811 16:41:57.948596 31003 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:41:57.949710 31023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:57.946303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60351 (local address 127.24.175.254:36855)
0811 16:41:57.946338 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:57.946340 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:57.946453 (+ 113us) server_negotiation.cc:407] Connection header received
0811 16:41:57.946537 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:57.946538 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:57.946547 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:57.946574 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:41:57.946752 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:57.947498 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:57.948602 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:41:57.948909 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:41:57.948947 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:41:57.949524 (+ 577us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:41:57.949525 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:41:57.949525 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:41:57.949529 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:41:57.949541 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:41:57.949545 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:41:57.949582 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:57.949640 (+ 58us) server_negotiation.cc:299] Negotiation successful
0811 16:41:57.949661 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 16:41:57.951370 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 30878
2026-08-11T16:41:57Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1448 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466249441839-25279-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:41:58 dist-test-slave-zj8q krb5kdc[31033](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:41:58 dist-test-slave-zj8q krb5kdc[31033](info): set up 2 sockets
Aug 11 16:41:58 dist-test-slave-zj8q krb5kdc[31033](info): commencing operation
krb5kdc: starting...
W20260811 16:41:59.132812 25279 mini_kdc.cc:121] Time spent starting KDC: real 1.147s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Aug 11 16:41:59 dist-test-slave-zj8q krb5kdc[31033](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466519, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:41:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:41:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab.
Entry for principal kudu/127.24.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab.
I20260811 16:41:59.253002 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466249441839-25279-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466249441839-25279-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466249441839-25279-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:36369
--webserver_interface=127.24.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:33281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.175.254:36369
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:41:59.335098 31054 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:41:59.335317 31054 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:41:59.335341 31054 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:41:59.336452 31054 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:41:59.336488 31054 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:41:59.336500 31054 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:41:59.336511 31054 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:41:59.336525 31054 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:41:59.338012 31054 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:33281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466249441839-25279-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466249441839-25279-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.175.254:36369
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:36369
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31054
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466249441839-25279-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:41:59.338279 31054 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:41:59.338470 31054 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:41:59.343218 31068 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:41:59.343245 31064 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:59.343299 31054 server_base.cc:1034] running on GCE node
W20260811 16:41:59.343217 31063 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:41:59.343688 31054 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:41:59.343986 31054 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:41:59.345136 31054 hybrid_clock.cc:648] HybridClock initialized: now 1786466519345119 us; error 31 us; skew 500 ppm
Aug 11 16:41:59 dist-test-slave-zj8q krb5kdc[31033](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466519, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:41:59.347602 31054 init.cc:377] Logged in from keytab as kudu/127.24.175.254@KRBTEST.COM (short username kudu)
I20260811 16:41:59.348031 31054 webserver.cc:460] Webserver started at http://127.24.175.254:39073/ using document root <none> and password file <none>
I20260811 16:41:59.348223 31054 fs_manager.cc:359] Metadata directory not provided
I20260811 16:41:59.348268 31054 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:41:59.348383 31054 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:41:59.349408 31054 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466249441839-25279-0/minicluster-data/master-0/data/instance:
uuid: "4a037026b1f6496680e4a144eba43733"
format_stamp: "Formatted at 2026-08-11 16:41:59 on dist-test-slave-zj8q"
server_key: "189fd2065183a416b81fb5534867b67a"
server_key_iv: "c2d8d0020dda466a8a36b204dc79dfd2"
server_key_version: "encryptionkey@0"
I20260811 16:41:59.349746 31054 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466249441839-25279-0/minicluster-data/master-0/wal/instance:
uuid: "4a037026b1f6496680e4a144eba43733"
format_stamp: "Formatted at 2026-08-11 16:41:59 on dist-test-slave-zj8q"
server_key: "189fd2065183a416b81fb5534867b67a"
server_key_iv: "c2d8d0020dda466a8a36b204dc79dfd2"
server_key_version: "encryptionkey@0"
I20260811 16:41:59.351040 31054 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:41:59.351704 31080 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:41:59.351853 31054 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:41:59.351934 31054 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466249441839-25279-0/minicluster-data/master-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466249441839-25279-0/minicluster-data/master-0/wal
uuid: "4a037026b1f6496680e4a144eba43733"
format_stamp: "Formatted at 2026-08-11 16:41:59 on dist-test-slave-zj8q"
server_key: "189fd2065183a416b81fb5534867b67a"
server_key_iv: "c2d8d0020dda466a8a36b204dc79dfd2"
server_key_version: "encryptionkey@0"
I20260811 16:41:59.351997 31054 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466249441839-25279-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466249441839-25279-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466249441839-25279-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:41:59.355234 31054 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:41:59.357281 31054 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:41:59.357409 31054 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:41:59.361227 31054 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.254:36369
I20260811 16:41:59.361258 31164 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.254:36369 every 8 connection(s)
I20260811 16:41:59.361557 31054 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
I20260811 16:41:59.362578 31167 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:41:59.364863 31167 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a037026b1f6496680e4a144eba43733: Bootstrap starting.
I20260811 16:41:59.365437 31167 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4a037026b1f6496680e4a144eba43733: Neither blocks nor log segments found. Creating new log.
I20260811 16:41:59.365741 31167 log.cc:824] T 00000000000000000000000000000000 P 4a037026b1f6496680e4a144eba43733: Log is configured to *not* fsync() on all Append() calls
I20260811 16:41:59.366415 31167 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a037026b1f6496680e4a144eba43733: No bootstrap required, opened a new log
I20260811 16:41:59.367843 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 31054
I20260811 16:41:59.367962 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466249441839-25279-0/minicluster-data/master-0/wal/instance
I20260811 16:41:59.368152 25279 external_mini_cluster.cc:1428] Setting key 32b5f82c7ba98e3c92359f79624d9c50
I20260811 16:41:59.368188 31167 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4a037026b1f6496680e4a144eba43733 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a037026b1f6496680e4a144eba43733" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 36369 } }
I20260811 16:41:59.368362 31167 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4a037026b1f6496680e4a144eba43733 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:41:59.368400 31167 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4a037026b1f6496680e4a144eba43733 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a037026b1f6496680e4a144eba43733, State: Initialized, Role: FOLLOWER
I20260811 16:41:59.368546 31167 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4a037026b1f6496680e4a144eba43733 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a037026b1f6496680e4a144eba43733" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 36369 } }
I20260811 16:41:59.368631 31167 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4a037026b1f6496680e4a144eba43733 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:41:59.368695 31167 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4a037026b1f6496680e4a144eba43733 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:41:59.368752 31167 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4a037026b1f6496680e4a144eba43733 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:41:59.369694 31167 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4a037026b1f6496680e4a144eba43733 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a037026b1f6496680e4a144eba43733" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 36369 } }
I20260811 16:41:59.369817 31167 leader_election.cc:302] T 00000000000000000000000000000000 P 4a037026b1f6496680e4a144eba43733 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4a037026b1f6496680e4a144eba43733; no voters:
I20260811 16:41:59.369983 31167 leader_election.cc:288] T 00000000000000000000000000000000 P 4a037026b1f6496680e4a144eba43733 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:41:59.370008 31174 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4a037026b1f6496680e4a144eba43733 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:41:59.370263 31174 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4a037026b1f6496680e4a144eba43733 [term 1 LEADER]: Becoming Leader. State: Replica: 4a037026b1f6496680e4a144eba43733, State: Running, Role: LEADER
I20260811 16:41:59.370332 31167 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4a037026b1f6496680e4a144eba43733 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:41:59.370405 31174 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4a037026b1f6496680e4a144eba43733 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a037026b1f6496680e4a144eba43733" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 36369 } }
I20260811 16:41:59.370481 31173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:59.368635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42953 (local address 127.24.175.254:36369)
0811 16:41:59.368848 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:59.368857 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:59.368891 (+ 34us) server_negotiation.cc:407] Connection header received
0811 16:41:59.368998 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:59.369004 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:59.369047 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:59.369158 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:41:59.369830 (+ 672us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:41:59.369834 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:41:59.369834 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:41:59.369839 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:41:59.369879 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:41:59.369890 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:41:59.369951 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:59.370056 (+ 105us) server_negotiation.cc:299] Negotiation successful
0811 16:41:59.370279 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":91,"threads_started":1}
I20260811 16:41:59.370774 31174 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a037026b1f6496680e4a144eba43733 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4a037026b1f6496680e4a144eba43733. Latest consensus state: current_term: 1 leader_uuid: "4a037026b1f6496680e4a144eba43733" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a037026b1f6496680e4a144eba43733" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 36369 } } }
I20260811 16:41:59.370847 31174 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a037026b1f6496680e4a144eba43733 [sys.catalog]: This master's current role is: LEADER
I20260811 16:41:59.371032 31175 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a037026b1f6496680e4a144eba43733 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4a037026b1f6496680e4a144eba43733" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a037026b1f6496680e4a144eba43733" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 36369 } } }
I20260811 16:41:59.371096 31175 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a037026b1f6496680e4a144eba43733 [sys.catalog]: This master's current role is: LEADER
I20260811 16:41:59.371449 25279 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:41:59.371376 31184 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:41:59.373251 31184 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:41:59.374323 31173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:41:59.372808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38179 (local address 127.24.175.254:36369)
0811 16:41:59.372847 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 16:41:59.372849 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:41:59.372994 (+ 145us) server_negotiation.cc:407] Connection header received
0811 16:41:59.373040 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:41:59.373041 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:41:59.373049 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:41:59.373096 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:41:59.373681 (+ 585us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:41:59.373682 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:41:59.373683 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:41:59.373687 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:41:59.373702 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:41:59.373707 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:41:59.373771 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 16:41:59.374252 (+ 481us) server_negotiation.cc:299] Negotiation successful
0811 16:41:59.374267 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 16:41:59.378561 31184 catalog_manager.cc:1347] Generated new cluster ID: 864cd22dedd545d39192c88750ab48f8
I20260811 16:41:59.378628 31184 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:41:59.402817 31184 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:41:59.403008 31184 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:41:59.411758 31184 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4a037026b1f6496680e4a144eba43733: Generated new TSK 0
I20260811 16:41:59.411948 31184 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:41:59.417483 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 31054
2026-08-11T16:41:59Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1460 ms)
[----------] 18 tests from AuthTokenIssuingTest (26232 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:41:59 dist-test-slave-zj8q krb5kdc[31213](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:41:59 dist-test-slave-zj8q krb5kdc[31213](info): set up 2 sockets
Aug 11 16:41:59 dist-test-slave-zj8q krb5kdc[31213](info): commencing operation
krb5kdc: starting...
W20260811 16:42:00.595865 25279 mini_kdc.cc:121] Time spent starting KDC: real 1.149s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Aug 11 16:42:00 dist-test-slave-zj8q krb5kdc[31213](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466520, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:42:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:42:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab.
Entry for principal kudu/127.24.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab.
I20260811 16:42:00.712772 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:36107
--webserver_interface=127.24.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:39457
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.175.254:36107,127.24.175.253:42783,127.24.175.252:34585
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:42:00.793582 31233 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 16:42:00.793790 31233 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:00.793808 31233 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:00.793826 31233 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:00.794976 31233 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:42:00.795017 31233 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:00.795030 31233 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:00.795048 31233 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:42:00.795059 31233 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:42:00.796504 31233 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:39457
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.175.254:36107,127.24.175.253:42783,127.24.175.252:34585
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:36107
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31233
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:00.796693 31233 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:00.796875 31233 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:42:00.801432 31242 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:00.801466 31239 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:00.801448 31240 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:00.801654 31233 server_base.cc:1034] running on GCE node
I20260811 16:42:00.801926 31233 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:00.802206 31233 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:00.803351 31233 hybrid_clock.cc:648] HybridClock initialized: now 1786466520803332 us; error 34 us; skew 500 ppm
Aug 11 16:42:00 dist-test-slave-zj8q krb5kdc[31213](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466520, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:00.805760 31233 init.cc:377] Logged in from keytab as kudu/127.24.175.254@KRBTEST.COM (short username kudu)
I20260811 16:42:00.806192 31233 webserver.cc:460] Webserver started at http://127.24.175.254:45905/ using document root <none> and password file <none>
I20260811 16:42:00.806419 31233 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:00.806468 31233 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:00.806600 31233 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:42:00.807636 31233 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/minicluster-data/master-0/data/instance:
uuid: "c00af56add6b4631a694ee75fe23d50d"
format_stamp: "Formatted at 2026-08-11 16:42:00 on dist-test-slave-zj8q"
server_key: "844812a5fbc9428b5cd70584a9a29223"
server_key_iv: "9da3c50833b1fc34e5c3c02eed1db954"
server_key_version: "encryptionkey@0"
I20260811 16:42:00.807934 31233 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/minicluster-data/master-0/wal/instance:
uuid: "c00af56add6b4631a694ee75fe23d50d"
format_stamp: "Formatted at 2026-08-11 16:42:00 on dist-test-slave-zj8q"
server_key: "844812a5fbc9428b5cd70584a9a29223"
server_key_iv: "9da3c50833b1fc34e5c3c02eed1db954"
server_key_version: "encryptionkey@0"
I20260811 16:42:00.809099 31233 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 16:42:00.809708 31255 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:00.809864 31233 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:00.809950 31233 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/minicluster-data/master-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/minicluster-data/master-0/wal
uuid: "c00af56add6b4631a694ee75fe23d50d"
format_stamp: "Formatted at 2026-08-11 16:42:00 on dist-test-slave-zj8q"
server_key: "844812a5fbc9428b5cd70584a9a29223"
server_key_iv: "9da3c50833b1fc34e5c3c02eed1db954"
server_key_version: "encryptionkey@0"
I20260811 16:42:00.810019 31233 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:00.822640 31233 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:00.824719 31233 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:00.824872 31233 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:00.828716 31233 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.254:36107
I20260811 16:42:00.828764 31342 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.254:36107 every 8 connection(s)
I20260811 16:42:00.829085 31233 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
I20260811 16:42:00.829967 31344 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:00.831503 31344 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.175.254" port: 36107 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 16:42:00 dist-test-slave-zj8q krb5kdc[31213](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466520, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.254@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:42:00.837131 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 31233
I20260811 16:42:00.837234 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/minicluster-data/master-0/wal/instance
I20260811 16:42:00.837415 25279 external_mini_cluster.cc:1428] Setting key ae62388fd1e368a176fd2fae8388b809
I20260811 16:42:00.840492 31347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:00.832100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:36107 (local address 127.0.0.1:36656)
0811 16:42:00.832277 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:00.832319 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:00.832793 (+ 474us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:00.833060 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:00.833062 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:00.833315 (+ 253us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:00.833466 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:00.833471 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:00.834498 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:00.834499 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:00.835157 (+ 658us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:00.835159 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:00.835604 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:00.835605 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:00.835673 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:00.836071 (+ 398us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:00.836080 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:00.837503 (+ 1423us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:00.839161 (+ 1658us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:00.839167 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:00.839169 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:00.839352 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:00.839556 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:00.839557 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:00.839557 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:00.839640 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:00.839955 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:00.839960 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:00.840022 (+ 62us) client_negotiation.cc:769] Sending connection context
0811 16:42:00.840100 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 16:42:00.840333 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"mutex_wait_us":98,"thread_start_us":83,"threads_started":1}
I20260811 16:42:00.840499 31350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:00.832161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36656 (local address 127.24.175.254:36107)
0811 16:42:00.832289 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:00.832299 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:00.832405 (+ 106us) server_negotiation.cc:407] Connection header received
0811 16:42:00.832944 (+ 539us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:00.832947 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:00.832963 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:00.833039 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:00.833558 (+ 519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:00.834413 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:00.835235 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:00.835532 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:00.835637 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:00.837589 (+ 1952us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:00.837596 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:00.837597 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:00.837603 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:00.839072 (+ 1469us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:00.839422 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:00.839425 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:00.839425 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:00.839503 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:00.839692 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:00.839693 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:00.839693 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:00.839896 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:00.839965 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:00.840143 (+ 178us) server_negotiation.cc:299] Negotiation successful
0811 16:42:00.840259 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98,"thread_start_us":64,"threads_started":1}
I20260811 16:42:00.841481 31344 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.175.253" port: 42783 } has no permanent_uuid. Determining permanent_uuid...
I20260811 16:42:00.841830 31347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:00.841694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.253:42783 (local address 127.0.0.1:35820)
0811 16:42:00.841748 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:00.841805 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.253:42783: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260811 16:42:00.841985 31256 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.24.175.253:42783: connect: Connection refused (error 111)
I20260811 16:42:00.842399 31347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:00.842302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.253:42783 (local address 127.0.0.1:35832)
0811 16:42:00.842347 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:00.842377 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.253:42783: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260811 16:42:00.842500 31344 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.175.253:42783: Network error: Client connection negotiation failed: client connection to 127.24.175.253:42783: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.24.175.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.253.keytab.
Entry for principal kudu/127.24.175.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.253.keytab.
I20260811 16:42:00.861977 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.253:42783
--webserver_interface=127.24.175.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.253.keytab
--principal=kudu/127.24.175.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:39457
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.175.254:36107,127.24.175.253:42783,127.24.175.252:34585
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 16:42:00.891726 31344 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.175.253" port: 42783 } attempt: 1
I20260811 16:42:00.892270 31347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:00.892109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.253:42783 (local address 127.0.0.1:35844)
0811 16:42:00.892176 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:00.892228 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.253:42783: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260811 16:42:00.892629 31347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:00.892534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.253:42783 (local address 127.0.0.1:35846)
0811 16:42:00.892577 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:00.892606 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.253:42783: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260811 16:42:00.892725 31344 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.175.253:42783: Network error: Client connection negotiation failed: client connection to 127.24.175.253:42783: connect: Connection refused (error 111)
W20260811 16:42:00.943298 31359 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 16:42:00.943495 31359 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:00.943511 31359 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:00.943531 31359 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:00.944670 31359 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:42:00.944708 31359 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:00.944721 31359 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:00.944732 31359 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:42:00.944746 31359 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:42:00.946298 31359 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:39457
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.24.175.254:36107,127.24.175.253:42783,127.24.175.252:34585
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.253.keytab
--principal=kudu/127.24.175.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.253:42783
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.24.175.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31359
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:00.946539 31359 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:00.946756 31359 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:42:00.951452 31367 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:00.951449 31365 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:00.951453 31369 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:00.951541 31359 server_base.cc:1034] running on GCE node
I20260811 16:42:00.951860 31359 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:00.952142 31359 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:00.953289 31359 hybrid_clock.cc:648] HybridClock initialized: now 1786466520953270 us; error 33 us; skew 500 ppm
Aug 11 16:42:00 dist-test-slave-zj8q krb5kdc[31213](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466520, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:00.955629 31359 init.cc:377] Logged in from keytab as kudu/127.24.175.253@KRBTEST.COM (short username kudu)
I20260811 16:42:00.956030 31359 webserver.cc:460] Webserver started at http://127.24.175.253:34813/ using document root <none> and password file <none>
I20260811 16:42:00.956247 31359 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:00.956297 31359 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:00.956422 31359 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:42:00.957424 31359 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/minicluster-data/master-1/data/instance:
uuid: "909510febc644080b6adca7bc9e20cfc"
format_stamp: "Formatted at 2026-08-11 16:42:00 on dist-test-slave-zj8q"
server_key: "11e0c8dc5ddf30ba2932567e8b65a758"
server_key_iv: "dd8b9bf92c395ab0dd462cae7888179d"
server_key_version: "encryptionkey@0"
I20260811 16:42:00.957762 31359 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/minicluster-data/master-1/wal/instance:
uuid: "909510febc644080b6adca7bc9e20cfc"
format_stamp: "Formatted at 2026-08-11 16:42:00 on dist-test-slave-zj8q"
server_key: "11e0c8dc5ddf30ba2932567e8b65a758"
server_key_iv: "dd8b9bf92c395ab0dd462cae7888179d"
server_key_version: "encryptionkey@0"
I20260811 16:42:00.959035 31359 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 16:42:00.959662 31385 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:00.959808 31359 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 16:42:00.959884 31359 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/minicluster-data/master-1/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/minicluster-data/master-1/wal
uuid: "909510febc644080b6adca7bc9e20cfc"
format_stamp: "Formatted at 2026-08-11 16:42:00 on dist-test-slave-zj8q"
server_key: "11e0c8dc5ddf30ba2932567e8b65a758"
server_key_iv: "dd8b9bf92c395ab0dd462cae7888179d"
server_key_version: "encryptionkey@0"
I20260811 16:42:00.959946 31359 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:00.960892 31344 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.175.253" port: 42783 } attempt: 2
I20260811 16:42:00.961254 31347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:00.961133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.253:42783 (local address 127.0.0.1:35852)
0811 16:42:00.961185 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:00.961221 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.253:42783: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260811 16:42:00.961514 31347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:00.961461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.253:42783 (local address 127.0.0.1:35866)
0811 16:42:00.961482 (+ 21us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:00.961502 (+ 20us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.253:42783: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":12}
W20260811 16:42:00.961603 31344 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.175.253:42783: Network error: Client connection negotiation failed: client connection to 127.24.175.253:42783: connect: Connection refused (error 111)
I20260811 16:42:00.967836 31359 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:00.969458 31359 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:00.969585 31359 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:00.973388 31359 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.253:42783
I20260811 16:42:00.973418 31466 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.253:42783 every 8 connection(s)
I20260811 16:42:00.973726 31359 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/minicluster-data/master-1/data/info.pb
I20260811 16:42:00.974583 31467 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:00.976058 31467 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.175.254" port: 36107 } has no permanent_uuid. Determining permanent_uuid...
I20260811 16:42:00.976820 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 31359
I20260811 16:42:00.976922 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/minicluster-data/master-1/wal/instance
I20260811 16:42:00.977089 25279 external_mini_cluster.cc:1428] Setting key 3bcae2f677f51a9003187c54a14f8d72
Aug 11 16:42:00 dist-test-slave-zj8q krb5kdc[31213](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466520, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.253@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:42:00.984560 31350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:00.976889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36660 (local address 127.24.175.254:36107)
0811 16:42:00.976940 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:00.976941 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:00.976953 (+ 12us) server_negotiation.cc:407] Connection header received
0811 16:42:00.977487 (+ 534us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:00.977488 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:00.977501 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:00.977562 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:00.978141 (+ 579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:00.978844 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:00.979804 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:00.980014 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:00.980070 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:00.982034 (+ 1964us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:00.982036 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:00.982036 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:00.982043 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:00.983347 (+ 1304us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:00.983700 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:00.983701 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:00.983702 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:00.983760 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:00.983968 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:00.983969 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:00.983969 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:00.984081 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:00.984135 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:00.984387 (+ 252us) server_negotiation.cc:299] Negotiation successful
0811 16:42:00.984469 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
WARNING: no policy specified for kudu/127.24.175.252@KRBTEST.COM; defaulting to no policy
I20260811 16:42:00.984714 31473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:00.976654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:36107 (local address 127.0.0.1:36660)
0811 16:42:00.976818 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:00.976857 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:00.977388 (+ 531us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:00.977622 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:00.977625 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:00.977868 (+ 243us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:00.978059 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:00.978063 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:00.978937 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:00.978939 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:00.979713 (+ 774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:00.979715 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:00.980082 (+ 367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:00.980083 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:00.980205 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:00.980668 (+ 463us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:00.980676 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:00.981951 (+ 1275us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:00.983418 (+ 1467us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:00.983425 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:00.983427 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:00.983635 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:00.983811 (+ 176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:00.983812 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:00.983813 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:00.983915 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:00.984132 (+ 217us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:00.984139 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:00.984272 (+ 133us) client_negotiation.cc:769] Sending connection context
0811 16:42:00.984360 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 16:42:00.984508 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":75,"threads_started":1}
I20260811 16:42:00.985311 31467 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.175.253" port: 42783 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.252@KRBTEST.COM" created.
Aug 11 16:42:00 dist-test-slave-zj8q krb5kdc[31213](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466520, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.253@KRBTEST.COM for kudu/127.24.175.253@KRBTEST.COM
I20260811 16:42:00.991801 31473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:00.985546 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.253:42783 (local address 127.0.0.1:35872)
0811 16:42:00.985598 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:00.985610 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:00.985656 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:00.985929 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:00.985930 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:00.986037 (+ 107us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:00.986085 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:00.986086 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:00.986912 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:00.986913 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:00.987460 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:00.987462 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:00.988004 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:00.988005 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:00.988065 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:00.988400 (+ 335us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:00.988404 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:00.989428 (+ 1024us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:00.990892 (+ 1464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:00.990893 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:00.990894 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:00.991039 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:00.991205 (+ 166us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:00.991205 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:00.991206 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:00.991258 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:00.991491 (+ 233us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:00.991491 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:00.991529 (+ 38us) client_negotiation.cc:769] Sending connection context
0811 16:42:00.991594 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 16:42:00.991685 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260811 16:42:00.991942 31477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:00.985656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35872 (local address 127.24.175.253:42783)
0811 16:42:00.985803 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:00.985807 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:00.985824 (+ 17us) server_negotiation.cc:407] Connection header received
0811 16:42:00.985842 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:00.985844 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:00.985854 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:00.985911 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:00.986140 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:00.986832 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:00.987529 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:00.987932 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:00.987994 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:00.989498 (+ 1504us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:00.989506 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:00.989507 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:00.989513 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:00.990823 (+ 1310us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:00.991103 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:00.991106 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:00.991106 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:00.991155 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:00.991304 (+ 149us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:00.991305 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:00.991305 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:00.991435 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:00.991502 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:00.991624 (+ 122us) server_negotiation.cc:299] Negotiation successful
0811 16:42:00.991737 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":48,"server-negotiator.queue_time_us":121,"thread_start_us":86,"threads_started":1}
I20260811 16:42:00.992520 31467 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.175.252" port: 34585 } has no permanent_uuid. Determining permanent_uuid...
I20260811 16:42:00.992836 31473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:00.992734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.252:34585 (local address 127.0.0.1:37100)
0811 16:42:00.992772 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:00.992815 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.252:34585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260811 16:42:00.992975 31389 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.24.175.252:34585: connect: Connection refused (error 111)
I20260811 16:42:00.993386 31473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:00.993307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.252:34585 (local address 127.0.0.1:37114)
0811 16:42:00.993346 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:00.993369 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.252:34585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260811 16:42:00.993487 31467 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.175.252:34585: Network error: Client connection negotiation failed: client connection to 127.24.175.252:34585: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.252.keytab.
Entry for principal kudu/127.24.175.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.252.keytab.
I20260811 16:42:01.000622 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.252:34585
--webserver_interface=127.24.175.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.252.keytab
--principal=kudu/127.24.175.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:39457
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.175.254:36107,127.24.175.253:42783,127.24.175.252:34585
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 16:42:01.042714 31467 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.175.252" port: 34585 } attempt: 1
I20260811 16:42:01.043286 31473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:01.043135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.252:34585 (local address 127.0.0.1:37116)
0811 16:42:01.043206 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:01.043251 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.252:34585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260811 16:42:01.043638 31473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:01.043541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.252:34585 (local address 127.0.0.1:37118)
0811 16:42:01.043587 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:01.043616 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.252:34585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260811 16:42:01.043735 31467 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.175.252:34585: Network error: Client connection negotiation failed: client connection to 127.24.175.252:34585: connect: Connection refused (error 111)
I20260811 16:42:01.052759 31344 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.175.253" port: 42783 } attempt: 3
Aug 11 16:42:01 dist-test-slave-zj8q krb5kdc[31213](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466520, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.254@KRBTEST.COM for kudu/127.24.175.253@KRBTEST.COM
I20260811 16:42:01.059852 31477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:01.053206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35888 (local address 127.24.175.253:42783)
0811 16:42:01.053275 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:01.053277 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:01.053289 (+ 12us) server_negotiation.cc:407] Connection header received
0811 16:42:01.053327 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:01.053328 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:01.053342 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:01.053407 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:01.053701 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:01.054542 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:01.055221 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:01.055568 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:01.055638 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:01.057535 (+ 1897us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:01.057537 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:01.057538 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:01.057544 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:01.058852 (+ 1308us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:01.059217 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:01.059218 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:01.059218 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:01.059272 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:01.059440 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:01.059441 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:01.059441 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:01.059537 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:01.059581 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:01.059720 (+ 139us) server_negotiation.cc:299] Negotiation successful
0811 16:42:01.059784 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 16:42:01.059909 31347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:01.053154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.253:42783 (local address 127.0.0.1:35888)
0811 16:42:01.053205 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:01.053217 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:01.053282 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:01.053412 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:01.053413 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:01.053567 (+ 154us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:01.053637 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:01.053639 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:01.054611 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:01.054612 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:01.055148 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:01.055150 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:01.055631 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:01.055632 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:01.055680 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:01.056125 (+ 445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:01.056129 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:01.057424 (+ 1295us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:01.058930 (+ 1506us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:01.058931 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:01.058932 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:01.059153 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:01.059322 (+ 169us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:01.059322 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:01.059323 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:01.059387 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:01.059584 (+ 197us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:01.059585 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:01.059637 (+ 52us) client_negotiation.cc:769] Sending connection context
0811 16:42:01.059701 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 16:42:01.059814 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23}
I20260811 16:42:01.060330 31344 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.175.252" port: 34585 } has no permanent_uuid. Determining permanent_uuid...
I20260811 16:42:01.060665 31347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:01.060567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.252:34585 (local address 127.0.0.1:37134)
0811 16:42:01.060612 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:01.060643 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.252:34585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260811 16:42:01.060941 31347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:01.060870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.252:34585 (local address 127.0.0.1:37146)
0811 16:42:01.060903 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:01.060925 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.252:34585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260811 16:42:01.061024 31344 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.175.252:34585: Network error: Client connection negotiation failed: client connection to 127.24.175.252:34585: connect: Connection refused (error 111)
W20260811 16:42:01.084712 31484 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 16:42:01.084915 31484 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:01.084931 31484 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:01.084961 31484 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:01.086112 31484 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:42:01.086176 31484 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:01.086206 31484 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:01.086229 31484 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:42:01.086252 31484 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:42:01.087711 31484 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:39457
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.24.175.254:36107,127.24.175.253:42783,127.24.175.252:34585
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.252.keytab
--principal=kudu/127.24.175.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.252:34585
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.24.175.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31484
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:01.087939 31484 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:01.088145 31484 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 16:42:01.092160 31344 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.175.252" port: 34585 } attempt: 1
I20260811 16:42:01.092732 31347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:01.092558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.252:34585 (local address 127.0.0.1:37158)
0811 16:42:01.092670 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:01.092702 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.252:34585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
W20260811 16:42:01.093065 31497 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:01.093041 31498 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:01.093128 31347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:01.093015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.252:34585 (local address 127.0.0.1:37160)
0811 16:42:01.093083 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:01.093105 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.252:34585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260811 16:42:01.093276 31502 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:01.093237 31344 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.175.252:34585: Network error: Client connection negotiation failed: client connection to 127.24.175.252:34585: connect: Connection refused (error 111)
I20260811 16:42:01.093568 31484 server_base.cc:1034] running on GCE node
I20260811 16:42:01.093837 31484 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:01.094094 31484 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:01.095232 31484 hybrid_clock.cc:648] HybridClock initialized: now 1786466521095217 us; error 29 us; skew 500 ppm
Aug 11 16:42:01 dist-test-slave-zj8q krb5kdc[31213](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466521, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:01.097520 31484 init.cc:377] Logged in from keytab as kudu/127.24.175.252@KRBTEST.COM (short username kudu)
I20260811 16:42:01.097904 31484 webserver.cc:460] Webserver started at http://127.24.175.252:45489/ using document root <none> and password file <none>
I20260811 16:42:01.098074 31484 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:01.098112 31484 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:01.098238 31484 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:42:01.099231 31484 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/minicluster-data/master-2/data/instance:
uuid: "ab6d0861bb1949959cc99fcc877a760e"
format_stamp: "Formatted at 2026-08-11 16:42:01 on dist-test-slave-zj8q"
server_key: "824f9ddd947bd060e0395d506d691c22"
server_key_iv: "5fc3cc2000415148b37c5e5b83ea564b"
server_key_version: "encryptionkey@0"
I20260811 16:42:01.099519 31484 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/minicluster-data/master-2/wal/instance:
uuid: "ab6d0861bb1949959cc99fcc877a760e"
format_stamp: "Formatted at 2026-08-11 16:42:01 on dist-test-slave-zj8q"
server_key: "824f9ddd947bd060e0395d506d691c22"
server_key_iv: "5fc3cc2000415148b37c5e5b83ea564b"
server_key_version: "encryptionkey@0"
I20260811 16:42:01.100666 31484 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:42:01.101280 31518 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:01.101424 31484 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:42:01.101500 31484 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/minicluster-data/master-2/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/minicluster-data/master-2/wal
uuid: "ab6d0861bb1949959cc99fcc877a760e"
format_stamp: "Formatted at 2026-08-11 16:42:01 on dist-test-slave-zj8q"
server_key: "824f9ddd947bd060e0395d506d691c22"
server_key_iv: "5fc3cc2000415148b37c5e5b83ea564b"
server_key_version: "encryptionkey@0"
I20260811 16:42:01.101568 31484 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:01.111913 31467 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.175.252" port: 34585 } attempt: 2
I20260811 16:42:01.112311 31473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:01.112184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.252:34585 (local address 127.0.0.1:37166)
0811 16:42:01.112239 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:01.112281 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.252:34585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260811 16:42:01.112658 31473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:01.112555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.252:34585 (local address 127.0.0.1:37182)
0811 16:42:01.112598 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:01.112630 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.252:34585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260811 16:42:01.112771 31467 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.175.252:34585: Network error: Client connection negotiation failed: client connection to 127.24.175.252:34585: connect: Connection refused (error 111)
I20260811 16:42:01.118852 31484 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:01.120949 31484 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:01.121073 31484 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:01.124898 31484 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.252:34585
I20260811 16:42:01.124938 31607 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.252:34585 every 8 connection(s)
I20260811 16:42:01.125286 31484 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/minicluster-data/master-2/data/info.pb
I20260811 16:42:01.126176 31608 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:01.127696 31608 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.175.254" port: 36107 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 16:42:01 dist-test-slave-zj8q krb5kdc[31213](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466521, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.252@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:42:01.135337 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 31484
I20260811 16:42:01.135456 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466249441839-25279-0/minicluster-data/master-2/wal/instance
I20260811 16:42:01.135645 25279 external_mini_cluster.cc:1428] Setting key a865b7f7be51fa4aca13777a47433608
I20260811 16:42:01.136225 31350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:01.128336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36674 (local address 127.24.175.254:36107)
0811 16:42:01.128389 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:01.128391 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:01.128589 (+ 198us) server_negotiation.cc:407] Connection header received
0811 16:42:01.129073 (+ 484us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:01.129074 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:01.129086 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:01.129147 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:01.129787 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:01.130539 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:01.131454 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:01.131663 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:01.131711 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:01.133635 (+ 1924us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:01.133636 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:01.133636 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:01.133643 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:01.134882 (+ 1239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:01.135255 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:01.135256 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:01.135256 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:01.135309 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:01.135585 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:01.135586 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:01.135586 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:01.135703 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:01.135766 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:01.136051 (+ 285us) server_negotiation.cc:299] Negotiation successful
0811 16:42:01.136136 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 16:42:01.136474 31610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:01.128311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:36107 (local address 127.0.0.1:36674)
0811 16:42:01.128460 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:01.128501 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:01.128956 (+ 455us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:01.129206 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:01.129209 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:01.129446 (+ 237us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:01.129690 (+ 244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:01.129697 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:01.130617 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:01.130618 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:01.131390 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:01.131392 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:01.131717 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:01.131718 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:01.131822 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:01.132267 (+ 445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:01.132276 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:01.133552 (+ 1276us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:01.134951 (+ 1399us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:01.134957 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:01.134959 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:01.135182 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:01.135364 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:01.135364 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:01.135365 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:01.135505 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:01.135758 (+ 253us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:01.135779 (+ 21us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:01.135915 (+ 136us) client_negotiation.cc:769] Sending connection context
0811 16:42:01.136025 (+ 110us) client_negotiation.cc:240] Negotiation successful
0811 16:42:01.136175 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":62,"threads_started":1}
I20260811 16:42:01.137006 31608 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.175.253" port: 42783 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 16:42:01 dist-test-slave-zj8q krb5kdc[31213](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466521, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.252@KRBTEST.COM for kudu/127.24.175.253@KRBTEST.COM
Aug 11 16:42:01 dist-test-slave-zj8q krb5kdc[31213](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466520, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.175.252@KRBTEST.COM
I20260811 16:42:01.143229 31477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:01.137290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35904 (local address 127.24.175.253:42783)
0811 16:42:01.137345 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:01.137347 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:01.137354 (+ 7us) server_negotiation.cc:407] Connection header received
0811 16:42:01.137378 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:01.137379 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:01.137388 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:01.137434 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:01.137680 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:01.138127 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:01.138766 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:01.138982 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:01.139037 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:01.140849 (+ 1812us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:01.140850 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:01.140850 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:01.140857 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:01.142259 (+ 1402us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:01.142591 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:01.142593 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:01.142593 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:01.142652 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:01.142792 (+ 140us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:01.142793 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:01.142793 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:01.142921 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:01.142998 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:01.143105 (+ 107us) server_negotiation.cc:299] Negotiation successful
0811 16:42:01.143168 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 16:42:01.143244 31610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:01.137222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.253:42783 (local address 127.0.0.1:35904)
0811 16:42:01.137260 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:01.137269 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:01.137303 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:01.137443 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:01.137443 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:01.137567 (+ 124us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:01.137614 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:01.137615 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:01.138221 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:01.138222 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:01.138699 (+ 477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:01.138700 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:01.139040 (+ 340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:01.139041 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:01.139101 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:01.139444 (+ 343us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:01.139448 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:01.140774 (+ 1326us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:01.142335 (+ 1561us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:01.142336 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:01.142336 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:01.142526 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:01.142711 (+ 185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:01.142711 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:01.142712 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:01.142754 (+ 42us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:01.142987 (+ 233us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:01.142987 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:01.143017 (+ 30us) client_negotiation.cc:769] Sending connection context
0811 16:42:01.143069 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 16:42:01.143152 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22}
I20260811 16:42:01.143666 31608 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.175.252" port: 34585 } has no permanent_uuid. Determining permanent_uuid...
I20260811 16:42:01.144284 31613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:01.136028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37190 (local address 127.24.175.252:34585)
0811 16:42:01.136183 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:01.136187 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:01.136262 (+ 75us) server_negotiation.cc:407] Connection header received
0811 16:42:01.136320 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:01.136323 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:01.136337 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:01.136384 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:01.137172 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:01.137881 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:01.138651 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:01.138967 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:01.139025 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:01.141466 (+ 2441us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:01.141475 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:01.141475 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:01.141482 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:01.143015 (+ 1533us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:01.143364 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:01.143367 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:01.143367 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:01.143426 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:01.143658 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:01.143659 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:01.143659 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:01.143844 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:01.143970 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:01.144101 (+ 131us) server_negotiation.cc:299] Negotiation successful
0811 16:42:01.144182 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":70,"threads_started":1}
Aug 11 16:42:01 dist-test-slave-zj8q krb5kdc[31213](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466521, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.252@KRBTEST.COM for kudu/127.24.175.252@KRBTEST.COM
Aug 11 16:42:01 dist-test-slave-zj8q krb5kdc[31213](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466520, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:42:01.150465 31610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:01.143911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.252:34585 (local address 127.0.0.1:37192)
0811 16:42:01.144100 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:01.144109 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:01.144150 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:01.144309 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:01.144310 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:01.144432 (+ 122us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:01.144454 (+ 22us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:01.144456 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:01.145071 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:01.145072 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:01.145536 (+ 464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:01.145538 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:01.145863 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:01.145864 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:01.145908 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:01.146272 (+ 364us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:01.146277 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:01.147409 (+ 1132us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:01.149603 (+ 2194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:01.149604 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:01.149605 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:01.149757 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:01.149941 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:01.149942 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:01.149942 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:01.149995 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:01.150258 (+ 263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:01.150259 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:01.150293 (+ 34us) client_negotiation.cc:769] Sending connection context
0811 16:42:01.150339 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 16:42:01.150410 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175}
I20260811 16:42:01.150593 31614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:01.143939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37192 (local address 127.24.175.252:34585)
0811 16:42:01.144102 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:01.144104 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:01.144139 (+ 35us) server_negotiation.cc:407] Connection header received
0811 16:42:01.144192 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:01.144192 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:01.144201 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:01.144266 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:01.144520 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:01.145010 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:01.145598 (+ 588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:01.145811 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:01.145861 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:01.147493 (+ 1632us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:01.147494 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:01.147495 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:01.147501 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:01.149534 (+ 2033us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:01.149824 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:01.149825 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:01.149825 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:01.149879 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:01.150049 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:01.150050 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:01.150050 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:01.150196 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:01.150268 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:01.150364 (+ 96us) server_negotiation.cc:299] Negotiation successful
0811 16:42:01.150467 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":30,"server-negotiator.queue_time_us":143,"thread_start_us":99,"threads_started":1}
I20260811 16:42:01.152055 31608 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ab6d0861bb1949959cc99fcc877a760e: Bootstrap starting.
I20260811 16:42:01.152216 31350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:01.145006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36678 (local address 127.24.175.254:36107)
0811 16:42:01.145040 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:01.145042 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:01.145084 (+ 42us) server_negotiation.cc:407] Connection header received
0811 16:42:01.145149 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:01.145150 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:01.145159 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:01.145201 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:01.145626 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:01.146213 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:01.146972 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:01.147174 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:01.147234 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:01.149131 (+ 1897us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:01.149132 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:01.149133 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:01.149139 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:01.150914 (+ 1775us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:01.151272 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:01.151272 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:01.151273 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:01.151319 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:01.151479 (+ 160us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:01.151479 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:01.151479 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:01.151565 (+ 86us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:01.152018 (+ 453us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:01.152055 (+ 37us) server_negotiation.cc:299] Negotiation successful
0811 16:42:01.152123 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 16:42:01.152787 31608 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ab6d0861bb1949959cc99fcc877a760e: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:01.153107 31608 log.cc:824] T 00000000000000000000000000000000 P ab6d0861bb1949959cc99fcc877a760e: Log is configured to *not* fsync() on all Append() calls
I20260811 16:42:01.153829 31608 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ab6d0861bb1949959cc99fcc877a760e: No bootstrap required, opened a new log
I20260811 16:42:01.155408 31608 raft_consensus.cc:348] T 00000000000000000000000000000000 P ab6d0861bb1949959cc99fcc877a760e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00af56add6b4631a694ee75fe23d50d" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 36107 } } peers { permanent_uuid: "909510febc644080b6adca7bc9e20cfc" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 42783 } } peers { permanent_uuid: "ab6d0861bb1949959cc99fcc877a760e" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 34585 } }
I20260811 16:42:01.155539 31608 raft_consensus.cc:729] T 00000000000000000000000000000000 P ab6d0861bb1949959cc99fcc877a760e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab6d0861bb1949959cc99fcc877a760e, State: Initialized, Role: FOLLOWER
I20260811 16:42:01.155620 31608 consensus_queue.cc:260] T 00000000000000000000000000000000 P ab6d0861bb1949959cc99fcc877a760e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00af56add6b4631a694ee75fe23d50d" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 36107 } } peers { permanent_uuid: "909510febc644080b6adca7bc9e20cfc" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 42783 } } peers { permanent_uuid: "ab6d0861bb1949959cc99fcc877a760e" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 34585 } }
I20260811 16:42:01.155874 31616 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab6d0861bb1949959cc99fcc877a760e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00af56add6b4631a694ee75fe23d50d" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 36107 } } peers { permanent_uuid: "909510febc644080b6adca7bc9e20cfc" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 42783 } } peers { permanent_uuid: "ab6d0861bb1949959cc99fcc877a760e" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 34585 } } }
I20260811 16:42:01.155928 31608 sys_catalog.cc:564] T 00000000000000000000000000000000 P ab6d0861bb1949959cc99fcc877a760e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:42:01.155974 31616 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab6d0861bb1949959cc99fcc877a760e [sys.catalog]: This master's current role is: FOLLOWER
Aug 11 16:42:01 dist-test-slave-zj8q krb5kdc[31213](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466520, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.175.253@KRBTEST.COM
W20260811 16:42:01.157786 31635 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ab6d0861bb1949959cc99fcc877a760e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 16:42:01.157851 31635 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 16:42:01.159848 31477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:01.152799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35920 (local address 127.24.175.253:42783)
0811 16:42:01.152834 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:01.152836 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:01.152845 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:42:01.152869 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:01.152870 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:01.152879 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:01.152944 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:01.153390 (+ 446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:01.153894 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:01.154585 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:01.154790 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:01.154842 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:01.157089 (+ 2247us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:01.157091 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:01.157092 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:01.157098 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:01.158714 (+ 1616us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:01.159088 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:01.159089 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:01.159089 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:01.159150 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:01.159346 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:01.159347 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:01.159347 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:01.159473 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:01.159650 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:01.159691 (+ 41us) server_negotiation.cc:299] Negotiation successful
0811 16:42:01.159766 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 16:42:01.158274 31484 master_runner.cc:186] Error getting master registration for 127.24.175.254:36107: OK, instance_id { permanent_uuid: "c00af56add6b4631a694ee75fe23d50d" instance_seqno: 1786466520827688 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 16:42:01.160249 31484 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 16:42:01.161237 25279 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:42:01.162240 31301 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "c00af56add6b4631a694ee75fe23d50d"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36678
I20260811 16:42:01.168413 31344 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.175.252" port: 34585 } attempt: 2
Aug 11 16:42:01 dist-test-slave-zj8q krb5kdc[31213](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466520, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.254@KRBTEST.COM for kudu/127.24.175.252@KRBTEST.COM
I20260811 16:42:01.175060 31347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:01.168703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.252:34585 (local address 127.0.0.1:37202)
0811 16:42:01.168755 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:01.168768 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:01.168820 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:01.168944 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:01.168946 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:01.169122 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:01.169162 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:01.169163 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:01.169801 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:01.169802 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:01.170380 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:01.170383 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:01.170736 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:01.170737 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:01.170803 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:01.171177 (+ 374us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:01.171182 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:01.172566 (+ 1384us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:01.174035 (+ 1469us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:01.174036 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:01.174037 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:01.174248 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:01.174420 (+ 172us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:01.174420 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:01.174421 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:01.174481 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:01.174748 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:01.174749 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:01.174797 (+ 48us) client_negotiation.cc:769] Sending connection context
0811 16:42:01.174857 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 16:42:01.174962 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260811 16:42:01.175060 31614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:01.168775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37202 (local address 127.24.175.252:34585)
0811 16:42:01.168823 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:01.168826 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:01.168855 (+ 29us) server_negotiation.cc:407] Connection header received
0811 16:42:01.168879 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:01.168880 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:01.168891 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:01.168937 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:01.169234 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:01.169727 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:01.170452 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:01.170678 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:01.170734 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:01.172645 (+ 1911us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:01.172647 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:01.172647 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:01.172654 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:01.173960 (+ 1306us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:01.174313 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:01.174314 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:01.174314 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:01.174369 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:01.174529 (+ 160us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:01.174530 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:01.174530 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:01.174686 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:01.174747 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:01.174885 (+ 138us) server_negotiation.cc:299] Negotiation successful
0811 16:42:01.174963 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 16:42:01.176575 31344 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c00af56add6b4631a694ee75fe23d50d: Bootstrap starting.
I20260811 16:42:01.177228 31344 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c00af56add6b4631a694ee75fe23d50d: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:01.177505 31344 log.cc:824] T 00000000000000000000000000000000 P c00af56add6b4631a694ee75fe23d50d: Log is configured to *not* fsync() on all Append() calls
I20260811 16:42:01.178369 31344 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c00af56add6b4631a694ee75fe23d50d: No bootstrap required, opened a new log
I20260811 16:42:01.179387 31344 raft_consensus.cc:348] T 00000000000000000000000000000000 P c00af56add6b4631a694ee75fe23d50d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00af56add6b4631a694ee75fe23d50d" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 36107 } } peers { permanent_uuid: "909510febc644080b6adca7bc9e20cfc" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 42783 } } peers { permanent_uuid: "ab6d0861bb1949959cc99fcc877a760e" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 34585 } }
I20260811 16:42:01.179508 31344 raft_consensus.cc:729] T 00000000000000000000000000000000 P c00af56add6b4631a694ee75fe23d50d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c00af56add6b4631a694ee75fe23d50d, State: Initialized, Role: FOLLOWER
I20260811 16:42:01.179589 31344 consensus_queue.cc:260] T 00000000000000000000000000000000 P c00af56add6b4631a694ee75fe23d50d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00af56add6b4631a694ee75fe23d50d" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 36107 } } peers { permanent_uuid: "909510febc644080b6adca7bc9e20cfc" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 42783 } } peers { permanent_uuid: "ab6d0861bb1949959cc99fcc877a760e" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 34585 } }
I20260811 16:42:01.179890 31344 sys_catalog.cc:564] T 00000000000000000000000000000000 P c00af56add6b4631a694ee75fe23d50d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:42:01.179858 31648 sys_catalog.cc:455] T 00000000000000000000000000000000 P c00af56add6b4631a694ee75fe23d50d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00af56add6b4631a694ee75fe23d50d" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 36107 } } peers { permanent_uuid: "909510febc644080b6adca7bc9e20cfc" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 42783 } } peers { permanent_uuid: "ab6d0861bb1949959cc99fcc877a760e" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 34585 } } }
I20260811 16:42:01.179947 31648 sys_catalog.cc:458] T 00000000000000000000000000000000 P c00af56add6b4631a694ee75fe23d50d [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:42:01.180141 31301 raft_consensus.cc:482] T 00000000000000000000000000000000 P c00af56add6b4631a694ee75fe23d50d [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:42:01.180207 31301 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c00af56add6b4631a694ee75fe23d50d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:01.181030 31301 raft_consensus.cc:504] T 00000000000000000000000000000000 P c00af56add6b4631a694ee75fe23d50d [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00af56add6b4631a694ee75fe23d50d" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 36107 } } peers { permanent_uuid: "909510febc644080b6adca7bc9e20cfc" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 42783 } } peers { permanent_uuid: "ab6d0861bb1949959cc99fcc877a760e" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 34585 } }
I20260811 16:42:01.181890 31565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c00af56add6b4631a694ee75fe23d50d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "ab6d0861bb1949959cc99fcc877a760e"
I20260811 16:42:01.182035 31565 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ab6d0861bb1949959cc99fcc877a760e [term 0 FOLLOWER]: Advancing to term 1
W20260811 16:42:01.182271 31662 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c00af56add6b4631a694ee75fe23d50d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 16:42:01.182363 31662 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 16:42:01.183349 31565 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ab6d0861bb1949959cc99fcc877a760e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c00af56add6b4631a694ee75fe23d50d in term 1.
I20260811 16:42:01.183622 31260 leader_election.cc:302] T 00000000000000000000000000000000 P c00af56add6b4631a694ee75fe23d50d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab6d0861bb1949959cc99fcc877a760e, c00af56add6b4631a694ee75fe23d50d; no voters:
I20260811 16:42:01.183753 31648 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c00af56add6b4631a694ee75fe23d50d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:42:01.183914 31648 raft_consensus.cc:686] T 00000000000000000000000000000000 P c00af56add6b4631a694ee75fe23d50d [term 1 LEADER]: Becoming Leader. State: Replica: c00af56add6b4631a694ee75fe23d50d, State: Running, Role: LEADER
I20260811 16:42:01.184005 31648 consensus_queue.cc:237] T 00000000000000000000000000000000 P c00af56add6b4631a694ee75fe23d50d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00af56add6b4631a694ee75fe23d50d" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 36107 } } peers { permanent_uuid: "909510febc644080b6adca7bc9e20cfc" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 42783 } } peers { permanent_uuid: "ab6d0861bb1949959cc99fcc877a760e" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 34585 } }
I20260811 16:42:01.184415 31648 sys_catalog.cc:455] T 00000000000000000000000000000000 P c00af56add6b4631a694ee75fe23d50d [sys.catalog]: SysCatalogTable state changed. Reason: New leader c00af56add6b4631a694ee75fe23d50d. Latest consensus state: current_term: 1 leader_uuid: "c00af56add6b4631a694ee75fe23d50d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00af56add6b4631a694ee75fe23d50d" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 36107 } } peers { permanent_uuid: "909510febc644080b6adca7bc9e20cfc" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 42783 } } peers { permanent_uuid: "ab6d0861bb1949959cc99fcc877a760e" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 34585 } } }
I20260811 16:42:01.184508 31648 sys_catalog.cc:458] T 00000000000000000000000000000000 P c00af56add6b4631a694ee75fe23d50d [sys.catalog]: This master's current role is: LEADER
I20260811 16:42:01.184652 31301 leader_election.cc:288] T 00000000000000000000000000000000 P c00af56add6b4631a694ee75fe23d50d [CANDIDATE]: Term 1 election: Requested vote from peers 909510febc644080b6adca7bc9e20cfc (127.24.175.253:42783), ab6d0861bb1949959cc99fcc877a760e (127.24.175.252:34585)
I20260811 16:42:01.182585 31233 master_runner.cc:186] Error getting master registration for 127.24.175.253:42783: OK, instance_id { permanent_uuid: "909510febc644080b6adca7bc9e20cfc" instance_seqno: 1786466520972371 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 16:42:01.184914 31233 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 16:42:01.193114 31614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:01.185923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37212 (local address 127.24.175.252:34585)
0811 16:42:01.185994 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:01.185996 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:01.186183 (+ 187us) server_negotiation.cc:407] Connection header received
0811 16:42:01.186283 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:01.186284 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:01.186310 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:01.186355 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:01.187093 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:01.187559 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:01.188522 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:01.188726 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:01.188781 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:01.190260 (+ 1479us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:01.190262 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:01.190262 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:01.190269 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:01.191821 (+ 1552us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:01.192192 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:01.192193 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:01.192194 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:01.192249 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:01.192419 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:01.192420 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:01.192421 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:01.192567 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:01.192656 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:01.192851 (+ 195us) server_negotiation.cc:299] Negotiation successful
0811 16:42:01.192948 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 16:42:01.194226 31670 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:42:01.194481 31670 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:42:01.196401 31565 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ab6d0861bb1949959cc99fcc877a760e [term 1 FOLLOWER]: Refusing update from remote peer c00af56add6b4631a694ee75fe23d50d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:42:01.196910 31668 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c00af56add6b4631a694ee75fe23d50d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab6d0861bb1949959cc99fcc877a760e" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:42:01.198407 31616 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab6d0861bb1949959cc99fcc877a760e [sys.catalog]: SysCatalogTable state changed. Reason: New leader c00af56add6b4631a694ee75fe23d50d. Latest consensus state: current_term: 1 leader_uuid: "c00af56add6b4631a694ee75fe23d50d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00af56add6b4631a694ee75fe23d50d" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 36107 } } peers { permanent_uuid: "909510febc644080b6adca7bc9e20cfc" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 42783 } } peers { permanent_uuid: "ab6d0861bb1949959cc99fcc877a760e" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 34585 } } }
I20260811 16:42:01.198498 31616 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab6d0861bb1949959cc99fcc877a760e [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:42:01.201318 31668 sys_catalog.cc:455] T 00000000000000000000000000000000 P c00af56add6b4631a694ee75fe23d50d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c00af56add6b4631a694ee75fe23d50d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00af56add6b4631a694ee75fe23d50d" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 36107 } } peers { permanent_uuid: "909510febc644080b6adca7bc9e20cfc" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 42783 } } peers { permanent_uuid: "ab6d0861bb1949959cc99fcc877a760e" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 34585 } } }
I20260811 16:42:01.201412 31668 sys_catalog.cc:458] T 00000000000000000000000000000000 P c00af56add6b4631a694ee75fe23d50d [sys.catalog]: This master's current role is: LEADER
I20260811 16:42:01.201858 31616 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab6d0861bb1949959cc99fcc877a760e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c00af56add6b4631a694ee75fe23d50d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00af56add6b4631a694ee75fe23d50d" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 36107 } } peers { permanent_uuid: "909510febc644080b6adca7bc9e20cfc" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 42783 } } peers { permanent_uuid: "ab6d0861bb1949959cc99fcc877a760e" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 34585 } } }
I20260811 16:42:01.201946 31616 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab6d0861bb1949959cc99fcc877a760e [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:42:01.202239 31691 mvcc.cc:205] Tried to move back new op lower bound from 7317366870817406976 to 7317366870770380800. Current Snapshot: MvccSnapshot[applied={T|T < 7317366870817406976}]
I20260811 16:42:01.202346 31477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:01.185941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35926 (local address 127.24.175.253:42783)
0811 16:42:01.185984 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:01.185986 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:01.193089 (+ 7103us) server_negotiation.cc:407] Connection header received
0811 16:42:01.193191 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:01.193192 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:01.193204 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:01.193236 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:01.193871 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:01.194433 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:01.195391 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:01.195694 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:01.195743 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:01.198637 (+ 2894us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:01.198638 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:01.198639 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:01.198662 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:01.200275 (+ 1613us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:01.200866 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:01.200868 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:01.200868 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:01.200947 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:01.201321 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:01.201322 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:01.201323 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:01.201463 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:01.201554 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:01.202136 (+ 582us) server_negotiation.cc:299] Negotiation successful
0811 16:42:01.202251 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 16:42:01.202414 31688 mvcc.cc:205] Tried to move back new op lower bound from 7317366870817406976 to 7317366870770380800. Current Snapshot: MvccSnapshot[applied={T|T < 7317366870817406976}]
I20260811 16:42:01.203904 31467 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.175.252" port: 34585 } attempt: 3
I20260811 16:42:01.207413 31350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:01.185883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36688 (local address 127.24.175.254:36107)
0811 16:42:01.185966 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:01.185968 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:01.195330 (+ 9362us) server_negotiation.cc:407] Connection header received
0811 16:42:01.195422 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:01.195423 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:01.195433 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:01.195460 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:01.196272 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:01.196983 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:01.197977 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:01.198301 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:01.198343 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:01.203730 (+ 5387us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:01.203732 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:01.203732 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:01.203740 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:01.205848 (+ 2108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:01.206270 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:01.206271 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:01.206272 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:01.206349 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:01.206557 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:01.206558 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:01.206558 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:01.206694 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:01.206794 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:01.207245 (+ 451us) server_negotiation.cc:299] Negotiation successful
0811 16:42:01.207322 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
Aug 11 16:42:01 dist-test-slave-zj8q krb5kdc[31213](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466520, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.253@KRBTEST.COM for kudu/127.24.175.252@KRBTEST.COM
I20260811 16:42:01.210412 31670 catalog_manager.cc:1347] Generated new cluster ID: 6b2ed042fcde4f12b9d495b84a1ebfc4
I20260811 16:42:01.210464 31670 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:42:01.212687 31473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:01.204146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.252:34585 (local address 127.0.0.1:37226)
0811 16:42:01.204226 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:01.204236 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:01.204277 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:01.204500 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:01.204501 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:01.204671 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:01.204721 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:01.204723 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:01.205683 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:01.205684 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:01.206443 (+ 759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:01.206446 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:01.206962 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:01.206963 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:01.207031 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:01.208026 (+ 995us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:01.208030 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:01.209468 (+ 1438us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:01.211401 (+ 1933us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:01.211403 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:01.211403 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:01.211626 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:01.211871 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:01.211872 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:01.211872 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:01.211942 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:01.212317 (+ 375us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:01.212318 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:01.212374 (+ 56us) client_negotiation.cc:769] Sending connection context
0811 16:42:01.212463 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 16:42:01.212573 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":65}
I20260811 16:42:01.213399 31614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:01.204342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37226 (local address 127.24.175.252:34585)
0811 16:42:01.204384 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:01.204385 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:01.204391 (+ 6us) server_negotiation.cc:407] Connection header received
0811 16:42:01.204410 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:01.204411 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:01.204419 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:01.204462 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:01.204806 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:01.205571 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:01.206546 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:01.206834 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:01.206898 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:01.209742 (+ 2844us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:01.209744 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:01.209744 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:01.209750 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:01.211315 (+ 1565us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:01.211723 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:01.211724 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:01.211724 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:01.211793 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:01.212070 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:01.212071 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:01.212071 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:01.212220 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:01.212287 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:01.213210 (+ 923us) server_negotiation.cc:299] Negotiation successful
0811 16:42:01.213301 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 16:42:01.215278 31467 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 909510febc644080b6adca7bc9e20cfc: Bootstrap starting.
I20260811 16:42:01.216006 31467 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 909510febc644080b6adca7bc9e20cfc: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:01.216305 31467 log.cc:824] T 00000000000000000000000000000000 P 909510febc644080b6adca7bc9e20cfc: Log is configured to *not* fsync() on all Append() calls
I20260811 16:42:01.217322 31467 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 909510febc644080b6adca7bc9e20cfc: No bootstrap required, opened a new log
I20260811 16:42:01.219434 31467 raft_consensus.cc:348] T 00000000000000000000000000000000 P 909510febc644080b6adca7bc9e20cfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00af56add6b4631a694ee75fe23d50d" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 36107 } } peers { permanent_uuid: "909510febc644080b6adca7bc9e20cfc" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 42783 } } peers { permanent_uuid: "ab6d0861bb1949959cc99fcc877a760e" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 34585 } }
I20260811 16:42:01.219580 31467 raft_consensus.cc:729] T 00000000000000000000000000000000 P 909510febc644080b6adca7bc9e20cfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 909510febc644080b6adca7bc9e20cfc, State: Initialized, Role: FOLLOWER
I20260811 16:42:01.219664 31467 consensus_queue.cc:260] T 00000000000000000000000000000000 P 909510febc644080b6adca7bc9e20cfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00af56add6b4631a694ee75fe23d50d" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 36107 } } peers { permanent_uuid: "909510febc644080b6adca7bc9e20cfc" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 42783 } } peers { permanent_uuid: "ab6d0861bb1949959cc99fcc877a760e" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 34585 } }
I20260811 16:42:01.219983 31467 sys_catalog.cc:564] T 00000000000000000000000000000000 P 909510febc644080b6adca7bc9e20cfc [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:42:01.220044 31429 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 909510febc644080b6adca7bc9e20cfc [term 0 FOLLOWER]: Advancing to term 1
W20260811 16:42:01.220125 31391 tablet.cc:2369] T 00000000000000000000000000000000 P 909510febc644080b6adca7bc9e20cfc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:42:01.220912 31429 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 909510febc644080b6adca7bc9e20cfc [term 1 FOLLOWER]: Refusing update from remote peer c00af56add6b4631a694ee75fe23d50d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:42:01.221232 31648 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c00af56add6b4631a694ee75fe23d50d [LEADER]: Connected to new peer: Peer: permanent_uuid: "909510febc644080b6adca7bc9e20cfc" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 42783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:42:01.221308 31430 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c00af56add6b4631a694ee75fe23d50d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "909510febc644080b6adca7bc9e20cfc"
I20260811 16:42:01.222081 31430 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 909510febc644080b6adca7bc9e20cfc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c00af56add6b4631a694ee75fe23d50d in term 1.
I20260811 16:42:01.222873 31670 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:42:01.219941 31699 sys_catalog.cc:455] T 00000000000000000000000000000000 P 909510febc644080b6adca7bc9e20cfc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00af56add6b4631a694ee75fe23d50d" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 36107 } } peers { permanent_uuid: "909510febc644080b6adca7bc9e20cfc" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 42783 } } peers { permanent_uuid: "ab6d0861bb1949959cc99fcc877a760e" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 34585 } } }
I20260811 16:42:01.223198 31699 sys_catalog.cc:458] T 00000000000000000000000000000000 P 909510febc644080b6adca7bc9e20cfc [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:42:01.223305 31699 sys_catalog.cc:455] T 00000000000000000000000000000000 P 909510febc644080b6adca7bc9e20cfc [sys.catalog]: SysCatalogTable state changed. Reason: New leader c00af56add6b4631a694ee75fe23d50d. Latest consensus state: current_term: 1 leader_uuid: "c00af56add6b4631a694ee75fe23d50d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00af56add6b4631a694ee75fe23d50d" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 36107 } } peers { permanent_uuid: "909510febc644080b6adca7bc9e20cfc" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 42783 } } peers { permanent_uuid: "ab6d0861bb1949959cc99fcc877a760e" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 34585 } } }
I20260811 16:42:01.223408 31699 sys_catalog.cc:458] T 00000000000000000000000000000000 P 909510febc644080b6adca7bc9e20cfc [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:42:01.223608 31670 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:42:01.223523 31699 sys_catalog.cc:455] T 00000000000000000000000000000000 P 909510febc644080b6adca7bc9e20cfc [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c00af56add6b4631a694ee75fe23d50d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00af56add6b4631a694ee75fe23d50d" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 36107 } } peers { permanent_uuid: "909510febc644080b6adca7bc9e20cfc" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 42783 } } peers { permanent_uuid: "ab6d0861bb1949959cc99fcc877a760e" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 34585 } } }
I20260811 16:42:01.223968 31699 sys_catalog.cc:458] T 00000000000000000000000000000000 P 909510febc644080b6adca7bc9e20cfc [sys.catalog]: This master's current role is: FOLLOWER
W20260811 16:42:01.225740 31723 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 909510febc644080b6adca7bc9e20cfc: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 16:42:01.225790 31723 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 16:42:01.226004 31716 mvcc.cc:205] Tried to move back new op lower bound from 7317366870817406976 to 7317366870770380800. Current Snapshot: MvccSnapshot[applied={T|T < 7317366870817406976}]
I20260811 16:42:01.226634 31668 sys_catalog.cc:455] T 00000000000000000000000000000000 P c00af56add6b4631a694ee75fe23d50d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c00af56add6b4631a694ee75fe23d50d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00af56add6b4631a694ee75fe23d50d" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 36107 } } peers { permanent_uuid: "909510febc644080b6adca7bc9e20cfc" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 42783 } } peers { permanent_uuid: "ab6d0861bb1949959cc99fcc877a760e" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 34585 } } }
I20260811 16:42:01.226754 31668 sys_catalog.cc:458] T 00000000000000000000000000000000 P c00af56add6b4631a694ee75fe23d50d [sys.catalog]: This master's current role is: LEADER
I20260811 16:42:01.240996 31670 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c00af56add6b4631a694ee75fe23d50d: Generated new TSK 0
I20260811 16:42:01.241192 31670 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 16:42:01.266587 31614 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:42:01.265262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37232 (local address 127.24.175.252:34585)
0811 16:42:01.265306 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:01.265308 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:01.265923 (+ 615us) server_negotiation.cc:407] Connection header received
0811 16:42:01.266022 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:01.266024 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:01.266034 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:01.266063 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:01.266506 (+ 443us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37232: BlockingRecv error: recv got EOF from 127.0.0.1:37232 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260811 16:42:01.267303 31350 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:42:01.265656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36702 (local address 127.24.175.254:36107)
0811 16:42:01.265694 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:01.265696 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:01.266822 (+ 1126us) server_negotiation.cc:407] Connection header received
0811 16:42:01.266913 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:01.266914 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:01.266924 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:01.266950 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:01.267242 (+ 292us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36702: BlockingRecv error: recv got EOF from 127.0.0.1:36702 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260811 16:42:01.268317 31477 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:42:01.267642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35938 (local address 127.24.175.253:42783)
0811 16:42:01.267681 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:01.267683 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:01.267803 (+ 120us) server_negotiation.cc:407] Connection header received
0811 16:42:01.267885 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:01.267886 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:01.267895 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:01.267922 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:01.268243 (+ 321us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35938: BlockingRecv error: recv got EOF from 127.0.0.1:35938 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260811 16:42:01.270655 31477 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:42:01.269885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35952 (local address 127.24.175.253:42783)
0811 16:42:01.269919 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:01.269920 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:01.270086 (+ 166us) server_negotiation.cc:407] Connection header received
0811 16:42:01.270208 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:01.270210 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:01.270227 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:01.270254 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:01.270611 (+ 357us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35952: BlockingRecv error: recv got EOF from 127.0.0.1:35952 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260811 16:42:01.273562 31477 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:42:01.272849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35956 (local address 127.24.175.253:42783)
0811 16:42:01.272892 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:01.272894 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:01.273100 (+ 206us) server_negotiation.cc:407] Connection header received
0811 16:42:01.273182 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:01.273183 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:01.273193 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:01.273217 (+ 24us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:01.273505 (+ 288us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35956: BlockingRecv error: recv got EOF from 127.0.0.1:35956 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260811 16:42:01.277391 31477 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:42:01.276671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35964 (local address 127.24.175.253:42783)
0811 16:42:01.276710 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:01.276712 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:01.276918 (+ 206us) server_negotiation.cc:407] Connection header received
0811 16:42:01.277007 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:01.277008 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:01.277018 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:01.277047 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:01.277354 (+ 307us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35964: BlockingRecv error: recv got EOF from 127.0.0.1:35964 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
W20260811 16:42:01.283190 31477 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:42:01.282463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35972 (local address 127.24.175.253:42783)
0811 16:42:01.282493 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:01.282495 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:01.282715 (+ 220us) server_negotiation.cc:407] Connection header received
0811 16:42:01.282800 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:01.282801 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:01.282811 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:01.282836 (+ 25us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:01.283151 (+ 315us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35972: BlockingRecv error: recv got EOF from 127.0.0.1:35972 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260811 16:42:01.293186 31477 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:42:01.292368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35980 (local address 127.24.175.253:42783)
0811 16:42:01.292415 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:01.292417 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:01.292645 (+ 228us) server_negotiation.cc:407] Connection header received
0811 16:42:01.292743 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:01.292744 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:01.292755 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:01.292782 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:01.293140 (+ 358us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35980: BlockingRecv error: recv got EOF from 127.0.0.1:35980 (error 108)
Metrics: {"server-negotiator.queue_time_us":29}
W20260811 16:42:01.311399 31477 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:42:01.310523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35992 (local address 127.24.175.253:42783)
0811 16:42:01.310565 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:01.310567 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:01.310815 (+ 248us) server_negotiation.cc:407] Connection header received
0811 16:42:01.310913 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:01.310914 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:01.310925 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:01.310954 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:01.311341 (+ 387us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35992: BlockingRecv error: recv got EOF from 127.0.0.1:35992 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260811 16:42:01.345799 31477 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:42:01.344789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36008 (local address 127.24.175.253:42783)
0811 16:42:01.344833 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:01.344835 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:01.345119 (+ 284us) server_negotiation.cc:407] Connection header received
0811 16:42:01.345255 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:01.345257 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:01.345272 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:01.345301 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:01.345738 (+ 437us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36008: BlockingRecv error: recv got EOF from 127.0.0.1:36008 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260811 16:42:01.411731 31477 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:42:01.411065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36016 (local address 127.24.175.253:42783)
0811 16:42:01.411118 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:01.411120 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:01.411221 (+ 101us) server_negotiation.cc:407] Connection header received
0811 16:42:01.411298 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:01.411299 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:01.411311 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:01.411357 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:01.411682 (+ 325us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36016: BlockingRecv error: recv got EOF from 127.0.0.1:36016 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
W20260811 16:42:01.541574 31477 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:42:01.540952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36022 (local address 127.24.175.253:42783)
0811 16:42:01.541015 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:01.541017 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:01.541091 (+ 74us) server_negotiation.cc:407] Connection header received
0811 16:42:01.541156 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:01.541157 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:01.541167 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:01.541205 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:01.541509 (+ 304us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36022: BlockingRecv error: recv got EOF from 127.0.0.1:36022 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
W20260811 16:42:01.799368 31477 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:42:01.798785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36030 (local address 127.24.175.253:42783)
0811 16:42:01.798830 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:01.798831 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:01.798854 (+ 23us) server_negotiation.cc:407] Connection header received
0811 16:42:01.798934 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:01.798935 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:01.798948 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:01.799010 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:01.799303 (+ 293us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36030: BlockingRecv error: recv got EOF from 127.0.0.1:36030 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 16:42:02.158321 31635 catalog_manager.cc:1259] Loaded cluster ID: 6b2ed042fcde4f12b9d495b84a1ebfc4
I20260811 16:42:02.158396 31635 catalog_manager.cc:1552] T 00000000000000000000000000000000 P ab6d0861bb1949959cc99fcc877a760e: loading cluster ID for follower catalog manager: success
I20260811 16:42:02.159206 31635 catalog_manager.cc:1574] T 00000000000000000000000000000000 P ab6d0861bb1949959cc99fcc877a760e: acquiring CA information for follower catalog manager: success
I20260811 16:42:02.159500 31635 catalog_manager.cc:1602] T 00000000000000000000000000000000 P ab6d0861bb1949959cc99fcc877a760e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 16:42:02.226284 31723 catalog_manager.cc:1259] Loaded cluster ID: 6b2ed042fcde4f12b9d495b84a1ebfc4
I20260811 16:42:02.226367 31723 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 909510febc644080b6adca7bc9e20cfc: loading cluster ID for follower catalog manager: success
I20260811 16:42:02.227218 31723 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 909510febc644080b6adca7bc9e20cfc: acquiring CA information for follower catalog manager: success
I20260811 16:42:02.227545 31723 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 909510febc644080b6adca7bc9e20cfc: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 16:42:02.315132 31835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:02.312517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36040 (local address 127.24.175.253:42783)
0811 16:42:02.312629 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:02.312631 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:02.312706 (+ 75us) server_negotiation.cc:407] Connection header received
0811 16:42:02.312781 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:02.312782 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:02.312838 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:02.312929 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:42:02.313131 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:02.313652 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:02.314491 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:02.314682 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:02.314729 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:02.314853 (+ 124us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:42:02.314962 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:42:02.315013 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:02.315029 (+ 16us) server_negotiation.cc:299] Negotiation successful
0811 16:42:02.315047 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91,"thread_start_us":60,"threads_started":1}
I20260811 16:42:02.318971 31849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:02.316882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37240 (local address 127.24.175.252:34585)
0811 16:42:02.316997 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:02.316998 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:02.317006 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:42:02.317042 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:02.317042 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:02.317075 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:02.317139 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:42:02.317233 (+ 94us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:02.317698 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:02.318386 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:02.318576 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:02.318622 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:02.318719 (+ 97us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:42:02.318814 (+ 95us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:42:02.318862 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:02.318878 (+ 16us) server_negotiation.cc:299] Negotiation successful
0811 16:42:02.318893 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94,"thread_start_us":60,"threads_started":1}
I20260811 16:42:02.323155 31835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:02.320492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36056 (local address 127.24.175.253:42783)
0811 16:42:02.320528 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:02.320531 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:02.320739 (+ 208us) server_negotiation.cc:407] Connection header received
0811 16:42:02.320782 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:02.320783 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:02.320794 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:02.320845 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:42:02.321013 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:02.321550 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:02.322440 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:02.322731 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:02.322797 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:02.322938 (+ 141us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:42:02.322969 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:42:02.323014 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:02.323064 (+ 50us) server_negotiation.cc:299] Negotiation successful
0811 16:42:02.323084 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 16:42:02.323675 31861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:02.320492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36718 (local address 127.24.175.254:36107)
0811 16:42:02.320682 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:02.320684 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:02.320747 (+ 63us) server_negotiation.cc:407] Connection header received
0811 16:42:02.320833 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:02.320835 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:02.320886 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:02.321037 (+ 151us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:42:02.321136 (+ 99us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:02.321905 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:02.322759 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:02.323041 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:02.323277 (+ 236us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:02.323352 (+ 75us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:42:02.323451 (+ 99us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:42:02.323507 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:02.323562 (+ 55us) server_negotiation.cc:299] Negotiation successful
0811 16:42:02.323589 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":72,"threads_started":1}
I20260811 16:42:02.323729 31849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:02.320590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37256 (local address 127.24.175.252:34585)
0811 16:42:02.320624 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:02.320626 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:02.320904 (+ 278us) server_negotiation.cc:407] Connection header received
0811 16:42:02.320951 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:02.320952 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:02.320961 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:02.320985 (+ 24us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:42:02.321199 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:02.321906 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:02.322875 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:02.323141 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:02.323194 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:02.323515 (+ 321us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:42:02.323545 (+ 30us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:42:02.323594 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:02.323652 (+ 58us) server_negotiation.cc:299] Negotiation successful
0811 16:42:02.323671 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260811 16:42:02.325196 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 31233
I20260811 16:42:02.338593 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 31359
I20260811 16:42:02.352545 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 31484
2026-08-11T16:42:02Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (2928 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:42:02 dist-test-slave-zj8q krb5kdc[31869](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:42:02 dist-test-slave-zj8q krb5kdc[31869](info): set up 2 sockets
Aug 11 16:42:02 dist-test-slave-zj8q krb5kdc[31869](info): commencing operation
krb5kdc: starting...
W20260811 16:42:03.523504 25279 mini_kdc.cc:121] Time spent starting KDC: real 1.148s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/krb5kdc/test-user.keytab.
Aug 11 16:42:03 dist-test-slave-zj8q krb5kdc[31869](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466523, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:42:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:42:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.175.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab.
Entry for principal kudu/127.24.175.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab.
I20260811 16:42:03.638861 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:40433
--webserver_interface=127.24.175.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:39487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.175.254:40433,127.24.175.253:40523,127.24.175.252:34831
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:42:03.719206 31884 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 16:42:03.719413 31884 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:03.719429 31884 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:03.719447 31884 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:03.720563 31884 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:42:03.720606 31884 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:03.720620 31884 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:03.720633 31884 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:42:03.720642 31884 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:42:03.722064 31884 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:39487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.175.254:40433,127.24.175.253:40523,127.24.175.252:34831
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.254.keytab
--principal=kudu/127.24.175.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.254:40433
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.175.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31884
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:03.722302 31884 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:03.722528 31884 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:42:03.727397 31899 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:03.727438 31884 server_base.cc:1034] running on GCE node
W20260811 16:42:03.727411 31893 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:03.727424 31896 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:03.727833 31884 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:03.728096 31884 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:03.729236 31884 hybrid_clock.cc:648] HybridClock initialized: now 1786466523729220 us; error 31 us; skew 500 ppm
Aug 11 16:42:03 dist-test-slave-zj8q krb5kdc[31869](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466523, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:03.735034 31884 init.cc:377] Logged in from keytab as kudu/127.24.175.254@KRBTEST.COM (short username kudu)
I20260811 16:42:03.735472 31884 webserver.cc:460] Webserver started at http://127.24.175.254:43705/ using document root <none> and password file <none>
I20260811 16:42:03.735697 31884 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:03.735745 31884 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:03.735878 31884 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:42:03.736924 31884 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/minicluster-data/master-0/data/instance:
uuid: "2603e53d00cf4e94bec2d81ceea5fad6"
format_stamp: "Formatted at 2026-08-11 16:42:03 on dist-test-slave-zj8q"
server_key: "9af0a7d600234e35789b5f372977ba83"
server_key_iv: "2b1c1a578993e7ca5194ba5f0790f619"
server_key_version: "encryptionkey@0"
I20260811 16:42:03.737270 31884 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/minicluster-data/master-0/wal/instance:
uuid: "2603e53d00cf4e94bec2d81ceea5fad6"
format_stamp: "Formatted at 2026-08-11 16:42:03 on dist-test-slave-zj8q"
server_key: "9af0a7d600234e35789b5f372977ba83"
server_key_iv: "2b1c1a578993e7ca5194ba5f0790f619"
server_key_version: "encryptionkey@0"
I20260811 16:42:03.738549 31884 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:42:03.739289 31908 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:03.739446 31884 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:42:03.739523 31884 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/minicluster-data/master-0/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/minicluster-data/master-0/wal
uuid: "2603e53d00cf4e94bec2d81ceea5fad6"
format_stamp: "Formatted at 2026-08-11 16:42:03 on dist-test-slave-zj8q"
server_key: "9af0a7d600234e35789b5f372977ba83"
server_key_iv: "2b1c1a578993e7ca5194ba5f0790f619"
server_key_version: "encryptionkey@0"
I20260811 16:42:03.739585 31884 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:03.756264 31884 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:03.758024 31884 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:03.758219 31884 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:03.762120 31884 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.254:40433
I20260811 16:42:03.762176 32000 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.254:40433 every 8 connection(s)
I20260811 16:42:03.762522 31884 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/minicluster-data/master-0/data/info.pb
I20260811 16:42:03.763339 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 31884
I20260811 16:42:03.763445 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/minicluster-data/master-0/wal/instance
I20260811 16:42:03.763497 32003 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:03.763660 25279 external_mini_cluster.cc:1428] Setting key b0da8dfc2a09641f52b1751d035d90a9
I20260811 16:42:03.765547 32003 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.175.254" port: 40433 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.24.175.253@KRBTEST.COM; defaulting to no policy
Aug 11 16:42:03 dist-test-slave-zj8q krb5kdc[31869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466523, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.254@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.253@KRBTEST.COM" created.
I20260811 16:42:03.775061 32008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:03.766328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:40433 (local address 127.0.0.1:57440)
0811 16:42:03.766580 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:03.766610 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:03.767103 (+ 493us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:03.767364 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:03.767367 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:03.767634 (+ 267us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:03.767783 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:03.767788 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:03.768807 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:03.768808 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:03.769475 (+ 667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:03.769477 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:03.769931 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:03.769932 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:03.769998 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:03.770471 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:03.770479 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:03.771841 (+ 1362us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:03.773601 (+ 1760us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:03.773608 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:03.773610 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:03.773802 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:03.774010 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:03.774011 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:03.774011 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:03.774098 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:03.774581 (+ 483us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:03.774588 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:03.774659 (+ 71us) client_negotiation.cc:769] Sending connection context
0811 16:42:03.774759 (+ 100us) client_negotiation.cc:240] Negotiation successful
0811 16:42:03.774894 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":101,"threads_started":1}
I20260811 16:42:03.775080 32007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:03.766330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57440 (local address 127.24.175.254:40433)
0811 16:42:03.766492 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:03.766502 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:03.766704 (+ 202us) server_negotiation.cc:407] Connection header received
0811 16:42:03.767260 (+ 556us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:03.767261 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:03.767278 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:03.767352 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:03.767873 (+ 521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:03.768718 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:03.769549 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:03.769859 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:03.769953 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:03.771938 (+ 1985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:03.771946 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:03.771946 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:03.771953 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:03.773478 (+ 1525us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:03.773872 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:03.773875 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:03.773875 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:03.773954 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:03.774199 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:03.774200 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:03.774200 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:03.774505 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:03.774580 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:03.774830 (+ 250us) server_negotiation.cc:299] Negotiation successful
0811 16:42:03.774979 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":39,"server-negotiator.queue_time_us":118,"thread_start_us":73,"threads_started":1}
I20260811 16:42:03.776641 32003 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.175.253" port: 40523 } has no permanent_uuid. Determining permanent_uuid...
I20260811 16:42:03.776974 32008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:03.776867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.253:40523 (local address 127.0.0.1:54738)
0811 16:42:03.776908 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:03.776953 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.253:40523: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260811 16:42:03.777102 31917 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.24.175.253:40523: connect: Connection refused (error 111)
I20260811 16:42:03.777500 32008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:03.777419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.253:40523 (local address 127.0.0.1:54744)
0811 16:42:03.777460 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:03.777484 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.253:40523: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260811 16:42:03.777601 32003 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.175.253:40523: Network error: Client connection negotiation failed: client connection to 127.24.175.253:40523: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.253.keytab.
Entry for principal kudu/127.24.175.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.253.keytab.
I20260811 16:42:03.788666 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.253:40523
--webserver_interface=127.24.175.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.253.keytab
--principal=kudu/127.24.175.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:39487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.175.254:40433,127.24.175.253:40523,127.24.175.252:34831
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 16:42:03.826841 32003 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.175.253" port: 40523 } attempt: 1
I20260811 16:42:03.827380 32008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:03.827243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.253:40523 (local address 127.0.0.1:54760)
0811 16:42:03.827311 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:03.827346 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.253:40523: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260811 16:42:03.827778 32008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:03.827689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.253:40523 (local address 127.0.0.1:54774)
0811 16:42:03.827724 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:03.827747 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.253:40523: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260811 16:42:03.827862 32003 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.175.253:40523: Network error: Client connection negotiation failed: client connection to 127.24.175.253:40523: connect: Connection refused (error 111)
W20260811 16:42:03.871206 32012 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 16:42:03.871410 32012 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:03.871426 32012 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:03.871443 32012 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:03.872517 32012 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:42:03.872558 32012 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:03.872577 32012 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:03.872593 32012 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:42:03.872605 32012 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:42:03.874015 32012 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:39487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.24.175.254:40433,127.24.175.253:40523,127.24.175.252:34831
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.253.keytab
--principal=kudu/127.24.175.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.253:40523
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.24.175.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32012
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:03.874241 32012 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:03.874418 32012 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:42:03.879065 32032 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:03.879078 32029 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:03.879069 32028 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:03.879150 32012 server_base.cc:1034] running on GCE node
I20260811 16:42:03.879528 32012 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:03.879819 32012 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:03.880960 32012 hybrid_clock.cc:648] HybridClock initialized: now 1786466523880948 us; error 28 us; skew 500 ppm
Aug 11 16:42:03 dist-test-slave-zj8q krb5kdc[31869](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466523, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:03.883316 32012 init.cc:377] Logged in from keytab as kudu/127.24.175.253@KRBTEST.COM (short username kudu)
I20260811 16:42:03.883708 32012 webserver.cc:460] Webserver started at http://127.24.175.253:34303/ using document root <none> and password file <none>
I20260811 16:42:03.883924 32012 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:03.883975 32012 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:03.884100 32012 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:42:03.885119 32012 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/minicluster-data/master-1/data/instance:
uuid: "13362fee357740f89717bd65a07ff608"
format_stamp: "Formatted at 2026-08-11 16:42:03 on dist-test-slave-zj8q"
server_key: "3c1493a78400e46742efe72b4743070d"
server_key_iv: "fa3b93d0f11b0635fd631bbbb7e37784"
server_key_version: "encryptionkey@0"
I20260811 16:42:03.885466 32012 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/minicluster-data/master-1/wal/instance:
uuid: "13362fee357740f89717bd65a07ff608"
format_stamp: "Formatted at 2026-08-11 16:42:03 on dist-test-slave-zj8q"
server_key: "3c1493a78400e46742efe72b4743070d"
server_key_iv: "fa3b93d0f11b0635fd631bbbb7e37784"
server_key_version: "encryptionkey@0"
I20260811 16:42:03.886844 32012 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:42:03.887544 32047 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:03.887696 32012 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:42:03.887799 32012 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/minicluster-data/master-1/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/minicluster-data/master-1/wal
uuid: "13362fee357740f89717bd65a07ff608"
format_stamp: "Formatted at 2026-08-11 16:42:03 on dist-test-slave-zj8q"
server_key: "3c1493a78400e46742efe72b4743070d"
server_key_iv: "fa3b93d0f11b0635fd631bbbb7e37784"
server_key_version: "encryptionkey@0"
I20260811 16:42:03.887861 32012 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:03.896019 32003 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.175.253" port: 40523 } attempt: 2
I20260811 16:42:03.896392 32008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:03.896279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.253:40523 (local address 127.0.0.1:54784)
0811 16:42:03.896332 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:03.896363 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.253:40523: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260811 16:42:03.896703 32008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:03.896623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.253:40523 (local address 127.0.0.1:54794)
0811 16:42:03.896659 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:03.896683 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.253:40523: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
W20260811 16:42:03.896780 32003 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.175.253:40523: Network error: Client connection negotiation failed: client connection to 127.24.175.253:40523: connect: Connection refused (error 111)
I20260811 16:42:03.931160 32012 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:03.933105 32012 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:03.933243 32012 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:03.937143 32012 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.253:40523
I20260811 16:42:03.937182 32141 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.253:40523 every 8 connection(s)
I20260811 16:42:03.937526 32012 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/minicluster-data/master-1/data/info.pb
I20260811 16:42:03.938431 32142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:03.940012 32142 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.175.254" port: 40433 } has no permanent_uuid. Determining permanent_uuid...
I20260811 16:42:03.943681 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 32012
I20260811 16:42:03.943783 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/minicluster-data/master-1/wal/instance
I20260811 16:42:03.943943 25279 external_mini_cluster.cc:1428] Setting key 163eb98dae2ace4d68c5cd016d692d27
Aug 11 16:42:03 dist-test-slave-zj8q krb5kdc[31869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466523, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.253@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:42:03.948859 32007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:03.940691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57454 (local address 127.24.175.254:40433)
0811 16:42:03.940789 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:03.940792 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:03.941000 (+ 208us) server_negotiation.cc:407] Connection header received
0811 16:42:03.941484 (+ 484us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:03.941485 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:03.941496 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:03.941536 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:03.942209 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:03.942706 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:03.943731 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:03.943999 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:03.944065 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:03.946100 (+ 2035us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:03.946102 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:03.946102 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:03.946109 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:03.947470 (+ 1361us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:03.947863 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:03.947864 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:03.947865 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:03.947930 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:03.948258 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:03.948258 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:03.948258 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:03.948363 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:03.948409 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:03.948727 (+ 318us) server_negotiation.cc:299] Negotiation successful
0811 16:42:03.948794 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 16:42:03.949134 32145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:03.940658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:40433 (local address 127.0.0.1:57454)
0811 16:42:03.940884 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:03.940922 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:03.941394 (+ 472us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:03.941602 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:03.941605 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:03.941893 (+ 288us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:03.942104 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:03.942108 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:03.942804 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:03.942805 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:03.943640 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:03.943643 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:03.944085 (+ 442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:03.944087 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:03.944207 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:03.944677 (+ 470us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:03.944685 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:03.946006 (+ 1321us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:03.947559 (+ 1553us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:03.947567 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:03.947569 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:03.947792 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:03.948020 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:03.948021 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:03.948022 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:03.948189 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:03.948420 (+ 231us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:03.948428 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:03.948597 (+ 169us) client_negotiation.cc:769] Sending connection context
0811 16:42:03.948719 (+ 122us) client_negotiation.cc:240] Negotiation successful
0811 16:42:03.948906 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":120,"threads_started":1}
I20260811 16:42:03.949689 32142 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.175.253" port: 40523 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.24.175.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.175.252@KRBTEST.COM" created.
Aug 11 16:42:03 dist-test-slave-zj8q krb5kdc[31869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466523, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.253@KRBTEST.COM for kudu/127.24.175.253@KRBTEST.COM
I20260811 16:42:03.958190 32145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:03.949928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.253:40523 (local address 127.0.0.1:54798)
0811 16:42:03.949981 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:03.949994 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:03.950039 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:03.950291 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:03.950292 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:03.950439 (+ 147us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:03.950501 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:03.950503 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:03.951317 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:03.951319 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:03.952085 (+ 766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:03.952088 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:03.952555 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:03.952556 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:03.952616 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:03.952907 (+ 291us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:03.952911 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:03.955336 (+ 2425us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:03.957125 (+ 1789us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:03.957126 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:03.957127 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:03.957339 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:03.957522 (+ 183us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:03.957523 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:03.957523 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:03.957589 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:03.957838 (+ 249us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:03.957839 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:03.957885 (+ 46us) client_negotiation.cc:769] Sending connection context
0811 16:42:03.957953 (+ 68us) client_negotiation.cc:240] Negotiation successful
0811 16:42:03.958045 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260811 16:42:03.958261 32147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:03.949991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54798 (local address 127.24.175.253:40523)
0811 16:42:03.950131 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:03.950136 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:03.950175 (+ 39us) server_negotiation.cc:407] Connection header received
0811 16:42:03.950197 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:03.950199 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:03.950212 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:03.950276 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:03.950569 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:03.951235 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:03.952156 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:03.952486 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:03.952539 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:03.955417 (+ 2878us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:03.955424 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:03.955424 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:03.955430 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:03.957050 (+ 1620us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:03.957411 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:03.957413 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:03.957414 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:03.957465 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:03.957648 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:03.957649 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:03.957649 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:03.957780 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:03.957836 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:03.957985 (+ 149us) server_negotiation.cc:299] Negotiation successful
0811 16:42:03.958093 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":46,"server-negotiator.queue_time_us":114,"thread_start_us":75,"threads_started":1}
I20260811 16:42:03.958948 32142 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.175.252" port: 34831 } has no permanent_uuid. Determining permanent_uuid...
I20260811 16:42:03.959282 32145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:03.959145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.252:34831 (local address 127.0.0.1:46788)
0811 16:42:03.959194 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:03.959249 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.252:34831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260811 16:42:03.959429 32050 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.24.175.252:34831: connect: Connection refused (error 111)
I20260811 16:42:03.959851 32145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:03.959756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.252:34831 (local address 127.0.0.1:46804)
0811 16:42:03.959799 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:03.959829 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.252:34831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260811 16:42:03.959954 32142 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.175.252:34831: Network error: Client connection negotiation failed: client connection to 127.24.175.252:34831: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.175.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.252.keytab.
Entry for principal kudu/127.24.175.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.252.keytab.
I20260811 16:42:03.969012 25279 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkGJqOS/build/release/bin/kudu
/tmp/dist-test-taskkGJqOS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.252:34831
--webserver_interface=127.24.175.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.252.keytab
--principal=kudu/127.24.175.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.175.212:39487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.175.254:40433,127.24.175.253:40523,127.24.175.252:34831
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 16:42:03.987919 32003 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.175.253" port: 40523 } attempt: 3
Aug 11 16:42:03 dist-test-slave-zj8q krb5kdc[31869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466523, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.254@KRBTEST.COM for kudu/127.24.175.253@KRBTEST.COM
I20260811 16:42:03.994686 32147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:03.988376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54804 (local address 127.24.175.253:40523)
0811 16:42:03.988440 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:03.988442 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:03.988450 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:42:03.988476 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:03.988476 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:03.988487 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:03.988533 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:03.988891 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:03.989407 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:03.990146 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:03.990390 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:03.990450 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:03.992403 (+ 1953us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:03.992404 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:03.992404 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:03.992412 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:03.993623 (+ 1211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:03.993994 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:03.993995 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:03.993995 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:03.994040 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:03.994241 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:03.994241 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:03.994241 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:03.994353 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:03.994404 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:03.994549 (+ 145us) server_negotiation.cc:299] Negotiation successful
0811 16:42:03.994615 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 16:42:03.994731 32008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:03.988275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.253:40523 (local address 127.0.0.1:54804)
0811 16:42:03.988343 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:03.988354 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:03.988396 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:03.988588 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:03.988590 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:03.988744 (+ 154us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:03.988812 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:03.988813 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:03.989493 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:03.989495 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:03.990071 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:03.990074 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:03.990458 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:03.990459 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:03.990548 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:03.990986 (+ 438us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:03.990990 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:03.992259 (+ 1269us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:03.993703 (+ 1444us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:03.993704 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:03.993704 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:03.993927 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:03.994091 (+ 164us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:03.994092 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:03.994092 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:03.994184 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:03.994407 (+ 223us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:03.994408 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:03.994464 (+ 56us) client_negotiation.cc:769] Sending connection context
0811 16:42:03.994531 (+ 67us) client_negotiation.cc:240] Negotiation successful
0811 16:42:03.994632 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260811 16:42:03.995147 32003 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.175.252" port: 34831 } has no permanent_uuid. Determining permanent_uuid...
I20260811 16:42:03.995522 32008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:03.995416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.252:34831 (local address 127.0.0.1:46810)
0811 16:42:03.995460 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:03.995496 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.252:34831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260811 16:42:03.995862 32008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:03.995787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.252:34831 (local address 127.0.0.1:46822)
0811 16:42:03.995821 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:03.995845 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.252:34831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
W20260811 16:42:03.995937 32003 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.175.252:34831: Network error: Client connection negotiation failed: client connection to 127.24.175.252:34831: connect: Connection refused (error 111)
I20260811 16:42:04.009200 32142 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.175.252" port: 34831 } attempt: 1
I20260811 16:42:04.009737 32145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:04.009578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.252:34831 (local address 127.0.0.1:46838)
0811 16:42:04.009663 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:04.009704 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.252:34831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260811 16:42:04.010102 32145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:04.009973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.252:34831 (local address 127.0.0.1:46844)
0811 16:42:04.010042 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:04.010075 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.252:34831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260811 16:42:04.010219 32142 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.175.252:34831: Network error: Client connection negotiation failed: client connection to 127.24.175.252:34831: connect: Connection refused (error 111)
I20260811 16:42:04.027070 32003 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.175.252" port: 34831 } attempt: 1
I20260811 16:42:04.027504 32008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:04.027370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.252:34831 (local address 127.0.0.1:46850)
0811 16:42:04.027428 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:04.027472 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.252:34831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260811 16:42:04.027851 32008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:04.027764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.252:34831 (local address 127.0.0.1:46866)
0811 16:42:04.027801 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:04.027829 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.252:34831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
W20260811 16:42:04.027937 32003 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.175.252:34831: Network error: Client connection negotiation failed: client connection to 127.24.175.252:34831: connect: Connection refused (error 111)
W20260811 16:42:04.053887 32151 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 16:42:04.054095 32151 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:04.054109 32151 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:04.054127 32151 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:04.055282 32151 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:42:04.055323 32151 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:04.055336 32151 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:04.055346 32151 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:42:04.055357 32151 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:42:04.056792 32151 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.175.212:39487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.24.175.254:40433,127.24.175.253:40523,127.24.175.252:34831
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/krb5kdc/kudu_127.24.175.252.keytab
--principal=kudu/127.24.175.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.175.252:34831
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.24.175.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32151
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:04.057000 32151 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:04.057237 32151 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:42:04.062004 32159 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:04.062026 32163 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:04.062263 32151 server_base.cc:1034] running on GCE node
W20260811 16:42:04.062031 32160 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:04.062575 32151 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:04.062875 32151 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:04.064033 32151 hybrid_clock.cc:648] HybridClock initialized: now 1786466524064016 us; error 27 us; skew 500 ppm
Aug 11 16:42:04 dist-test-slave-zj8q krb5kdc[31869](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466524, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:04.066964 32151 init.cc:377] Logged in from keytab as kudu/127.24.175.252@KRBTEST.COM (short username kudu)
I20260811 16:42:04.067497 32151 webserver.cc:460] Webserver started at http://127.24.175.252:39801/ using document root <none> and password file <none>
I20260811 16:42:04.067726 32151 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:04.067777 32151 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:04.067921 32151 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:42:04.069052 32151 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/minicluster-data/master-2/data/instance:
uuid: "dbd91c1b20b1442eb93ec4b52839ca4d"
format_stamp: "Formatted at 2026-08-11 16:42:04 on dist-test-slave-zj8q"
server_key: "fa5424ab42eaf16991323007d3496681"
server_key_iv: "cc96506988f5c1620b287fa459629221"
server_key_version: "encryptionkey@0"
I20260811 16:42:04.069408 32151 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/minicluster-data/master-2/wal/instance:
uuid: "dbd91c1b20b1442eb93ec4b52839ca4d"
format_stamp: "Formatted at 2026-08-11 16:42:04 on dist-test-slave-zj8q"
server_key: "fa5424ab42eaf16991323007d3496681"
server_key_iv: "cc96506988f5c1620b287fa459629221"
server_key_version: "encryptionkey@0"
I20260811 16:42:04.070771 32151 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:42:04.071451 32174 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:04.071651 32151 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:42:04.071750 32151 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/minicluster-data/master-2/data,/tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/minicluster-data/master-2/wal
uuid: "dbd91c1b20b1442eb93ec4b52839ca4d"
format_stamp: "Formatted at 2026-08-11 16:42:04 on dist-test-slave-zj8q"
server_key: "fa5424ab42eaf16991323007d3496681"
server_key_iv: "cc96506988f5c1620b287fa459629221"
server_key_version: "encryptionkey@0"
I20260811 16:42:04.071816 32151 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:04.078363 32142 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.175.252" port: 34831 } attempt: 2
I20260811 16:42:04.078763 32145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:04.078626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.252:34831 (local address 127.0.0.1:46882)
0811 16:42:04.078693 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:04.078733 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.252:34831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260811 16:42:04.079047 32145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:04.078977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.252:34831 (local address 127.0.0.1:46898)
0811 16:42:04.079008 (+ 31us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:04.079030 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.175.252:34831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
W20260811 16:42:04.079120 32142 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.175.252:34831: Network error: Client connection negotiation failed: client connection to 127.24.175.252:34831: connect: Connection refused (error 111)
I20260811 16:42:04.080610 32151 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:04.082633 32151 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:04.082741 32151 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:04.086622 32151 rpc_server.cc:307] RPC server started. Bound to: 127.24.175.252:34831
I20260811 16:42:04.086691 32254 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.175.252:34831 every 8 connection(s)
I20260811 16:42:04.086987 32151 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/minicluster-data/master-2/data/info.pb
I20260811 16:42:04.087857 32257 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:04.089360 32257 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.175.254" port: 40433 } has no permanent_uuid. Determining permanent_uuid...
I20260811 16:42:04.093762 25279 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkGJqOS/build/release/bin/kudu as pid 32151
I20260811 16:42:04.093868 25279 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkGJqOS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466249441839-25279-0/minicluster-data/master-2/wal/instance
I20260811 16:42:04.094034 25279 external_mini_cluster.cc:1428] Setting key d07e0e8168c0db43bb181a2df9634cab
Aug 11 16:42:04 dist-test-slave-zj8q krb5kdc[31869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466524, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.252@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
I20260811 16:42:04.098263 32007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:04.090029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57458 (local address 127.24.175.254:40433)
0811 16:42:04.090093 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:04.090096 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:04.090309 (+ 213us) server_negotiation.cc:407] Connection header received
0811 16:42:04.090812 (+ 503us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:04.090813 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:04.090827 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:04.090878 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:04.091482 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:04.091957 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:04.092898 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:04.093088 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:04.093153 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:04.095562 (+ 2409us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:04.095564 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:04.095565 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:04.095573 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:04.096846 (+ 1273us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:04.097288 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:04.097289 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:04.097290 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:04.097351 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:04.097557 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:04.097558 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:04.097558 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:04.097713 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:04.097765 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:04.098068 (+ 303us) server_negotiation.cc:299] Negotiation successful
0811 16:42:04.098140 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 16:42:04.098453 32262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:04.089981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.254:40433 (local address 127.0.0.1:57458)
0811 16:42:04.090148 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:04.090216 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:04.090715 (+ 499us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:04.090944 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:04.090947 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:04.091188 (+ 241us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:04.091401 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:04.091406 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:04.092036 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:04.092037 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:04.092819 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:04.092821 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:04.093155 (+ 334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:04.093156 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:04.093280 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:04.093763 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:04.093773 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:04.095486 (+ 1713us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:04.096922 (+ 1436us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:04.096930 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:04.096932 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:04.097230 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:04.097410 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:04.097411 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:04.097411 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:04.097504 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:04.097793 (+ 289us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:04.097800 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:04.097929 (+ 129us) client_negotiation.cc:769] Sending connection context
0811 16:42:04.098042 (+ 113us) client_negotiation.cc:240] Negotiation successful
0811 16:42:04.098224 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":77,"threads_started":1}
I20260811 16:42:04.099128 32257 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.175.253" port: 40523 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 16:42:04 dist-test-slave-zj8q krb5kdc[31869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466523, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.175.252@KRBTEST.COM
Aug 11 16:42:04 dist-test-slave-zj8q krb5kdc[31869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466524, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.252@KRBTEST.COM for kudu/127.24.175.253@KRBTEST.COM
I20260811 16:42:04.102514 32264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:04.094400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46914 (local address 127.24.175.252:34831)
0811 16:42:04.094541 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:04.094545 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:04.094616 (+ 71us) server_negotiation.cc:407] Connection header received
0811 16:42:04.094656 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:04.094658 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:04.094678 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:04.094758 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:04.095394 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:04.096352 (+ 958us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:04.097157 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:04.097516 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:04.097576 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:04.100054 (+ 2478us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:04.100062 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:04.100062 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:04.100069 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:04.101389 (+ 1320us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:04.101739 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:04.101742 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:04.101742 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:04.101810 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:04.101982 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:04.101983 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:04.101983 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:04.102101 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:04.102258 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:04.102352 (+ 94us) server_negotiation.cc:299] Negotiation successful
0811 16:42:04.102424 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":65,"threads_started":1}
I20260811 16:42:04.103072 32003 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.175.252" port: 34831 } attempt: 2
I20260811 16:42:04.105913 32262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:04.099374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.253:40523 (local address 127.0.0.1:54810)
0811 16:42:04.099427 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:04.099437 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:04.099478 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:04.099583 (+ 105us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:04.099583 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:04.099719 (+ 136us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:04.099773 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:04.099775 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:04.100322 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:04.100323 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:04.100936 (+ 613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:04.100939 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:04.101291 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:04.101291 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:04.101357 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:04.101663 (+ 306us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:04.101667 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:04.102795 (+ 1128us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:04.104969 (+ 2174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:04.104970 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:04.104970 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:04.105125 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:04.105292 (+ 167us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:04.105293 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:04.105293 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:04.105349 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:04.105607 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:04.105608 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:04.105666 (+ 58us) client_negotiation.cc:769] Sending connection context
0811 16:42:04.105744 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 16:42:04.105829 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260811 16:42:04.105935 32147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:04.099436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54810 (local address 127.24.175.253:40523)
0811 16:42:04.099486 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:04.099488 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:04.099498 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:42:04.099525 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:04.099526 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:04.099534 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:04.099576 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:04.099838 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:04.100270 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:04.101016 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:04.101234 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:04.101287 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:04.102879 (+ 1592us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:04.102880 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:04.102880 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:04.102886 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:04.104902 (+ 2016us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:04.105184 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:04.105185 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:04.105185 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:04.105238 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:04.105398 (+ 160us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:04.105399 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:04.105400 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:04.105520 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:04.105592 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:04.105778 (+ 186us) server_negotiation.cc:299] Negotiation successful
0811 16:42:04.105854 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 16:42:04.106606 32257 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.175.252" port: 34831 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 16:42:04 dist-test-slave-zj8q krb5kdc[31869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466523, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.175.254@KRBTEST.COM
Aug 11 16:42:04 dist-test-slave-zj8q krb5kdc[31869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466523, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.254@KRBTEST.COM for kudu/127.24.175.252@KRBTEST.COM
Aug 11 16:42:04 dist-test-slave-zj8q krb5kdc[31869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466524, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.252@KRBTEST.COM for kudu/127.24.175.252@KRBTEST.COM
I20260811 16:42:04.111215 32008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:04.103301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.252:34831 (local address 127.0.0.1:46918)
0811 16:42:04.103390 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:04.103399 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:04.103438 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:04.103606 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:04.103607 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:04.103759 (+ 152us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:04.103799 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:04.103801 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:04.104502 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:04.104503 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:04.105855 (+ 1352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:04.105858 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:04.106523 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:04.106524 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:04.106582 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:04.107018 (+ 436us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:04.107023 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:04.108538 (+ 1515us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:04.110005 (+ 1467us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:04.110006 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:04.110007 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:04.110287 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:04.110494 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:04.110495 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:04.110495 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:04.110553 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:04.110817 (+ 264us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:04.110818 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:04.110865 (+ 47us) client_negotiation.cc:769] Sending connection context
0811 16:42:04.110911 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 16:42:04.110999 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":70}
I20260811 16:42:04.111310 32264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:04.103382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46918 (local address 127.24.175.252:34831)
0811 16:42:04.103503 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:04.103504 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:04.103510 (+ 6us) server_negotiation.cc:407] Connection header received
0811 16:42:04.103527 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:04.103528 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:04.103537 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:04.103583 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:04.103886 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:04.104440 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:04.105937 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:04.106451 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:04.106511 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:04.108610 (+ 2099us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:04.108611 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:04.108611 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:04.108618 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:04.109935 (+ 1317us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:04.110362 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:04.110364 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:04.110364 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:04.110421 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:04.110611 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:04.110612 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:04.110612 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:04.110730 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:04.111117 (+ 387us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:04.111154 (+ 37us) server_negotiation.cc:299] Negotiation successful
0811 16:42:04.111223 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103}
I20260811 16:42:04.111975 32007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:04.103305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57472 (local address 127.24.175.254:40433)
0811 16:42:04.103338 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:04.103340 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:04.103346 (+ 6us) server_negotiation.cc:407] Connection header received
0811 16:42:04.103365 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:04.103366 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:04.103374 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:04.103416 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:04.103958 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:04.104588 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:04.105453 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:04.105715 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:04.105777 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:04.108749 (+ 2972us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:04.108751 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:04.108751 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:04.108758 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:04.110733 (+ 1975us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:04.111067 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:04.111068 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:04.111068 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:04.111134 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:04.111333 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:04.111334 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:04.111334 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:04.111455 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:04.111609 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:04.111828 (+ 219us) server_negotiation.cc:299] Negotiation successful
0811 16:42:04.111899 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260811 16:42:04.112962 32003 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2603e53d00cf4e94bec2d81ceea5fad6: Bootstrap starting.
I20260811 16:42:04.113731 32003 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2603e53d00cf4e94bec2d81ceea5fad6: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:04.114050 32003 log.cc:824] T 00000000000000000000000000000000 P 2603e53d00cf4e94bec2d81ceea5fad6: Log is configured to *not* fsync() on all Append() calls
I20260811 16:42:04.114172 32262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:04.106860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.252:34831 (local address 127.0.0.1:46922)
0811 16:42:04.106900 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:04.106909 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:04.106947 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:04.107190 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:04.107191 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:04.107308 (+ 117us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:04.107339 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:04.107340 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:04.108027 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:04.108029 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:04.108729 (+ 700us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:04.108732 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:04.109142 (+ 410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:04.109143 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:04.109201 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:04.109582 (+ 381us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:04.109587 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:04.110940 (+ 1353us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:04.113227 (+ 2287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:04.113227 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:04.113228 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:04.113378 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:04.113532 (+ 154us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:04.113533 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:04.113533 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:04.113584 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:04.113853 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:04.113854 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:04.113887 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 16:42:04.113946 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 16:42:04.114040 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26}
I20260811 16:42:04.114300 32265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:04.106893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46922 (local address 127.24.175.252:34831)
0811 16:42:04.107062 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:04.107064 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:04.107072 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:42:04.107091 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:04.107092 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:04.107102 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:04.107176 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:04.107417 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:04.107953 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:04.108804 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:04.109058 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:04.109125 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:04.111017 (+ 1892us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:04.111018 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:04.111019 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:04.111025 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:04.113167 (+ 2142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:04.113433 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:04.113434 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:04.113434 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:04.113484 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:04.113638 (+ 154us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:04.113639 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:04.113639 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:04.113774 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:04.113833 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:04.113997 (+ 164us) server_negotiation.cc:299] Negotiation successful
0811 16:42:04.114100 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":22,"server-negotiator.queue_time_us":147,"thread_start_us":99,"threads_started":1}
I20260811 16:42:04.115037 32003 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2603e53d00cf4e94bec2d81ceea5fad6: No bootstrap required, opened a new log
I20260811 16:42:04.115847 32257 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dbd91c1b20b1442eb93ec4b52839ca4d: Bootstrap starting.
I20260811 16:42:04.116510 32257 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dbd91c1b20b1442eb93ec4b52839ca4d: Neither blocks nor log segments found. Creating new log.
Aug 11 16:42:04 dist-test-slave-zj8q krb5kdc[31869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466523, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.175.253@KRBTEST.COM
I20260811 16:42:04.116781 32257 log.cc:824] T 00000000000000000000000000000000 P dbd91c1b20b1442eb93ec4b52839ca4d: Log is configured to *not* fsync() on all Append() calls
I20260811 16:42:04.117075 32003 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2603e53d00cf4e94bec2d81ceea5fad6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2603e53d00cf4e94bec2d81ceea5fad6" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 40433 } } peers { permanent_uuid: "13362fee357740f89717bd65a07ff608" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 40523 } } peers { permanent_uuid: "dbd91c1b20b1442eb93ec4b52839ca4d" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 34831 } }
I20260811 16:42:04.117177 32003 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2603e53d00cf4e94bec2d81ceea5fad6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2603e53d00cf4e94bec2d81ceea5fad6, State: Initialized, Role: FOLLOWER
I20260811 16:42:04.117233 32003 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2603e53d00cf4e94bec2d81ceea5fad6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2603e53d00cf4e94bec2d81ceea5fad6" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 40433 } } peers { permanent_uuid: "13362fee357740f89717bd65a07ff608" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 40523 } } peers { permanent_uuid: "dbd91c1b20b1442eb93ec4b52839ca4d" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 34831 } }
I20260811 16:42:04.117496 32270 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2603e53d00cf4e94bec2d81ceea5fad6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2603e53d00cf4e94bec2d81ceea5fad6" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 40433 } } peers { permanent_uuid: "13362fee357740f89717bd65a07ff608" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 40523 } } peers { permanent_uuid: "dbd91c1b20b1442eb93ec4b52839ca4d" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 34831 } } }
I20260811 16:42:04.117554 32003 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2603e53d00cf4e94bec2d81ceea5fad6 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:42:04.117568 32270 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2603e53d00cf4e94bec2d81ceea5fad6 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:42:04.117807 32257 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dbd91c1b20b1442eb93ec4b52839ca4d: No bootstrap required, opened a new log
I20260811 16:42:04.119676 32257 raft_consensus.cc:348] T 00000000000000000000000000000000 P dbd91c1b20b1442eb93ec4b52839ca4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2603e53d00cf4e94bec2d81ceea5fad6" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 40433 } } peers { permanent_uuid: "13362fee357740f89717bd65a07ff608" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 40523 } } peers { permanent_uuid: "dbd91c1b20b1442eb93ec4b52839ca4d" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 34831 } }
I20260811 16:42:04.119907 32257 raft_consensus.cc:729] T 00000000000000000000000000000000 P dbd91c1b20b1442eb93ec4b52839ca4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbd91c1b20b1442eb93ec4b52839ca4d, State: Initialized, Role: FOLLOWER
I20260811 16:42:04.120041 32257 consensus_queue.cc:260] T 00000000000000000000000000000000 P dbd91c1b20b1442eb93ec4b52839ca4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2603e53d00cf4e94bec2d81ceea5fad6" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 40433 } } peers { permanent_uuid: "13362fee357740f89717bd65a07ff608" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 40523 } } peers { permanent_uuid: "dbd91c1b20b1442eb93ec4b52839ca4d" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 34831 } }
I20260811 16:42:04.120148 32147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:04.112928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54812 (local address 127.24.175.253:40523)
0811 16:42:04.112961 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:04.112963 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:04.112971 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:42:04.113010 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:04.113011 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:04.113019 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:04.113073 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:04.113682 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:04.114364 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:04.115078 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:04.115287 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:04.115339 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:04.117265 (+ 1926us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:04.117266 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:04.117266 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:04.117273 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:04.118754 (+ 1481us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:04.119096 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:04.119097 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:04.119097 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:04.119151 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:04.119310 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:04.119311 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:04.119311 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:04.119485 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:04.119647 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:04.119996 (+ 349us) server_negotiation.cc:299] Negotiation successful
0811 16:42:04.120066 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
W20260811 16:42:04.120198 32290 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2603e53d00cf4e94bec2d81ceea5fad6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 16:42:04.120239 32290 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 16:42:04.120520 32257 sys_catalog.cc:564] T 00000000000000000000000000000000 P dbd91c1b20b1442eb93ec4b52839ca4d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:42:04.121469 25279 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:42:04.122073 32295 sys_catalog.cc:455] T 00000000000000000000000000000000 P dbd91c1b20b1442eb93ec4b52839ca4d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2603e53d00cf4e94bec2d81ceea5fad6" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 40433 } } peers { permanent_uuid: "13362fee357740f89717bd65a07ff608" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 40523 } } peers { permanent_uuid: "dbd91c1b20b1442eb93ec4b52839ca4d" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 34831 } } }
W20260811 16:42:04.122381 32310 catalog_manager.cc:1558] T 00000000000000000000000000000000 P dbd91c1b20b1442eb93ec4b52839ca4d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260811 16:42:04.122423 32295 sys_catalog.cc:458] T 00000000000000000000000000000000 P dbd91c1b20b1442eb93ec4b52839ca4d [sys.catalog]: This master's current role is: FOLLOWER
W20260811 16:42:04.122460 32310 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 16:42:04.122496 31961 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "2603e53d00cf4e94bec2d81ceea5fad6"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57472
I20260811 16:42:04.122622 31961 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2603e53d00cf4e94bec2d81ceea5fad6 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:42:04.122670 31961 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2603e53d00cf4e94bec2d81ceea5fad6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:04.123322 31961 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2603e53d00cf4e94bec2d81ceea5fad6 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2603e53d00cf4e94bec2d81ceea5fad6" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 40433 } } peers { permanent_uuid: "13362fee357740f89717bd65a07ff608" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 40523 } } peers { permanent_uuid: "dbd91c1b20b1442eb93ec4b52839ca4d" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 34831 } }
I20260811 16:42:04.120975 31884 master_runner.cc:186] Error getting master registration for 127.24.175.253:40523: OK, instance_id { permanent_uuid: "13362fee357740f89717bd65a07ff608" instance_seqno: 1786466523936044 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 16:42:04.123409 31884 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 16:42:04.123536 31961 leader_election.cc:288] T 00000000000000000000000000000000 P 2603e53d00cf4e94bec2d81ceea5fad6 [CANDIDATE]: Term 1 election: Requested vote from peers 13362fee357740f89717bd65a07ff608 (127.24.175.253:40523), dbd91c1b20b1442eb93ec4b52839ca4d (127.24.175.252:34831)
I20260811 16:42:04.123950 32212 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2603e53d00cf4e94bec2d81ceea5fad6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "dbd91c1b20b1442eb93ec4b52839ca4d"
I20260811 16:42:04.124058 32212 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dbd91c1b20b1442eb93ec4b52839ca4d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:04.124854 32212 raft_consensus.cc:2454] T 00000000000000000000000000000000 P dbd91c1b20b1442eb93ec4b52839ca4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2603e53d00cf4e94bec2d81ceea5fad6 in term 1.
I20260811 16:42:04.125080 31911 leader_election.cc:302] T 00000000000000000000000000000000 P 2603e53d00cf4e94bec2d81ceea5fad6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2603e53d00cf4e94bec2d81ceea5fad6, dbd91c1b20b1442eb93ec4b52839ca4d; no voters:
I20260811 16:42:04.125197 32270 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2603e53d00cf4e94bec2d81ceea5fad6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:42:04.125352 32270 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2603e53d00cf4e94bec2d81ceea5fad6 [term 1 LEADER]: Becoming Leader. State: Replica: 2603e53d00cf4e94bec2d81ceea5fad6, State: Running, Role: LEADER
I20260811 16:42:04.125434 32270 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2603e53d00cf4e94bec2d81ceea5fad6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2603e53d00cf4e94bec2d81ceea5fad6" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 40433 } } peers { permanent_uuid: "13362fee357740f89717bd65a07ff608" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 40523 } } peers { permanent_uuid: "dbd91c1b20b1442eb93ec4b52839ca4d" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 34831 } }
I20260811 16:42:04.125830 32270 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2603e53d00cf4e94bec2d81ceea5fad6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2603e53d00cf4e94bec2d81ceea5fad6. Latest consensus state: current_term: 1 leader_uuid: "2603e53d00cf4e94bec2d81ceea5fad6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2603e53d00cf4e94bec2d81ceea5fad6" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 40433 } } peers { permanent_uuid: "13362fee357740f89717bd65a07ff608" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 40523 } } peers { permanent_uuid: "dbd91c1b20b1442eb93ec4b52839ca4d" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 34831 } } }
I20260811 16:42:04.125911 32270 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2603e53d00cf4e94bec2d81ceea5fad6 [sys.catalog]: This master's current role is: LEADER
I20260811 16:42:04.126684 32325 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:42:04.127040 32325 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:42:04.125494 32151 master_runner.cc:186] Error getting master registration for 127.24.175.253:40523: OK, instance_id { permanent_uuid: "13362fee357740f89717bd65a07ff608" instance_seqno: 1786466523936044 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 16:42:04.127559 32151 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 16:42:04.128842 32212 raft_consensus.cc:1261] T 00000000000000000000000000000000 P dbd91c1b20b1442eb93ec4b52839ca4d [term 1 FOLLOWER]: Refusing update from remote peer 2603e53d00cf4e94bec2d81ceea5fad6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:42:04.129122 32270 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2603e53d00cf4e94bec2d81ceea5fad6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbd91c1b20b1442eb93ec4b52839ca4d" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 34831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:42:04.130358 32295 sys_catalog.cc:455] T 00000000000000000000000000000000 P dbd91c1b20b1442eb93ec4b52839ca4d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2603e53d00cf4e94bec2d81ceea5fad6. Latest consensus state: current_term: 1 leader_uuid: "2603e53d00cf4e94bec2d81ceea5fad6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2603e53d00cf4e94bec2d81ceea5fad6" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 40433 } } peers { permanent_uuid: "13362fee357740f89717bd65a07ff608" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 40523 } } peers { permanent_uuid: "dbd91c1b20b1442eb93ec4b52839ca4d" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 34831 } } }
I20260811 16:42:04.130478 32295 sys_catalog.cc:458] T 00000000000000000000000000000000 P dbd91c1b20b1442eb93ec4b52839ca4d [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:42:04.138464 32270 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2603e53d00cf4e94bec2d81ceea5fad6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2603e53d00cf4e94bec2d81ceea5fad6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2603e53d00cf4e94bec2d81ceea5fad6" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 40433 } } peers { permanent_uuid: "13362fee357740f89717bd65a07ff608" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 40523 } } peers { permanent_uuid: "dbd91c1b20b1442eb93ec4b52839ca4d" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 34831 } } }
I20260811 16:42:04.138550 32270 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2603e53d00cf4e94bec2d81ceea5fad6 [sys.catalog]: This master's current role is: LEADER
I20260811 16:42:04.138935 32295 sys_catalog.cc:455] T 00000000000000000000000000000000 P dbd91c1b20b1442eb93ec4b52839ca4d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2603e53d00cf4e94bec2d81ceea5fad6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2603e53d00cf4e94bec2d81ceea5fad6" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 40433 } } peers { permanent_uuid: "13362fee357740f89717bd65a07ff608" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 40523 } } peers { permanent_uuid: "dbd91c1b20b1442eb93ec4b52839ca4d" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 34831 } } }
I20260811 16:42:04.139008 32295 sys_catalog.cc:458] T 00000000000000000000000000000000 P dbd91c1b20b1442eb93ec4b52839ca4d [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:42:04.139338 32326 mvcc.cc:205] Tried to move back new op lower bound from 7317366882829660160 to 7317366882818486272. Current Snapshot: MvccSnapshot[applied={T|T < 7317366882829660160}]
I20260811 16:42:04.139490 32327 mvcc.cc:205] Tried to move back new op lower bound from 7317366882829660160 to 7317366882818486272. Current Snapshot: MvccSnapshot[applied={T|T < 7317366882829660160 or (T in {7317366882829660160})}]
I20260811 16:42:04.140097 32325 catalog_manager.cc:1347] Generated new cluster ID: 504852238f454b6792589b32103cdc1b
I20260811 16:42:04.140141 32325 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:42:04.146626 32325 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:42:04.147394 32325 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:42:04.155112 32265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:04.130369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46930 (local address 127.24.175.252:34831)
0811 16:42:04.130539 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:04.130541 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:04.140258 (+ 9717us) server_negotiation.cc:407] Connection header received
0811 16:42:04.140345 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:04.140346 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:04.140356 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:04.140381 (+ 25us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:04.141005 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:04.141788 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:04.145779 (+ 3991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:04.146068 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:04.146107 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:04.149131 (+ 3024us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:04.149132 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:04.149133 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:04.149140 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:04.151360 (+ 2220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:04.152226 (+ 866us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:04.152227 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:04.152228 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:04.152280 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:04.153907 (+ 1627us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:04.153908 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:04.153908 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:04.154046 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:04.154121 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:04.154915 (+ 794us) server_negotiation.cc:299] Negotiation successful
0811 16:42:04.155006 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152}
I20260811 16:42:04.155952 32007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:04.130565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57478 (local address 127.24.175.254:40433)
0811 16:42:04.130601 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:04.130603 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:04.138497 (+ 7894us) server_negotiation.cc:407] Connection header received
0811 16:42:04.138716 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:04.138717 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:04.138728 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:04.138756 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:04.139552 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:04.140330 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:04.145120 (+ 4790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:04.145375 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:04.145415 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:04.148868 (+ 3453us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:04.148869 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:04.148870 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:04.148876 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:04.150695 (+ 1819us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:04.152690 (+ 1995us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:04.152691 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:04.152691 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:04.152745 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:04.154434 (+ 1689us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:04.154435 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:04.154435 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:04.154555 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:04.154627 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:04.155760 (+ 1133us) server_negotiation.cc:299] Negotiation successful
0811 16:42:04.155865 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 16:42:04.157594 32147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:04.130765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54818 (local address 127.24.175.253:40523)
0811 16:42:04.130816 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:04.130818 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:04.138653 (+ 7835us) server_negotiation.cc:407] Connection header received
0811 16:42:04.138681 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:04.138682 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:04.138694 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:04.138751 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:04.141021 (+ 2270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:04.141731 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:04.144400 (+ 2669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:04.144704 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:04.144744 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:04.151951 (+ 7207us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:04.151952 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:04.151952 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:04.151960 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:04.153392 (+ 1432us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:04.154190 (+ 798us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:04.154191 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:04.154192 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:04.154244 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:04.155473 (+ 1229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:04.155474 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:04.155474 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:04.155614 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:04.155686 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:04.157413 (+ 1727us) server_negotiation.cc:299] Negotiation successful
0811 16:42:04.157505 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 16:42:04.157855 32325 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2603e53d00cf4e94bec2d81ceea5fad6: Generated new TSK 0
I20260811 16:42:04.158219 32325 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:42:04.170259 32142 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.175.252" port: 34831 } attempt: 3
Aug 11 16:42:04 dist-test-slave-zj8q krb5kdc[31869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466523, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.175.253@KRBTEST.COM for kudu/127.24.175.252@KRBTEST.COM
I20260811 16:42:04.179232 32145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:04.170590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.175.252:34831 (local address 127.0.0.1:46934)
0811 16:42:04.170691 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:04.170701 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:04.170748 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:04.170881 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:04.170882 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:04.171070 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:04.171121 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:04.171123 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:04.171999 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:04.172000 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:04.172747 (+ 747us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:04.172751 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:04.173241 (+ 490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:04.173242 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:04.173296 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:04.173723 (+ 427us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:04.173729 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:04.175445 (+ 1716us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:04.178175 (+ 2730us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:04.178176 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:04.178177 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:04.178384 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:04.178586 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:04.178586 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:04.178587 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:04.178645 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:04.178916 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:04.178917 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:04.178964 (+ 47us) client_negotiation.cc:769] Sending connection context
0811 16:42:04.179019 (+ 55us) client_negotiation.cc:240] Negotiation successful
0811 16:42:04.179136 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":83}
I20260811 16:42:04.179692 32265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:04.170625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46934 (local address 127.24.175.252:34831)
0811 16:42:04.170665 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:04.170668 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:04.170733 (+ 65us) server_negotiation.cc:407] Connection header received
0811 16:42:04.170802 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:04.170803 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:04.170813 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:04.170871 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:04.171184 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:04.171925 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:04.172865 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:04.173180 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:04.173237 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:04.176440 (+ 3203us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:04.176441 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:04.176442 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:04.176450 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:04.178070 (+ 1620us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:04.178460 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:04.178462 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:04.178462 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:04.178521 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:04.178703 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:04.178704 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:04.178705 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:04.178832 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:04.178890 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:04.179522 (+ 632us) server_negotiation.cc:299] Negotiation successful
0811 16:42:04.179606 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 16:42:04.181747 32142 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 13362fee357740f89717bd65a07ff608: Bootstrap starting.
I20260811 16:42:04.182437 32142 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 13362fee357740f89717bd65a07ff608: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:04.182720 32142 log.cc:824] T 00000000000000000000000000000000 P 13362fee357740f89717bd65a07ff608: Log is configured to *not* fsync() on all Append() calls
I20260811 16:42:04.183559 32142 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 13362fee357740f89717bd65a07ff608: No bootstrap required, opened a new log
I20260811 16:42:04.185678 32142 raft_consensus.cc:348] T 00000000000000000000000000000000 P 13362fee357740f89717bd65a07ff608 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2603e53d00cf4e94bec2d81ceea5fad6" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 40433 } } peers { permanent_uuid: "13362fee357740f89717bd65a07ff608" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 40523 } } peers { permanent_uuid: "dbd91c1b20b1442eb93ec4b52839ca4d" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 34831 } }
I20260811 16:42:04.185824 32142 raft_consensus.cc:729] T 00000000000000000000000000000000 P 13362fee357740f89717bd65a07ff608 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13362fee357740f89717bd65a07ff608, State: Initialized, Role: FOLLOWER
I20260811 16:42:04.185906 32142 consensus_queue.cc:260] T 00000000000000000000000000000000 P 13362fee357740f89717bd65a07ff608 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2603e53d00cf4e94bec2d81ceea5fad6" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 40433 } } peers { permanent_uuid: "13362fee357740f89717bd65a07ff608" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 40523 } } peers { permanent_uuid: "dbd91c1b20b1442eb93ec4b52839ca4d" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 34831 } }
I20260811 16:42:04.186273 32142 sys_catalog.cc:564] T 00000000000000000000000000000000 P 13362fee357740f89717bd65a07ff608 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:42:04.186345 32100 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2603e53d00cf4e94bec2d81ceea5fad6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "13362fee357740f89717bd65a07ff608"
I20260811 16:42:04.186439 32100 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 13362fee357740f89717bd65a07ff608 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:04.187266 32100 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 13362fee357740f89717bd65a07ff608 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2603e53d00cf4e94bec2d81ceea5fad6 in term 1.
I20260811 16:42:04.187487 32099 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 13362fee357740f89717bd65a07ff608 [term 1 FOLLOWER]: Refusing update from remote peer 2603e53d00cf4e94bec2d81ceea5fad6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:42:04.187937 32270 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2603e53d00cf4e94bec2d81ceea5fad6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13362fee357740f89717bd65a07ff608" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 40523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 16:42:04.191653 32369 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 13362fee357740f89717bd65a07ff608: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 16:42:04.191706 32369 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 16:42:04.191793 32384 sys_catalog.cc:455] T 00000000000000000000000000000000 P 13362fee357740f89717bd65a07ff608 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2603e53d00cf4e94bec2d81ceea5fad6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2603e53d00cf4e94bec2d81ceea5fad6" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 40433 } } peers { permanent_uuid: "13362fee357740f89717bd65a07ff608" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 40523 } } peers { permanent_uuid: "dbd91c1b20b1442eb93ec4b52839ca4d" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 34831 } } }
I20260811 16:42:04.191869 32384 sys_catalog.cc:458] T 00000000000000000000000000000000 P 13362fee357740f89717bd65a07ff608 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:42:04.191910 32384 sys_catalog.cc:455] T 00000000000000000000000000000000 P 13362fee357740f89717bd65a07ff608 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2603e53d00cf4e94bec2d81ceea5fad6. Latest consensus state: current_term: 1 leader_uuid: "2603e53d00cf4e94bec2d81ceea5fad6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2603e53d00cf4e94bec2d81ceea5fad6" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 40433 } } peers { permanent_uuid: "13362fee357740f89717bd65a07ff608" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 40523 } } peers { permanent_uuid: "dbd91c1b20b1442eb93ec4b52839ca4d" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 34831 } } }
I20260811 16:42:04.191953 32384 sys_catalog.cc:458] T 00000000000000000000000000000000 P 13362fee357740f89717bd65a07ff608 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:42:04.191978 32384 sys_catalog.cc:455] T 00000000000000000000000000000000 P 13362fee357740f89717bd65a07ff608 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2603e53d00cf4e94bec2d81ceea5fad6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2603e53d00cf4e94bec2d81ceea5fad6" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 40433 } } peers { permanent_uuid: "13362fee357740f89717bd65a07ff608" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 40523 } } peers { permanent_uuid: "dbd91c1b20b1442eb93ec4b52839ca4d" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 34831 } } }
I20260811 16:42:04.192018 32384 sys_catalog.cc:458] T 00000000000000000000000000000000 P 13362fee357740f89717bd65a07ff608 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:42:04.193192 32378 mvcc.cc:205] Tried to move back new op lower bound from 7317366882944102400 to 7317366882818486272. Current Snapshot: MvccSnapshot[applied={T|T < 7317366882829660160}]
W20260811 16:42:04.200222 32147 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:42:04.199196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54834 (local address 127.24.175.253:40523)
0811 16:42:04.199233 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:04.199234 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:04.199611 (+ 377us) server_negotiation.cc:407] Connection header received
0811 16:42:04.199703 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:04.199704 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:04.199715 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:04.199744 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:04.200151 (+ 407us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54834: BlockingRecv error: recv got EOF from 127.0.0.1:54834 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260811 16:42:04.200222 32007 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:42:04.198966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57488 (local address 127.24.175.254:40433)
0811 16:42:04.199009 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:04.199011 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:04.199470 (+ 459us) server_negotiation.cc:407] Connection header received
0811 16:42:04.199565 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:04.199567 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:04.199579 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:04.199632 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:04.200148 (+ 516us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57488: BlockingRecv error: recv got EOF from 127.0.0.1:57488 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260811 16:42:04.201018 32265 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:42:04.198670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46946 (local address 127.24.175.252:34831)
0811 16:42:04.198717 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:04.198719 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:04.200464 (+ 1745us) server_negotiation.cc:407] Connection header received
0811 16:42:04.200562 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:04.200563 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:04.200575 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:04.200603 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:04.200950 (+ 347us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46946: BlockingRecv error: recv got EOF from 127.0.0.1:46946 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260811 16:42:04.208470 32147 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:42:04.207605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54842 (local address 127.24.175.253:40523)
0811 16:42:04.207645 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:04.207647 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:04.207887 (+ 240us) server_negotiation.cc:407] Connection header received
0811 16:42:04.207997 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:04.207998 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:04.208017 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:04.208046 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:04.208418 (+ 372us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54842: BlockingRecv error: recv got EOF from 127.0.0.1:54842 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260811 16:42:04.211576 32147 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:42:04.210771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54856 (local address 127.24.175.253:40523)
0811 16:42:04.210806 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:04.210808 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:04.211062 (+ 254us) server_negotiation.cc:407] Connection header received
0811 16:42:04.211167 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:04.211168 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:04.211179 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:04.211207 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:04.211525 (+ 318us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54856: BlockingRecv error: recv got EOF from 127.0.0.1:54856 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260811 16:42:04.215345 32147 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:42:04.214601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54868 (local address 127.24.175.253:40523)
0811 16:42:04.214645 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:04.214647 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:04.214871 (+ 224us) server_negotiation.cc:407] Connection header received
0811 16:42:04.214955 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:04.214956 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:04.214965 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:04.214990 (+ 25us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:04.215299 (+ 309us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54868: BlockingRecv error: recv got EOF from 127.0.0.1:54868 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260811 16:42:04.221302 32147 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:42:04.220455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54874 (local address 127.24.175.253:40523)
0811 16:42:04.220490 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:04.220491 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:04.220763 (+ 272us) server_negotiation.cc:407] Connection header received
0811 16:42:04.220860 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:04.220861 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:04.220871 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:04.220900 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:04.221257 (+ 357us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54874: BlockingRecv error: recv got EOF from 127.0.0.1:54874 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260811 16:42:04.231724 32147 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:42:04.230708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54888 (local address 127.24.175.253:40523)
0811 16:42:04.230758 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:04.230760 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:04.231048 (+ 288us) server_negotiation.cc:407] Connection header received
0811 16:42:04.231170 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:04.231171 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:04.231183 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:04.231216 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:04.231662 (+ 446us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54888: BlockingRecv error: recv got EOF from 127.0.0.1:54888 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260811 16:42:04.250033 32147 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:42:04.249035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54900 (local address 127.24.175.253:40523)
0811 16:42:04.249088 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:04.249090 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:04.249401 (+ 311us) server_negotiation.cc:407] Connection header received
0811 16:42:04.249513 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:04.249515 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:04.249527 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:04.249557 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:04.249971 (+ 414us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54900: BlockingRecv error: recv got EOF from 127.0.0.1:54900 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
W20260811 16:42:04.284513 32147 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:42:04.283485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54912 (local address 127.24.175.253:40523)
0811 16:42:04.283533 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:04.283535 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:04.283847 (+ 312us) server_negotiation.cc:407] Connection header received
0811 16:42:04.283953 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:04.283954 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:04.283966 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:04.283995 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:04.284451 (+ 456us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54912: BlockingRecv error: recv got EOF from 127.0.0.1:54912 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260811 16:42:04.350494 32147 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:42:04.349823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54914 (local address 127.24.175.253:40523)
0811 16:42:04.349877 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:04.349880 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:04.349947 (+ 67us) server_negotiation.cc:407] Connection header received
0811 16:42:04.349994 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:04.349995 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:04.350007 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:04.350087 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:04.350428 (+ 341us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54914: BlockingRecv error: recv got EOF from 127.0.0.1:54914 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
W20260811 16:42:04.480244 32147 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:42:04.479642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54920 (local address 127.24.175.253:40523)
0811 16:42:04.479720 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:04.479729 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:04.479762 (+ 33us) server_negotiation.cc:407] Connection header received
0811 16:42:04.479791 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:04.479792 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:04.479802 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:04.479843 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:04.480178 (+ 335us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54920: BlockingRecv error: recv got EOF from 127.0.0.1:54920 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 16:42:04.647722 32322 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2603e53d00cf4e94bec2d81ceea5fad6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2603e53d00cf4e94bec2d81ceea5fad6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2603e53d00cf4e94bec2d81ceea5fad6" member_type: VOTER last_known_addr { host: "127.24.175.254" port: 40433 } } peers { permanent_uuid: "13362fee357740f89717bd65a07ff608" member_type: VOTER last_known_addr { host: "127.24.175.253" port: 40523 } } peers { permanent_uuid: "dbd91c1b20b1442eb93ec4b52839ca4d" member_type: VOTER last_known_addr { host: "127.24.175.252" port: 34831 } } }
I20260811 16:42:04.647902 32322 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2603e53d00cf4e94bec2d81ceea5fad6 [sys.catalog]: This master's current role is: LEADER
W20260811 16:42:04.737994 32147 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:42:04.737435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54922 (local address 127.24.175.253:40523)
0811 16:42:04.737495 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:04.737496 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:04.737505 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:42:04.737531 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:04.737532 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:04.737542 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:04.737592 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:04.737943 (+ 351us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54922: BlockingRecv error: recv got EOF from 127.0.0.1:54922 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 16:42:05.122970 32310 catalog_manager.cc:1259] Loaded cluster ID: 504852238f454b6792589b32103cdc1b
I20260811 16:42:05.123054 32310 catalog_manager.cc:1552] T 00000000000000000000000000000000 P dbd91c1b20b1442eb93ec4b52839ca4d: loading cluster ID for follower catalog manager: success
I20260811 16:42:05.123890 32310 catalog_manager.cc:1574] T 00000000000000000000000000000000 P dbd91c1b20b1442eb93ec4b52839ca4d: acquiring CA information for follower catalog manager: success
I20260811 16:42:05.124200 32310 catalog_manager.cc:1602] T 00000000000000000000000000000000 P dbd91c1b20b1442eb93ec4b52839ca4d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 16:42:05.192145 32369 catalog_manager.cc:1259] Loaded cluster ID: 504852238f454b6792589b32103cdc1b
I20260811 16:42:05.192233 32369 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 13362fee357740f89717bd65a07ff608: loading cluster ID for follower catalog manager: success
I20260811 16:42:05.193127 32369 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 13362fee357740f89717bd65a07ff608: acquiring CA information for follower catalog manager: success
I20260811 16:42:05.193439 32369 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 13362fee357740f89717bd65a07ff608: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 16:42:05.253782 32510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:05.251235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54934 (local address 127.24.175.253:40523)
0811 16:42:05.251362 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:05.251364 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:05.251402 (+ 38us) server_negotiation.cc:407] Connection header received
0811 16:42:05.251473 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:05.251474 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:05.251550 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:05.251620 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:42:05.251763 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:05.252261 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:05.253009 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:05.253224 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:05.253285 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:05.253439 (+ 154us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:42:05.253558 (+ 119us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:42:05.253629 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:05.253666 (+ 37us) server_negotiation.cc:299] Negotiation successful
0811 16:42:05.253689 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103,"thread_start_us":62,"threads_started":1}
I20260811 16:42:05.257599 32523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:05.255557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46954 (local address 127.24.175.252:34831)
0811 16:42:05.255654 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:05.255656 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:05.255682 (+ 26us) server_negotiation.cc:407] Connection header received
0811 16:42:05.255718 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:05.255719 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:05.255754 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:05.255816 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:42:05.255893 (+ 77us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:05.256364 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:05.257015 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:05.257204 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:05.257245 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:05.257341 (+ 96us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:42:05.257442 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:42:05.257490 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:05.257517 (+ 27us) server_negotiation.cc:299] Negotiation successful
0811 16:42:05.257534 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75,"thread_start_us":51,"threads_started":1}
I20260811 16:42:05.261946 32532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:05.259206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57500 (local address 127.24.175.254:40433)
0811 16:42:05.259572 (+ 366us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:05.259574 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:05.259582 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:42:05.259630 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:05.259631 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:05.259683 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:05.259937 (+ 254us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:42:05.259977 (+ 40us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:05.260448 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:05.261172 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:05.261379 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:05.261431 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:05.261618 (+ 187us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:42:05.261728 (+ 110us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:42:05.261795 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:05.261840 (+ 45us) server_negotiation.cc:299] Negotiation successful
0811 16:42:05.261863 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":343,"thread_start_us":75,"threads_started":1}
I20260811 16:42:05.262260 32510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:05.259372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54946 (local address 127.24.175.253:40523)
0811 16:42:05.259416 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:05.259418 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:05.259524 (+ 106us) server_negotiation.cc:407] Connection header received
0811 16:42:05.259580 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:05.259581 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:05.259592 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:05.259633 (+ 41us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:42:05.259727 (+ 94us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:05.260446 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:05.261534 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:05.261740 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:05.261792 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:05.261964 (+ 172us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:42:05.261999 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:42:05.262025 (+ 26us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:05.262138 (+ 113us) server_negotiation.cc:299] Negotiation successful
0811 16:42:05.262184 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 16:42:05.262598 32523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:05.259363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46956 (local address 127.24.175.252:34831)
0811 16:42:05.259407 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:05.259409 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:05.259596 (+ 187us) server_negotiation.cc:407] Connection header received
0811 16:42:05.259793 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:05.259794 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:05.259802 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:05.259847 (+ 45us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:42:05.260000 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:05.260666 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:05.261642 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:05.261903 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:05.261939 (+ 36us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:05.262369 (+ 430us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:42:05.262399 (+ 30us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:42:05.262425 (+ 26us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:05.262510 (+ 85us) server_negotiation.cc:299] Negotiation successful
0811 16:42:05.262530 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 16:42:05.263674 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 31884
I20260811 16:42:05.282260 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 32012
I20260811 16:42:05.295980 25279 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkGJqOS/build/release/bin/kudu with pid 32151
2026-08-11T16:42:05Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (2943 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (5871 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (275864 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST